论文标题
物理和语义知情的多传感器校准通过优化理论和自我监督学习
Physics and semantic informed multi-sensor calibration via optimization theory and self-supervised learning
论文作者
论文摘要
实现安全可靠的自主驾驶在很大程度上取决于实现准确,强大的感知系统的能力;但是,如果没有精确校准的传感器,这将无法完全实现。环境和操作条件以及不当维护可能会产生校准误差,从而抑制传感器融合,从而降低感知性能。传统上,传感器校准是在具有一个或多个已知目标的受控环境中进行的。这样的程序只能在驱动器之间进行,并且需要手动操作;如果需要定期进行的一项繁琐的任务。这引起了人们对在线无目标方法的最新兴趣,能够基于感知到的环境特征产生一组几何转换,但是,感应方式的冗余所需的冗余使这项任务更加具有挑战性,因为每种方式捕获的特征及其独特性可能会有所不同。我们提出了对摄像头雷达三重奏进行关节校准的整体方法。利用这些感应方式的先验知识和物理特性以及语义信息,我们在成本最小化框架内通过直接在线优化提出了两种无目标的校准方法,第二种是通过自我监督的学习(SSL)。
Achieving safe and reliable autonomous driving relies greatly on the ability to achieve an accurate and robust perception system; however, this cannot be fully realized without precisely calibrated sensors. Environmental and operational conditions as well as improper maintenance can produce calibration errors inhibiting sensor fusion and, consequently, degrading the perception performance. Traditionally, sensor calibration is performed in a controlled environment with one or more known targets. Such a procedure can only be carried out in between drives and requires manual operation; a tedious task if needed to be conducted on a regular basis. This sparked a recent interest in online targetless methods, capable of yielding a set of geometric transformations based on perceived environmental features, however, the required redundancy in sensing modalities makes this task even more challenging, as the features captured by each modality and their distinctiveness may vary. We present a holistic approach to performing joint calibration of a camera-lidar-radar trio. Leveraging prior knowledge and physical properties of these sensing modalities together with semantic information, we propose two targetless calibration methods within a cost minimization framework once via direct online optimization, and second via self-supervised learning (SSL).