论文标题
立体内窥镜检查的深度估计设置和点测量的光学跟踪的比较
Comparison of Depth Estimation Setups from Stereo Endoscopy and Optical Tracking for Point Measurements
论文作者
论文摘要
为了支持最小侵入性的术中二尖瓣修复,可以使用红外轨道手写笔获得阀门的定量测量。希望查看此类手动测量点以及内窥镜图像以进行进一步的帮助。因此,需要手眼校准,以链接坐标系,并且是将点投射到图像平面上的先决条件。一种互补的方法是使用基于视觉的内窥镜立体声设定来检测和三角剖分点,以获得3D坐标。在本文中,我们旨在比较刚性幻影和两个类似于术中场景的患者个体硅酮复制品的两种方法。初步结果表明,使用深度学习方法手动或通过部分自动检测标记的3D地标估计,使用基于图像的方法进行的,可提供更准确的三角测量深度测量值,而不是用手写笔测量。
To support minimally-invasive intraoperative mitral valve repair, quantitative measurements from the valve can be obtained using an infra-red tracked stylus. It is desirable to view such manually measured points together with the endoscopic image for further assistance. Therefore, hand-eye calibration is required that links both coordinate systems and is a prerequisite to project the points onto the image plane. A complementary approach to this is to use a vision-based endoscopic stereo-setup to detect and triangulate points of interest, to obtain the 3D coordinates. In this paper, we aim to compare both approaches on a rigid phantom and two patient-individual silicone replica which resemble the intraoperative scenario. The preliminary results indicate that 3D landmark estimation, either labeled manually or through partly automated detection with a deep learning approach, provides more accurate triangulated depth measurements when performed with a tailored image-based method than with stylus measurements.