论文标题

基于多个实例学习的胰腺癌玫瑰图像分类

Pancreatic Cancer ROSE Image Classification Based on Multiple Instance Learning with Shuffle Instances

论文作者

Zhang, Tianyi, Feng, Youdan, Feng, Yunlu, Zhang, Guanglei

论文摘要

快速的现场评估(ROSE)技术可以通过立即使用现场病理学家分析快速染色的细胞病理图像来显着掌握胰腺癌的诊断工作流程。使用深度学习方法的计算机辅助诊断(CAD)有可能解决病理不足的问题。但是,玫瑰图像的癌性模式在不同的样品之间差异很大,这使得CAD任务极具挑战性。此外,由于染色质量和各种类型的采集设备,玫瑰图像在颜色分布,亮度和对比度方面也具有柔和的扰动。为了应对这些挑战,我们使用包含该实例的洗牌片提出了一种新颖的多个实例学习(MIL)方法,该方法采用了基于贴片的视觉变压器学习策略。该方法凭借重新组的洗牌实例及其袋子级软标签,该方法利用MIL头将模型集中在胰腺癌细胞的特征上,而不是来自玫瑰图像中各种扰动的特征。同时,该模型与分类头结合在一起,可以有效地识别不同实例的Gen-order分布模式。结果表明,分类准确性的显着提高,具有更准确的态度区域,表明玫瑰图像的各种模式有效地提取,并且玫瑰图像的复杂扰动被显着消除。这也表明,带有洗牌实例的MIL在细胞病理图像的分析中具有巨大的潜力。

The rapid on-site evaluation (ROSE) technique can significantly ac-celerate the diagnostic workflow of pancreatic cancer by immediately analyzing the fast-stained cytopathological images with on-site pathologists. Computer-aided diagnosis (CAD) using the deep learning method has the potential to solve the problem of insufficient pathology staffing. However, the cancerous patterns of ROSE images vary greatly between different samples, making the CAD task extremely challenging. Besides, due to different staining qualities and various types of acquisition devices, the ROSE images also have compli-cated perturbations in terms of color distribution, brightness, and contrast. To address these challenges, we proposed a novel multiple instance learning (MIL) approach using shuffle patches containing the instances, which adopts the patch-based learning strategy of Vision Transformers. With the re-grouped bags of shuffle instances and their bag-level soft labels, the approach utilizes a MIL head to make the model focus on the features from the pancreatic cancer cells, rather than that from various perturbations in ROSE images. Simultaneously, combined with a classification head, the model can effectively identify the gen-eral distributive patterns across different instances. The results demonstrate the significant improvements in the classification accuracy with more accurate at-tention regions, indicating that the diverse patterns of ROSE images are effec-tively extracted, and the complicated perturbations of ROSE images are signifi-cantly eliminated. It also suggests that the MIL with shuffle instances has great potential in the analysis of cytopathological images.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源