论文标题
双边不对称引导的反事实生成网络用于乳房X线照片分类
Bilateral Asymmetry Guided Counterfactual Generating Network for Mammogram Classification
论文作者
论文摘要
由于缺乏病变注释,乳房X线图良性良性或恶性分类是具有挑战性的。在对称之前的动机,乳房一侧的病变很少出现在另一侧的相应区域,鉴于患病的图像,我们可以探索一个反事实问题,即如果图像中没有病变,特征将如何表现,以识别病变区域。我们基于对称的先验获得了反事实生成的新理论结果。通过构建一个有需要双边图像的先验的因果模型,我们获得了反事实生成的两个优化目标,可以通过我们新提出的反事实生成网络来实现。我们提出的模型主要由发电机对抗网络和\ emph {预测反馈机制}组成,它们是共同优化并互相提示的。具体而言,前者可以通过产生反事实特征来计算病变区域来进一步改善分类性能。另一方面,后者通过监督分类损失有助于反事实。我们的方法的实用性以及我们模型中每个模块的有效性可以通过在Inbreast上的最新性能以及内部数据集和消融研究来验证。
Mammogram benign or malignant classification with only image-level labels is challenging due to the absence of lesion annotations. Motivated by the symmetric prior that the lesions on one side of breasts rarely appear in the corresponding areas on the other side, given a diseased image, we can explore a counterfactual problem that how would the features have behaved if there were no lesions in the image, so as to identify the lesion areas. We derive a new theoretical result for counterfactual generation based on the symmetric prior. By building a causal model that entails such a prior for bilateral images, we obtain two optimization goals for counterfactual generation, which can be accomplished via our newly proposed counterfactual generative network. Our proposed model is mainly composed of Generator Adversarial Network and a \emph{prediction feedback mechanism}, they are optimized jointly and prompt each other. Specifically, the former can further improve the classification performance by generating counterfactual features to calculate lesion areas. On the other hand, the latter helps counterfactual generation by the supervision of classification loss. The utility of our method and the effectiveness of each module in our model can be verified by state-of-the-art performance on INBreast and an in-house dataset and ablation studies.