论文标题
IDPL:基于动态伪标签的辅助辅助适应对抗学习分割方法
IDPL: Intra-subdomain adaptation adversarial learning segmentation method based on Dynamic Pseudo Labels
论文作者
论文摘要
无监督的域适应性(UDA)已应用于图像语义分割,以解决域偏移的问题。但是,在某些识别准确性较差的困难类别中,分割效应仍然不是理想的。为此,在本文中,提出了基于动态伪标签(IDPL)的辅助内适应性学习分割方法。整个过程包括3个步骤:首先,提出了实例级伪标签动态生成模块,该模块在全局类和本地实例中融合了类匹配的类信息,从而自适应地生成了每个类的最佳阈值,并获得了高质量的伪伪标签。其次,基于实例置信度的子域分类器模块可以根据简单且困难实例的相对比例将目标域分为简单且困难的子域。最后,提出了基于自我注意的子域对抗学习模块。它利用多头自我注意力在班级级别上的简单和困难的子域,借助产生的高质量伪标签,以专注于挖掘目标域图像的高脑类别区域中困难类别的特征,从而促进了类别的子域之间的班级水平条件分配,以提高困难类别的分裂效果,从而提高了难度类别的分组绩效。对于困难类别,实验结果表明,与其他最新主流方法相比,IDPL的性能得到了显着提高。
Unsupervised domain adaptation(UDA) has been applied to image semantic segmentation to solve the problem of domain offset. However, in some difficult categories with poor recognition accuracy, the segmentation effects are still not ideal. To this end, in this paper, Intra-subdomain adaptation adversarial learning segmentation method based on Dynamic Pseudo Labels(IDPL) is proposed. The whole process consists of 3 steps: Firstly, the instance-level pseudo label dynamic generation module is proposed, which fuses the class matching information in global classes and local instances, thus adaptively generating the optimal threshold for each class, obtaining high-quality pseudo labels. Secondly, the subdomain classifier module based on instance confidence is constructed, which can dynamically divide the target domain into easy and difficult subdomains according to the relative proportion of easy and difficult instances. Finally, the subdomain adversarial learning module based on self-attention is proposed. It uses multi-head self-attention to confront the easy and difficult subdomains at the class level with the help of generated high-quality pseudo labels, so as to focus on mining the features of difficult categories in the high-entropy region of target domain images, which promotes class-level conditional distribution alignment between the subdomains, improving the segmentation performance of difficult categories. For the difficult categories, the experimental results show that the performance of IDPL is significantly improved compared with other latest mainstream methods.