论文标题

BRINET:弥合一杆分段的阶层内和阶层间隙

BriNet: Towards Bridging the Intra-class and Inter-class Gaps in One-Shot Segmentation

论文作者

Yang, Xianghui, Wang, Bairun, Chen, Kaige, Zhou, Xinchi, Yi, Shuai, Ouyang, Wanli, Zhou, Luping

论文摘要

很少有射击细分集中在模型的概括上,以细分有限的训练样本。尽管已经取得了巨大的改进,但现有方法仍然受到两个因素的限制。 (1)查询图像和支持图像之间的信息相互作用不足,留下了类内间隙。 (2)培训和推理阶段的对象类别没有重叠,而会留下一流的差距。因此,我们提出了一个框架,以弥合这些差距。首先,在查询图像的提取功能和支持图像的提取功能之间,即使用信息交换模块来强调共同对象之间。此外,为了精确定位查询对象,我们设计了一个多路细颗粒策略,能够更好地利用支持功能表示。其次,提出了一种新的在线改进策略,以帮助训练有素的模型适应了看不见的课程,通过在推理阶段切换查询角色和支持图像来实现。 The effectiveness of our framework is demonstrated by experimental results, which outperforms other competitive methods and leads to a new state-of-the-art on both PASCAL VOC and MSCOCO dataset.

Few-shot segmentation focuses on the generalization of models to segment unseen object instances with limited training samples. Although tremendous improvements have been achieved, existing methods are still constrained by two factors. (1) The information interaction between query and support images is not adequate, leaving intra-class gap. (2) The object categories at the training and inference stages have no overlap, leaving the inter-class gap. Thus, we propose a framework, BriNet, to bridge these gaps. First, more information interactions are encouraged between the extracted features of the query and support images, i.e., using an Information Exchange Module to emphasize the common objects. Furthermore, to precisely localize the query objects, we design a multi-path fine-grained strategy which is able to make better use of the support feature representations. Second, a new online refinement strategy is proposed to help the trained model adapt to unseen classes, achieved by switching the roles of the query and the support images at the inference stage. The effectiveness of our framework is demonstrated by experimental results, which outperforms other competitive methods and leads to a new state-of-the-art on both PASCAL VOC and MSCOCO dataset.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源