论文标题
深度半监督学习,具有双重对比的功能和语义
Deep Semi-supervised Learning with Double-Contrast of Features and Semantics
论文作者
论文摘要
近年来,智能运输系统(ITS)的领域取得了杰出的成功,这主要是由于大量可用注释数据所致。但是,获得这些注释的数据必须在现实中负担昂贵的成本。因此,一个更现实的策略是利用少量标记的数据和大量未标记的数据来利用半监督学习(SSL)。通常,已证明语义一致性正规化和分离特征提取和分类的两阶段学习方法已被证明有效。然而,仅限于语义一致性正规化的表示形式学习可能不能保证具有不同语义的样本的表示形式的分离或可区分性。由于两阶段学习方法的固有局限性,提取的功能可能与特定的下游任务不符。为了处理上述缺点,本文提出了语义和特征的端到端深度半监督学习的双重对比,该对比是通过对比的是正面和负面增强样本对的语义/特征来提取有效的任务特定的判别特征。此外,我们利用信息理论来解释语义和特征和松弛相互信息的双重对比的合理性,以更简单的方式对比损失。最后,在基准数据集中验证了我们方法的有效性。
In recent years, the field of intelligent transportation systems (ITS) has achieved remarkable success, which is mainly due to the large amount of available annotation data. However, obtaining these annotated data has to afford expensive costs in reality. Therefore, a more realistic strategy is to leverage semi-supervised learning (SSL) with a small amount of labeled data and a large amount of unlabeled data. Typically, semantic consistency regularization and the two-stage learning methods of decoupling feature extraction and classification have been proven effective. Nevertheless, representation learning only limited to semantic consistency regularization may not guarantee the separation or discriminability of representations of samples with different semantics; due to the inherent limitations of the two-stage learning methods, the extracted features may not match the specific downstream tasks. In order to deal with the above drawbacks, this paper proposes an end-to-end deep semi-supervised learning double contrast of semantic and feature, which extracts effective tasks specific discriminative features by contrasting the semantics/features of positive and negative augmented samples pairs. Moreover, we leverage information theory to explain the rationality of double contrast of semantics and features and slack mutual information to contrastive loss in a simpler way. Finally, the effectiveness of our method is verified in benchmark datasets.