论文标题

增强异性图的类内部信息提取:一种神经体系结构搜索方法

Enhancing Intra-class Information Extraction for Heterophilous Graphs: One Neural Architecture Search Approach

论文作者

Wei, Lanning, He, Zhiqiang, Zhao, Huan, Yao, Quanming

论文摘要

近年来,图形神经网络(GNN)在图表学习中很受欢迎,该学习假设具有同质性属性,即连接的节点具有相同的标签或具有相似的特征。但是,它们可能未能概括为在低/中等水平的异性图中。现有方法倾向于通过增强类内部信息提取来解决此问题,即,通过设计更好的GNN来提高模型效果,或重新设计图形结构以结合远处啤酒花的潜在级内节点。尽管取得了成功,但我们观察到可以进一步改进的两个方面:(a)增强从节点本身中提取的自我特征信息提取,这在提取阶级内部信息方面更可靠; (b)设计节点gnns可以更好地适应具有不同均匀比率的节点。在本文中,我们提出了一种新颖的方法IIE-GNN(阶级信息增强的图形神经网络),以实现两种改进。根据文献提出了一个统一的框架,其中可以根据七个精心设计的块来提取节点本身和邻居的阶级内部信息。在神经体系结构搜索(NAS)的帮助下,我们根据框架提出了一个新颖的搜索空间,然后为每个节点设计gnns提供了一个架构预测指标。我们进一步进行实验,以表明IIE-GNN可以通过设计节点的GNN来提高阶级内部信息提取来提高模型性能。

In recent years, Graph Neural Networks (GNNs) have been popular in graph representation learning which assumes the homophily property, i.e., the connected nodes have the same label or have similar features. However, they may fail to generalize into the heterophilous graphs which in the low/medium level of homophily. Existing methods tend to address this problem by enhancing the intra-class information extraction, i.e., either by designing better GNNs to improve the model effectiveness, or re-designing the graph structures to incorporate more potential intra-class nodes from distant hops. Despite the success, we observe two aspects that can be further improved: (a) enhancing the ego feature information extraction from node itself which is more reliable in extracting the intra-class information; (b) designing node-wise GNNs can better adapt to the nodes with different homophily ratios. In this paper, we propose a novel method IIE-GNN (Intra-class Information Enhanced Graph Neural Networks) to achieve two improvements. A unified framework is proposed based on the literature, in which the intra-class information from the node itself and neighbors can be extracted based on seven carefully designed blocks. With the help of neural architecture search (NAS), we propose a novel search space based on the framework, and then provide an architecture predictor to design GNNs for each node. We further conduct experiments to show that IIE-GNN can improve the model performance by designing node-wise GNNs to enhance intra-class information extraction.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源