论文标题

个性化子图联合学习

Personalized Subgraph Federated Learning

论文作者

Baek, Jinheon, Jeong, Wonyong, Jin, Jiongdao, Yoon, Jaehong, Hwang, Sung Ju

论文摘要

较大的全局图的子图可以分布在多个设备上,并且仅由于隐私限制而在本地访问,尽管子图之间可能存在链接。最近,拟议的子图联合学习方法(FL)方法涉及跨本地子图的那些缺少的链接,而分布式培训图形神经网络(GNN)。但是,他们忽略了包含全球图的不同社区的子图之间的不可避免的异质性,因此从本地GNN模型中崩溃了不相容的知识。为此,我们引入了一个新的子图FL问题,即个性化的子图FL,该问题的重点是相互关联的本地GNN,而不是学习一个全球模型,并提出了一个新颖的框架,Federated个性化的子学学习(Fed-Pub)来解决它。由于服务器无法访问每个客户端中的子图,因此Fed-Pub使用随机图作为输入来计算它们之间的相似之处,并利用本地GNN的功能嵌入,并使用相似性执行服务器端聚合的加权平均。此外,它还在每个客户端学习一个个性化的稀疏掩码,以选择和更新聚合参数的子图相关子集。我们考虑了非重叠和重叠子图的六个数据集上的FED-PUB,以验证其在六个数据集上的子图FL性能,在这些数据集中,它在其上大大优于相关的基线。我们的代码可在https://github.com/jinheonbaek/fed-pub上找到。

Subgraphs of a larger global graph may be distributed across multiple devices, and only locally accessible due to privacy restrictions, although there may be links between subgraphs. Recently proposed subgraph Federated Learning (FL) methods deal with those missing links across local subgraphs while distributively training Graph Neural Networks (GNNs) on them. However, they have overlooked the inevitable heterogeneity between subgraphs comprising different communities of a global graph, consequently collapsing the incompatible knowledge from local GNN models. To this end, we introduce a new subgraph FL problem, personalized subgraph FL, which focuses on the joint improvement of the interrelated local GNNs rather than learning a single global model, and propose a novel framework, FEDerated Personalized sUBgraph learning (FED-PUB), to tackle it. Since the server cannot access the subgraph in each client, FED-PUB utilizes functional embeddings of the local GNNs using random graphs as inputs to compute similarities between them, and use the similarities to perform weighted averaging for server-side aggregation. Further, it learns a personalized sparse mask at each client to select and update only the subgraph-relevant subset of the aggregated parameters. We validate our FED-PUB for its subgraph FL performance on six datasets, considering both non-overlapping and overlapping subgraphs, on which it significantly outperforms relevant baselines. Our code is available at https://github.com/JinheonBaek/FED-PUB.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源