论文标题
在设备社会中,联合和持续学习的分类任务
Federated and continual learning for classification tasks in a society of devices
论文作者
论文摘要
今天,我们生活在一个越来越多地互连和传感的设备的情况下,几乎无处不在。近年来,深度学习已成为一种流行的方式,可以从这些设备能够收集的大量数据中提取知识。然而,在面对实际分布式问题时,集中式的最新学习方法具有许多缺点,其中可用信息通常是私人,部分,有偏见和随着时间的推移而发展的。联合学习是一个受欢迎的框架,它允许多个分布式设备远程训练模型,协作并保留数据隐私。但是,联邦学习中的当前建议集中于深层体系结构,在许多情况下,在诸如智能手机等非专业设备中实施不可行。同样,关于数据分布随时间变化以无法预见的方式变化的情况很少进行的研究,从而导致所谓的概念漂移。因此,在这项工作中,我们希望提出联合和持续共识的光线(LFEDCON2),这是一种使用光线,传统学习者的新联邦和持续建筑。我们的方法允许无能为力的设备(例如智能手机或机器人)实时,本地,连续,自主和用户学习,但也可以在全球,云中改进模型,在设备中结合本地学到的知识。为了测试我们的建议,我们将其应用于智能手机用户的异质社区,以解决步行识别的问题。结果表明LFEDCON2相对于其他最先进的方法提供了优势。
Today we live in a context in which devices are increasingly interconnected and sensorized and are almost ubiquitous. Deep learning has become in recent years a popular way to extract knowledge from the huge amount of data that these devices are able to collect. Nevertheless, centralized state-of-the-art learning methods have a number of drawbacks when facing real distributed problems, in which the available information is usually private, partial, biased and evolving over time. Federated learning is a popular framework that allows multiple distributed devices to train models remotely, collaboratively, and preserving data privacy. However, the current proposals in federated learning focus on deep architectures that in many cases are not feasible to implement in non-dedicated devices such as smartphones. Also, little research has been done regarding the scenario where data distribution changes over time in unforeseen ways, causing what is known as concept drift. Therefore, in this work we want to present Light Federated and Continual Consensus (LFedCon2), a new federated and continual architecture that uses light, traditional learners. Our method allows powerless devices (such as smartphones or robots) to learn in real time, locally, continuously, autonomously and from users, but also improving models globally, in the cloud, combining what is learned locally, in the devices. In order to test our proposal, we have applied it in a heterogeneous community of smartphone users to solve the problem of walking recognition. The results show the advantages that LFedCon2 provides with respect to other state-of-the-art methods.