论文标题
通过层次训练卷积神经网络具有较小的过滤器,用于使用可穿戴传感器的人类活动识别
Layer-wise training convolutional neural networks with smaller filters for human activity recognition using wearable sensors
论文作者
论文摘要
最近,卷积神经网络(CNN)设置了有关各种人类活动识别(HAR)数据集的最新最新技术。但是,深CNN通常需要更多的计算资源,这限制了其在嵌入式HAR中的应用。尽管已经提出了许多成功的方法来减少CNN的内存和障碍,但它们通常涉及专为视觉任务设计的特殊网络体系结构,由于显着差异,它们不适合带有时间序列传感器信号的深HAR任务。因此,有必要开发轻巧的深层模型来执行HAR。由于过滤器是构建CNN的基本单元,因此应该进一步研究重新设计较小的过滤器是否适用于Deep HAR。在纸上,受到这个想法的启发,我们提出了一个使用乐高过滤器的轻量级CNN。一组低维过滤器用作常规过滤器的乐高积木,不依赖任何特殊的网络结构。局部损失函数用于训练模型。据我们所知,这是第一篇在无处不在且可穿戴的计算领域提出轻巧的CNN的论文。该实验在五个公共HAR数据集,UCI-HAR数据集,机会数据集,Unimib-Shar数据集,PAMAP2数据集和从智能手机或多个传感器节点收集的WISDM数据集中,这表明我们的新型LEGO CNN具有局部损失可以极大地降低比CNN的计算,同时可以降低内存和计算成本,同时获得更高的CNN,同时可以降低CNN的能力。也就是说,提出的模型更小,更快,更准确。最后,我们评估了Android智能手机上的实际性能。
Recently, convolutional neural networks (CNNs) have set latest state-of-the-art on various human activity recognition (HAR) datasets. However, deep CNNs often require more computing resources, which limits their applications in embedded HAR. Although many successful methods have been proposed to reduce memory and FLOPs of CNNs, they often involve special network architectures designed for visual tasks, which are not suitable for deep HAR tasks with time series sensor signals, due to remarkable discrepancy. Therefore, it is necessary to develop lightweight deep models to perform HAR. As filter is the basic unit in constructing CNNs, it deserves further research whether re-designing smaller filters is applicable for deep HAR. In the paper, inspired by the idea, we proposed a lightweight CNN using Lego filters for HAR. A set of lower-dimensional filters is used as Lego bricks to be stacked for conventional filters, which does not rely on any special network structure. The local loss function is used to train model. To our knowledge, this is the first paper that proposes lightweight CNN for HAR in ubiquitous and wearable computing arena. The experiment results on five public HAR datasets, UCI-HAR dataset, OPPORTUNITY dataset, UNIMIB-SHAR dataset, PAMAP2 dataset, and WISDM dataset collected from either smartphones or multiple sensor nodes, indicate that our novel Lego CNN with local loss can greatly reduce memory and computation cost over CNN, while achieving higher accuracy. That is to say, the proposed model is smaller, faster and more accurate. Finally, we evaluate the actual performance on an Android smartphone.