论文标题

用双阈值和增强方案构建准确有效的深尖峰神经网络

Constructing Accurate and Efficient Deep Spiking Neural Networks with Double-threshold and Augmented Schemes

论文作者

Yu, Qiang, Ma, Chenxiang, Song, Shiming, Zhang, Gaoyan, Dang, Jianwu, Tan, Kay Chen

论文摘要

尖峰神经网络(SNN)被认为是克服当前挑战的潜在候选人,例如人工神经网络遇到的高功率消费(ANN),但是,在实际任务的识别准确性方面,它们之间仍然存在差距。因此,最近引入了一种转换策略,以通过将受过训练的ANN映射到SNN来弥合这一差距。但是,尚不清楚该获得的SNN在多大程度上可以使ANN的准确性优势和基于尖峰的计算范式提高效率。在本文中,我们提出了两种新的转换方法,即列为和augmapping。该列表是具有双重阈值方案的典型阈值平衡方法的直接扩展,而Augmapping则还结合了一种新的增强尖峰方案,该方案采用了尖峰系数,可以在一个时间步骤中携带典型的全或整个尖峰数量。我们研究了基于MNIST,时尚摄影和CIFAR10数据集的方法的性能。结果表明,拟议的双阈值方案可以有效地改善转换后的SNN的精度。更重要的是,与其他最先进的方法相比,提出的Augmapping对于构建准确,快速和有效的深SNN更为有利。因此,我们的研究提供了新的方法,以进一步整合ANN中的高级技术以提高SNN的性能,这对于使用基于Spike的神经形态计算的应用开发可能非常有用。

Spiking neural networks (SNNs) are considered as a potential candidate to overcome current challenges such as the high-power consumption encountered by artificial neural networks (ANNs), however there is still a gap between them with respect to the recognition accuracy on practical tasks. A conversion strategy was thus introduced recently to bridge this gap by mapping a trained ANN to an SNN. However, it is still unclear that to what extent this obtained SNN can benefit both the accuracy advantage from ANN and high efficiency from the spike-based paradigm of computation. In this paper, we propose two new conversion methods, namely TerMapping and AugMapping. The TerMapping is a straightforward extension of a typical threshold-balancing method with a double-threshold scheme, while the AugMapping additionally incorporates a new scheme of augmented spike that employs a spike coefficient to carry the number of typical all-or-nothing spikes occurring at a time step. We examine the performance of our methods based on MNIST, Fashion-MNIST and CIFAR10 datasets. The results show that the proposed double-threshold scheme can effectively improve accuracies of the converted SNNs. More importantly, the proposed AugMapping is more advantageous for constructing accurate, fast and efficient deep SNNs as compared to other state-of-the-art approaches. Our study therefore provides new approaches for further integration of advanced techniques in ANNs to improve the performance of SNNs, which could be of great merit to applied developments with spike-based neuromorphic computing.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源