论文标题
通过低等级近似增强卷积神经网络的推广性
Enhancing convolutional neural network generalizability via low-rank weight approximation
论文作者
论文摘要
在图像采集过程中,噪声无处不在。足够的降解通常是图像处理的重要第一步。近几十年来,深度神经网络(DNN)已被广泛用于图像denosising。大多数基于DNN的图像Denoising方法都需要大规模的数据集或专注于监督设置,在该设置中,需要单个/对的干净图像或一组嘈杂的图像。这给图像采集过程带来了重大负担。此外,在有限规模的数据集上接受培训的DeNoiser可能会产生过度拟合。为了减轻这些问题,我们基于Tucker低级张量近似引入了一个新的自我监督框架,以供图像Denoising。借助提出的设计,我们能够以更少的参数来表征我们的DeNoiser,并根据单个图像进行训练,从而大大提高了模型的通用性并降低了数据获取的成本。已经进行了合成和现实世界嘈杂图像的广泛实验。经验结果表明,我们提出的方法优于现有的非基于非学习的方法(例如,低通滤波器,非本地均值),在样本中和样本数据集中评估的单图像无监督的DENOISER(例如DIP,NN+BM3D)。提出的方法甚至通过一些有监督的方法(例如DNCNN)实现了可比的性能。
Noise is ubiquitous during image acquisition. Sufficient denoising is often an important first step for image processing. In recent decades, deep neural networks (DNNs) have been widely used for image denoising. Most DNN-based image denoising methods require a large-scale dataset or focus on supervised settings, in which single/pairs of clean images or a set of noisy images are required. This poses a significant burden on the image acquisition process. Moreover, denoisers trained on datasets of limited scale may incur over-fitting. To mitigate these issues, we introduce a new self-supervised framework for image denoising based on the Tucker low-rank tensor approximation. With the proposed design, we are able to characterize our denoiser with fewer parameters and train it based on a single image, which considerably improves the model's generalizability and reduces the cost of data acquisition. Extensive experiments on both synthetic and real-world noisy images have been conducted. Empirical results show that our proposed method outperforms existing non-learning-based methods (e.g., low-pass filter, non-local mean), single-image unsupervised denoisers (e.g., DIP, NN+BM3D) evaluated on both in-sample and out-sample datasets. The proposed method even achieves comparable performances with some supervised methods (e.g., DnCNN).