论文标题
通过固定散射媒体进行深度学习辅助成像
Deep learning-assisted imaging through stationary scattering media
论文作者
论文摘要
通过散射媒体进行成像是一个具有挑战性的问题,这是由于媒体本身扰动的斑点去相关。对于在线成像方式,由于它们是紧凑的,不需要运动部件并且坚固的,因此很有吸引力,否定这种散射的影响变得特别具有挑战性。在这里,我们探讨了固定散射介质对包括数字全息显微镜在内的在线几何形状中光散射的影响。我们考虑了各种对象散发器方案,其中对象被其他固定散射器扭曲或掩盖,并使用先进的深度学习(DL)生成方法,生成的对抗网络(GAN)来减轻其他散射器的效果。使用带有和没有其他散射器的对象上的光散射模拟和实验,我们发现有条件的gan可以通过微小数据集快速训练,还可以有效地学习交叉域输入输入输入图像对之间的一对一统计映射。训练这样的网络会产生独立的模型,该模型可以在以后用来倒数或消除散射的效果,从而产生清晰的对象重建,以进行对象检索和下游处理。此外,众所周知,固定散射光学系统的相干点扩散函数(C-PSF)是一种斑点模式,在空间上移动变体。我们表明,通过仅使用20个图像对的快速训练,可以否定这种不需要的散射,以精确地定位具有高空间精度的衍射受限的冲动,从而将早期的移位变体系统转换为线性移位不变(LSI)系统。
Imaging through scattering media is a challenging problem owing to speckle decorrelations from perturbations in the media itself. For in-line imaging modalities, which are appealing because they are compact, require no moving parts, and are robust, negating the effects of such scattering becomes particularly challenging. Here we explore the effect of stationary scattering media on light scattering in in-line geometries, including digital holographic microscopy. We consider various object-scatterer scenarios where the object is distorted or obscured by additional stationary scatterers, and use an advanced deep learning (DL) generative methodology, generative adversarial networks (GANs), to mitigate the effects of the additional scatterers. Using light scattering simulations and experiments on objects of interest with and without additional scatterers, we find that conditional GANs can be quickly trained with minuscule datasets and can also efficiently learn the one-to-one statistical mapping between the cross-domain input-output image pairs. Training such a network yields a standalone model, that can be used later to inverse or negate the effect of scattering, yielding clear object reconstructions for object retrieval and downstream processing. Moreover, it is well-known that the coherent point spread function (c-PSF) of a stationary scattering optical system is a speckle pattern which is spatially shift variant. We show that with rapid training using only 20 image pairs, it is possible to negate this undesired scattering to accurately localize diffraction-limited impulses with high spatial accuracy, therefore transforming the earlier shift variant system to a linear shift invariant (LSI) system.