论文标题
自然照明下复杂场景的SVBRDF估计的多视图梯度一致性
Multi-view Gradient Consistency for SVBRDF Estimation of Complex Scenes under Natural Illumination
论文作者
论文摘要
本文提出了一个过程，用于估计在自然照明下观察到的复杂场景的空间变化的表面反射率。与以前的方法相反，我们的过程不限于在受控照明条件下观看的场景，而可以处理在任意照明条件下观看的复杂室内和室外场景。端到端的过程使用场景几何形状的模型，并在各种自然照明条件下从任意观点和各种自然照明条件下捕获场景表面。我们开发了一个可区分的路径示踪剂，该路径示踪剂利用最小二乘形状的映射来处理场景中出现的多个不相交对象。我们遵循两步优化的过程，并引入了多视图梯度一致性损失，与其他最先进的ART相比，图像重建损失的提高了30-50％，并可以进一步更好地分散分散和镜面BRDF。我们从野外图像中的现实世界和室外场景中演示了该过程，并表明我们可以使用估计的反射率属性生成与实际图像一致的逼真的渲染。实验表明，我们的技术对具有复杂几何形状的任意室外场景产生了现实的结果。源代码可公开可用：https：//gitlab.com/alen.joy/multi-view-gradient-consistency-for-svbrdf-svbrdf-esimation-complex-scenes-scenes-scenes-suder-natural-lumumination
This paper presents a process for estimating the spatially varying surface reflectance of complex scenes observed under natural illumination. In contrast to previous methods, our process is not limited to scenes viewed under controlled lighting conditions but can handle complex indoor and outdoor scenes viewed under arbitrary illumination conditions. An end-to-end process uses a model of the scene's geometry and several images capturing the scene's surfaces from arbitrary viewpoints and under various natural illumination conditions. We develop a differentiable path tracer that leverages least-square conformal mapping for handling multiple disjoint objects appearing in the scene. We follow a two-step optimization process and introduce a multi-view gradient consistency loss which results in up to 30-50% improvement in the image reconstruction loss and can further achieve better disentanglement of the diffuse and specular BRDFs compared to other state-of-the-art. We demonstrate the process in real-world indoor and outdoor scenes from images in the wild and show that we can produce realistic renders consistent with actual images using the estimated reflectance properties. Experiments show that our technique produces realistic results for arbitrary outdoor scenes with complex geometry. The source code is publicly available at: https://gitlab.com/alen.joy/multi-view-gradient-consistency-for-svbrdf-estimation-of-complex-scenes-under-natural-illumination
