论文标题

基于骨骼的特征在虚拟试验中的意义

Significance of Skeleton-based Features in Virtual Try-On

论文作者

Roy, Debapriya, Santra, Sanchayan, Mukherjee, Diganta, Chanda, Bhabatosh

论文摘要

\ textit {virtual try-on}(vton)的想法使用户在舒适的家中尝试穿衣服的便利,从而使电子零售受益。总的来说,当一个与手臂摆姿势的人弯曲或交叉的人想尝试服装时,大多数现有的VTON方法会产生不一致的结果。在长袖服装的情况下,问题变得严重。与那时,对于交叉的手臂姿势,可能会发生不同的衣服零件之间的重叠。现有的方法,尤其是采用\ textit {薄板样条(TPS)}的基于翘曲的方法}转换无法解决此类情况。为此,我们尝试采用一种解决方案方法,其中将来自源的人的衣服分为语义上有意义的部分,并且每个部分都独立扭曲为人的形状。为了解决弯曲问题,我们采用了与人体几何形状一致的手工制作的几何特征来翘曲源装备。此外,我们提出了两个基于学习的模块:合成器网络和一个掩码预测网络。所有这些共同尝试生成光合逼真的,姿势射击的VTON解决方案,而无需任何配对的训练数据。与某些基准方法的比较清楚地确定了该方法的有效性。

The idea of \textit{Virtual Try-ON} (VTON) benefits e-retailing by giving an user the convenience of trying a clothing at the comfort of their home. In general, most of the existing VTON methods produce inconsistent results when a person posing with his arms folded i.e., bent or crossed, wants to try an outfit. The problem becomes severe in the case of long-sleeved outfits. As then, for crossed arm postures, overlap among different clothing parts might happen. The existing approaches, especially the warping-based methods employing \textit{Thin Plate Spline (TPS)} transform can not tackle such cases. To this end, we attempt a solution approach where the clothing from the source person is segmented into semantically meaningful parts and each part is warped independently to the shape of the person. To address the bending issue, we employ hand-crafted geometric features consistent with human body geometry for warping the source outfit. In addition, we propose two learning-based modules: a synthesizer network and a mask prediction network. All these together attempt to produce a photo-realistic, pose-robust VTON solution without requiring any paired training data. Comparison with some of the benchmark methods clearly establishes the effectiveness of the approach.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源