论文标题
使用人解剖语言进行全面的面部表达综合
Comprehensive Facial Expression Synthesis using Human-Interpretable Language
论文作者
论文摘要
面部表达合成的最新进展已使用包括面部动作单元在内的各种表达表示形式显示出令人鼓舞的结果。需要直观地表示面部表达综合的面部动作单位以进行人类理解，而不是对面部动作单位的数字分类。为了解决这个问题，我们利用人类友好的方法：使用自然语言，其中语言有助于人类掌握概念环境。因此，在本文中，我们提出了一个新的面部表达综合模型，该模型来自基于语言的面部表达描述。我们的方法可以用详细的表达式合成面部图像。此外，有效地将语言特征嵌入面部特征上，我们的方法可以控制单个单词来处理面部运动的每个部分。进行了广泛的定性和定量评估，以验证自然语言的有效性。
Recent advances in facial expression synthesis have shown promising results using diverse expression representations including facial action units. Facial action units for an elaborate facial expression synthesis need to be intuitively represented for human comprehension, not a numeric categorization of facial action units. To address this issue, we utilize human-friendly approach: use of natural language where language helps human grasp conceptual contexts. In this paper, therefore, we propose a new facial expression synthesis model from language-based facial expression description. Our method can synthesize the facial image with detailed expressions. In addition, effectively embedding language features on facial features, our method can control individual word to handle each part of facial movement. Extensive qualitative and quantitative evaluations were conducted to verify the effectiveness of the natural language.
