论文标题
机器人画中的艺术风格;从人类艺术家那里学习笔触的机器学习方法
Artistic Style in Robotic Painting; a Machine Learning Approach to Learning Brushstroke from Human Artists
论文作者
论文摘要
自1970年代以来,机器人绘画一直是艺术家和机器人主义者感兴趣的主题。研究人员和跨学科艺术家采用了各种绘画技术和人类机器人协作模型来在画布上创建视觉媒介。机器人绘画的挑战之一是将所需的艺术风格应用于这幅画。使用机器学习模型的样式转移技术帮助我们通过特定绘画的视觉样式解决了这一挑战。但是,尚未完全解决其他风格的手动元素,即艺术家的绘画技巧和笔触。我们提出了一种通过与人类艺术家的合作,将艺术风格整合到笔触和绘画过程中的方法。在本文中,我们描述了我们的方法1)从艺术家那里收集笔触和手刷运动样品,以及2)训练生成模型,以生成与艺术家风格有关的笔触,以及3)微调基于中风的渲染模型,以与我们的机器人绘画设置一起使用。我们将在单独的出版物中报告这三个步骤的集成。在一项初步研究中,有71%的人类评估人员发现我们的重建笔触与艺术家风格的特征有关。此外,有58%的参与者无法将我们方法的绘画与人类艺术家创作的视觉上相似的绘画区分开。
Robotic painting has been a subject of interest among both artists and roboticists since the 1970s. Researchers and interdisciplinary artists have employed various painting techniques and human-robot collaboration models to create visual mediums on canvas. One of the challenges of robotic painting is to apply a desired artistic style to the painting. Style transfer techniques with machine learning models have helped us address this challenge with the visual style of a specific painting. However, other manual elements of style, i.e., painting techniques and brushstrokes of an artist, have not been fully addressed. We propose a method to integrate an artistic style to the brushstrokes and the painting process through collaboration with a human artist. In this paper, we describe our approach to 1) collect brushstrokes and hand-brush motion samples from an artist, and 2) train a generative model to generate brushstrokes that pertains to the artist's style, and 3) fine tune a stroke-based rendering model to work with our robotic painting setup. We will report on the integration of these three steps in a separate publication. In a preliminary study, 71% of human evaluators find our reconstructed brushstrokes are pertaining to the characteristics of the artist's style. Moreover, 58% of participants could not distinguish a painting made by our method from a visually similar painting created by a human artist.