论文标题
通过基于组的子集扫描来创造生成模型的创造力表征
Towards Creativity Characterization of Generative Models via Group-based Subset Scanning
论文作者
论文摘要
深层生成模型,例如变异自动编码器(VAE)和生成对抗网络(GAN),已广泛用于计算创造力研究中。但是,这样的模型不鼓励分布生成以避免产生虚假的样本,从而限制了它们的创造力。因此,将人类创造力的研究纳入生成深度学习技术为使他们的产出更具吸引力和人性化提供了机会。当我们看到针对创造力研究的生成模型的出现时,必须需要基于机器学习的替代指标来表征这些模型的创造性输出。我们建议基于组的子集扫描,以通过在生成模型的隐藏层中检测一个异常淋巴结激活的子集来识别,量化和表征创作过程。我们对标准图像基准的实验及其“创造性生成”的变体表明,所提出的子集分数分布对于检测激活空间中的创作过程而不是像素空间更有用。此外,我们发现创意样本比整个数据集生成比普通样本或非创造样本的异常集。创意解码过程中突出显示的节点激活与负责正常样品生成的节点不同。最后,我们评估了人类评估者是否还发现了我们方法选择的子集中的图像,并在人类中的创造力感知与深神经网中的节点激活之间存在联系。
Deep generative models, such as Variational Autoencoders (VAEs) and Generative Adversarial Networks (GANs), have been employed widely in computational creativity research. However, such models discourage out-of-distribution generation to avoid spurious sample generation, thereby limiting their creativity. Thus, incorporating research on human creativity into generative deep learning techniques presents an opportunity to make their outputs more compelling and human-like. As we see the emergence of generative models directed toward creativity research, a need for machine learning-based surrogate metrics to characterize creative output from these models is imperative. We propose group-based subset scanning to identify, quantify, and characterize creative processes by detecting a subset of anomalous node-activations in the hidden layers of the generative models. Our experiments on the standard image benchmarks, and their "creatively generated" variants, reveal that the proposed subset scores distribution is more useful for detecting creative processes in the activation space rather than the pixel space. Further, we found that creative samples generate larger subsets of anomalies than normal or non-creative samples across datasets. The node activations highlighted during the creative decoding process are different from those responsible for the normal sample generation. Lastly, we assess if the images from the subsets selected by our method were also found creative by human evaluators, presenting a link between creativity perception in humans and node activations within deep neural nets.