论文标题
何时可以接受违反规则？基于经验数据的道德判断的知识表示
When Is It Acceptable to Break the Rules? Knowledge Representation of Moral Judgement Based on Empirical Data
论文作者
论文摘要
关于人类道德思想的最引人注目的事情之一就是灵活性。我们可以对我们从未见过的案件做出道德判断。我们可以决定应违反预先建立的规则。我们可以即时发明新颖的规则。捕捉这种灵活性是开发可以解释和产生类似人类道德判断的AI系统的核心挑战之一。本文详细介绍了一项研究现实世界决策者的研究结果，他们判断打破一个公认的规范是否可以接受：````无削减''。我们收集了有关人类参与者如何判断在各种情况下判断线的可接受性的数据。然后，为了将这些推理能力有效地嵌入机器中，我们提出了一种使用基于偏好的结构对它们进行建模的方法，该结构捕获了对标准``双重过程''的新颖修改的道德判断理论。
One of the most remarkable things about the human moral mind is its flexibility. We can make moral judgments about cases we have never seen before. We can decide that pre-established rules should be broken. We can invent novel rules on the fly. Capturing this flexibility is one of the central challenges in developing AI systems that can interpret and produce human-like moral judgment. This paper details the results of a study of real-world decision makers who judge whether it is acceptable to break a well-established norm: ``no cutting in line.'' We gather data on how human participants judge the acceptability of line-cutting in a range of scenarios. Then, in order to effectively embed these reasoning capabilities into a machine, we propose a method for modeling them using a preference-based structure, which captures a novel modification to standard ``dual process'' theories of moral judgment.
