论文标题

算法反馈循环中的新兴不稳定性

Emergent Instabilities in Algorithmic Feedback Loops

论文作者

Burghardt, Keith, Lerman, Kristina

论文摘要

有助于人类任务的算法,例如推荐系统,无处不在。它们出现在从社交媒体到流媒体视频到在线购物的所有事物中。但是,人们与算法之间的反馈回路知之甚少,可以扩大认知和社会偏见(算法混淆),从而导致意外的结果。在这项工作中,我们通过教师学习模拟探索基于协作过滤的建议算法中的算法混杂。也就是说,建议算法使用基于模拟选择培训的基于学生协作过滤的模型将项目推荐给代理商。根据基本教师模型,代理商可能会选择其中一些项目,然后将新的选择回到学生模型中作为新的培训数据(近似于在线机器学习)。这些模拟表明了算法混淆如何产生错误的建议,从而导致不稳定,即每个模拟实现之间项目的普及。我们使用模拟来展示一种新颖的方法来培训协作过滤模型,该模型可以创建更稳定和准确的建议。我们的方法足够一般,可以扩展到其他社会技术系统,以便更好地量化和提高算法的稳定性。这些结果强调了人们与算法之间相互作用的紧急行为的必要性。

Algorithms that aid human tasks, such as recommendation systems, are ubiquitous. They appear in everything from social media to streaming videos to online shopping. However, the feedback loop between people and algorithms is poorly understood and can amplify cognitive and social biases (algorithmic confounding), leading to unexpected outcomes. In this work, we explore algorithmic confounding in collaborative filtering-based recommendation algorithms through teacher-student learning simulations. Namely, a student collaborative filtering-based model, trained on simulated choices, is used by the recommendation algorithm to recommend items to agents. Agents might choose some of these items, according to an underlying teacher model, with new choices then fed back into the student model as new training data (approximating online machine learning). These simulations demonstrate how algorithmic confounding produces erroneous recommendations which in turn lead to instability, i.e., wide variations in an item's popularity between each simulation realization. We use the simulations to demonstrate a novel approach to training collaborative filtering models that can create more stable and accurate recommendations. Our methodology is general enough that it can be extended to other socio-technical systems in order to better quantify and improve the stability of algorithms. These results highlight the need to account for emergent behaviors from interactions between people and algorithms.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源