Collaborative Research: IIS Core: Small: World Values of Conversational AI and the Consequences for Human-AI Interaction

协作研究：IIS 核心：小：对话式 AI 的世界价值以及人机交互的后果

• 批准号: 2230467
• 负责人: Maarten Sap
• 金额: $ 5.1万
• 依托单位: Carnegie-Mellon University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-04-01 至 2026-03-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2230467&HistoricalAwards=false
• 关键词: Collaborative; Research; IIS; Core; Small

People increasingly converse with Artificial Intelligence (AI)-powered systems in their everyday lives, such as smart assistants on mobile phones or home speakers. However, those interactions could have unintended and potentially negative effects on people if the AI system expresses cultural values or beliefs they disagree with. Indeed, when humans interact with each other, cultural differences can lead to “culture clash,” which may trigger misunderstandings, mistrust, rejection, or declines in well-being. Thus, understanding to what extent culture clash may happen in human-AI interaction, and how people react to AI systems that express varied values, is an important question in making AI-based conversational systems that are acceptable, useful, and inclusive of people from different backgrounds. This project aims to investigate the ways values and beliefs embodied within conversational AI systems vary and whether diverging values between humans and AI can have effects similar to culture clash between humans. The team of researchers will develop: (1) methods for measuring cultural values in a variety of language models that form the basis for conversational AI systems; (2) insights into how prominent language models compare to human values across the world and across groups in the United States; and (3) empirical knowledge of the effects of mismatching values between humans and conversational AIs on a person's own values, trust, and subjective well-being, and the implications of these for larger society. The team will also release datasets for other researchers and deploy an online platform to allow the public to explore the values expressed by conversational AI systems, share their own experiences with culture clash in AI-based systems, and think about potential culture clashes and their consequences.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

人们越来越多地与人工智能（AI）能力的系统在日常生活中，例如手机或家庭扬声器上的智能助手。但是，如果AI系统表达文化价值或认为它们不同意，这些互动可能会对人们产生意外的和潜在的负面影响。的确，当人类互相互动时，文化差异可能导致“文化冲突”，这可能会引发误解，不信任，拒绝或在幸福中的衰落。这样一来，了解文化在人类互动中可能发生的冲突可能发生在多大程度上，以及人们如何对表达各种价值的AI系统做出反应，这是建立基于AI的对话系统的重要问题，这些系统是可以接受，有用且包含来自不同背景的人们的重要问题。该项目旨在调查对话AI系统中体现的价值观和相信的方式，以及人类与AI之间的分歧值是否具有类似于人类之间的文化冲突的影响。研究人员团队将开发：（1）在各种语言模型中衡量文化价值的方法，这些模型构成了对话AI系统的基础； （2）深入了解与世界各地的人类价值观相比如何与美国的人类价值观相比； （3）对人类与对话AI之间的不匹配价值观对人自己的价值观，信任和主观幸福感的影响的经验知识，以及这些对更大社会的影响。该团队还将为其他研究人员发布数据集，并部署一个在线平台，以允许公众探索对话性AI系统表达的价值，分享他们在基于AI的系统中与文化冲突的经验，并考虑潜在的文化冲突及其后果。该奖项反映了NSF的法定任务，并通过评估智力效果来评估NSF的法定任务，并具有价值的评估。

项目成果

NLPositionality: Characterizing Design Biases of Datasets and Models

NLPositionality：表征数据集和模型的设计偏差

• DOI: 10.18653/v1/2023.acl-long.505
• 发表时间: 2023
• 期刊: Association for Computational Linguistics
• 作者: Santy, Sebastin;Liang, Jenny;Le Bras, Ronan;Reinecke, Katharina;Sap, Maarten
• 通讯作者: Sap, Maarten