RI: Small: Towards a Formal Theory of Blameworthiness, Intention, and Moral Responsibility

RI：小：走向应受谴责、意图和道德责任的正式理论

• 批准号: 1718108
• 负责人: Joseph Halpern
• 金额: $ 42.7万
• 依托单位: Cornell University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-08-01 至 2021-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1718108&HistoricalAwards=false
• 关键词: RI; Small; Towards; Formal; Theory

As we move to an era of self-driving cars, autonomous drones, and robots helping people in work and everyday tasks, there is an increasing need to develop a theory of moral or ethical behavior. Policy-makers are already grappling with some of the issues. Jurisdictions around the world are beginning to formulate highway codes that take into consideration the presence of driverless cars. The goal of this project is to provide the foundations for a theory of blameworthiness, intention, and moral responsibility for such agents and applications. The study will evaluate this theory against the moral judgments that people make, and take the first steps to applying resulting policies in practice. A good theory will have to take into consideration tradeoffs among many competing and sometimes conflicting goals. This suggests that probability and utility will be involved. The theory will also have to deal with counterfactuals--that is, reasoning about what would have happened had circumstances or actions differed. Issues of causality will reveal whether an agent's action was responsible for an outcome, or if the action was coincidental to the outcome. Yet another relevant issue is determining intent: that is, determining whether an agent intended an outcome when performing an act. Pearl's structural-equations framework can model counterfactuals (interventions) and has been used as the basis of a definition of causality. In this project, the framework will be extended to capture degree of blameworthiness and intention. These definitions are given relative to an agent's epistemic state, which describes the agent's beliefs and preferences. Initially, the beliefs will be specified by a probability measure and the preferences by a utility function. The framework will then be extended to consider more qualitative representations of beliefs and preferences, to take into account issues of normality and typicality (e.g., to capture societal conventions), and to settings with multiple agents (e.g., multiple communicating driverless cars or robots), where game-theoretic concerns and issues of group responsibility vs. individual responsibility arise. The definitions developed under this framework will be tested to see if they capture people's intuitions about these issues, and will be applied to situations of practical interest. The theory will then be refined to take into account the outcomes of these experiments.

随着我们进入自动驾驶汽车，自动无人机和机器人的时代，帮助人们从事工作和日常任务时，越来越需要发展道德或道德行为理论。 政策制定者已经在解决一些问题。 世界各地的司法管辖区开始制定公路法规，考虑到无人驾驶汽车的存在。 该项目的目的是为这些代理商和应用的责备，意图和道德责任理论提供基础。 该研究将根据人们所做的道德判断评估这一理论，并采取第一步，以实践实现产生的政策。 一个好的理论将必须考虑许多竞争，有时甚至是冲突的目标的权衡。 这表明将涉及概率和效用。 该理论还必须处理反事实，也就是说，如果情况或行动有所不同，那会发生什么。 因果关系问题将揭示代理人的行动是否负责结果，还是该行动是偶然的结果。 另一个相关问题是确定意图：也就是说，确定代理在执行ACT时是否打算结果。 Pearl的结构方程式框架可以对反事实（干预措施）进行建模，并被用作因果关系的定义。 在这个项目中，将扩展该框架以捕获责备和意图的程度。 这些定义是相对于代理人的认知状态给出的，该状态描述了代理人的信念和偏好。 最初，信念将通过概率度量和效用函数来指定。 然后将扩展该框架以考虑信念和偏好的更多定性表示，考虑到正常性和典型性问题（例如，捕获社会惯例），以及具有多个代理商（例如，多个交流无人驾驶的汽车或机器人）的设置，如果是游戏理论的问题和集体责任的问题，与个人责任相关。 将测试在此框架下开发的定义，以查看它们是否捕获人们对这些问题的直觉，并将应用于实际利益的情况。 然后，该理论将被改进，以考虑这些实验的结果。

项目成果

Reasoning about causal models with infinitely many variables,

推理具有无限多个变量的因果模型，

• 发表时间: 2022
• 期刊: Proceedings of the Thirty-Sixth AAAI Conference on Artificial Intelligence
• 作者: S. Peters;J. Y. Halpern
• 通讯作者: J. Y. Halpern

Book review

书评

• DOI: 10.1016/j.artint.2019.103175
• 发表时间: 2019
• 期刊: Artificial Intelligence
• 影响因子: 14.4
• 作者: Halpern, Joseph Y.

A NOTE ON THE EXISTENCE OF RATIFIABLE ACTS

关于可批准法案的存在的说明

• DOI: 10.1017/s175502031800028x
• 发表时间: 2019
• 期刊: The Review of Symbolic Logic
• 作者: HALPERN, JOSEPH Y.

The evolution of cognitive mechanisms in response to cultural innovations

• DOI: 10.1073/pnas.1620742114
• 发表时间: 2017-07-25
• 期刊: PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA
• 影响因子: 11.1
• 作者: Lotem, Arnon;Halpern, Joseph Y.;Kolodny, Oren
• 通讯作者: Kolodny, Oren

Predicting responsibility judgments from dispositional inferences and causal attributions

• DOI: 10.1016/j.cogpsych.2021.101412
• 发表时间: 2021-07-21
• 期刊: COGNITIVE PSYCHOLOGY
• 影响因子: 2.6
• 作者: Langenhoff, Antonia F.;Wiegmann, Alex;Gerstenberg, Tobias
• 通讯作者: Gerstenberg, Tobias