CRII: RI: Bayesian Models for Fairness, and Fairness for Bayesian Models

CRII：RI：公平性的贝叶斯模型以及贝叶斯模型的公平性

• 批准号: 1850023
• 负责人: James Foulds
• 金额: $ 17.49万
• 依托单位: University of Maryland Baltimore County
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-07-01 至 2023-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1850023&HistoricalAwards=false
• 关键词: CRII; RI; Bayesian; Models; Fairness

In our interconnected society, artificial intelligence (AI) and machine learning (ML) systems have become ubiquitous. Every day, machine learning systems influence our purchasing decisions, our navigation through virtual and physical spaces, the friendships we make, and even the romantic relationships we form. The decisions automated by these systems have increasingly important real-world consequences, from credit scoring, to college admissions, to the prediction of re-offending behavior in the criminal justice system, as is already being used for bail and sentencing decisions across the United States of America. With the growing impact of artificial intelligence and machine learning technologies on our society, and their importance to the economic competitiveness and technological leadership of the United States, it is imperative that we ensure that these systems behave in a fair and trustworthy manner. Recent studies have shown that data-driven AI and ML systems can in some cases exhibit unfair and unjust behavior, for example due to biases hidden in the input data, or because of flawed engineering decisions. This project develops a suite of tools for modeling, measuring, and correcting unfair and discriminatory behavior in AI and ML systems. The research focuses on simultaneously addressing algorithmic discrimination that may occur across several overlapping dimensions, including gender, race, national origin, sexual orientation, disability status, and socioeconomic class. The novel AI techniques developed in this project address the two main technical challenges which specifically arise in this context: uncertainty in the measurement of fairness, and correlations in the data.When ensuring AI fairness regarding multiple protected dimensions such as gender and race, data sparsity rapidly becomes a challenge as the number of dimensions, or the number of values per dimension, increase. This data sparsity directly results in uncertainty in the measurement of fairness. The project will leverage Bayesian inference, a branch of statistics which specifically addresses uncertainty, to manage this issue. Correlations between the protected (and other) attributes will be leveraged using probabilistic graphical models, a class of machine learning models which encode dependence relationships. Using a novel Bayesian definition of fairness as a unifying framework, the project's contributions consist of three interdependent tracks. The first track will focus on developing general modeling techniques for the statistically efficient measurement of fairness, using latent variable models to produce parsimonious representations, and hierarchical modeling to achieve data efficiency. The second track develops adversarial optimization algorithms to train machine learning algorithms to respect fairness constraints when the data distribution is uncertain. In the third track, the project will develop methods for ensuring fairness in Bayesian inference, which can be used to prevent the inferences from reflecting negative stereotypes. The methods will be validated with case studies on applications across a wide range of data regimes, including modeling census income data, criminal justice recidivism prediction, and social media analytics.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

在我们互联的社会中，人工智能 (AI) 和机器学习 (ML) 系统已经无处不在。 机器学习系统每天都会影响我们的购买决策、我们在虚拟和物理空间中的导航、我们建立的友谊，甚至我们形成的浪漫关系。 这些系统自动化的决策对现实世界产生越来越重要的影响，从信用评分到大学录取，再到刑事司法系统中再犯罪行为的预测，美国各地已经将其用于保释和量刑决策美国的。 随着人工智能和机器学习技术对我们社会的影响越来越大，及其对美国经济竞争力和技术领先地位的重要性，我们必须确保这些系统以公平和值得信赖的方式运行。 最近的研究表明，数据驱动的人工智能和机器学习系统在某些情况下可能会表现出不公平和不公正的行为，例如由于输入数据中隐藏的偏见，或者由于有缺陷的工程决策。 该项目开发了一套工具，用于建模、测量和纠正人工智能和机器学习系统中的不公平和歧视行为。 该研究的重点是同时解决可能发生在多个重叠维度的算法歧视，包括性别、种族、国籍、性取向、残疾状况和社会经济阶层。 该项目开发的新颖人工智能技术解决了在此背景下特别出现的两个主要技术挑战：公平性测量的不确定性和数据的相关性。在确保性别和种族等多个受保护维度的人工智能公平性时，数据稀疏性随着维度数量或每个维度的值数量的增加，迅速成为一个挑战。 这种数据稀疏性直接导致了公平性衡量的不确定性。 该项目将利用贝叶斯推理（专门解决不确定性的统计学分支）来解决这个问题。 将使用概率图形模型来利用受保护（和其他）属性之间的相关性，概率图形模型是一类编码依赖关系的机器学习模型。 该项目使用新颖的贝叶斯公平定义作为统一框架，其贡献包括三个相互依赖的轨道。 第一个轨道将侧重于开发通用建模技术，以统计有效地衡量公平性，使用潜在变量模型来生成简约的表示，并使用分层建模来实现数据效率。 第二条路线开发对抗性优化算法，以训练机器学习算法在数据分布不确定时尊重公平性约束。 在第三个轨道中，该项目将开发确保贝叶斯推理公平性的方法，可用于防止推论反映负面刻板印象。这些方法将通过各种数据制度的应用案例研究进行验证，包括人口普查收入数据建模、刑事司法累犯预测和社交媒体分析。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准。

项目成果

Do Humans Prefer Debiased AI Algorithms? A Case Study in Career Recommendation

人类更喜欢有偏差的人工智能算法吗？

• DOI: 10.1145/3490099.3511108
• 发表时间: 2022
• 期刊: Annual Conference on Intelligent User Interfaces (IUI
• 作者: Wang, Clarice;Wang, Kathryn;Bian, Andrew;Islam, Rashidul;Keya, Kamrun Naher;Foulds, James;Pan, Shimei
• 通讯作者: Pan, Shimei

Can We Obtain Fairness For Free?

我们能免费获得公平吗？

• DOI: 10.1145/3461702.3462614
• 发表时间: 2021
• 期刊: and Society 2021
• 作者: Islam, Rashidul;Pan, Shimei;Foulds, James R.
• 通讯作者: Foulds, James R.

Equitable Allocation of Healthcare Resources with Fair Survival Models

以公平生存模式公平分配医疗资源

• DOI: 10.1137/1.9781611976700.22
• 发表时间: 2021
• 期刊: Proceedings of the 2021 SIAM International Conference on Data Mining (SDM 2021
• 作者: Keya, Kamrun Naher;Islam, Rashidul;Pan, Shimei;Stockwell, Ian;Foulds, James
• 通讯作者: Foulds, James

Differential Fairness

• 发表时间: 2019
• 期刊: J. Multiple Valued Log. Soft Comput.
• 作者: James R. Foulds;Rashidul Islam;Kamrun Keya;Shimei Pan

Equitable Allocation of Healthcare Resources with Fair Cox Models

利用公平考克斯模型公平分配医疗资源

• 发表时间: 2020
• 期刊: AAAI Fall Symposium on AI in Government and Public Sector (AAAI FSS-20
• 作者: Keya, K.;Islam, R.;Pan, S.;Stockwell, I.;Foulds, J. R.
• 通讯作者: Foulds, J. R.