HCC: Small: Incorporating Procedural Fairness in Flagging Mechanisms on Social Media Sites

HCC：小型：将程序公平性纳入社交媒体网站上的标记机制

• 批准号: 2329394
• 负责人: Shagun Jhaver
• 金额: $ 58.17万
• 依托单位: Rutgers University New Brunswick
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-09-15 至 2026-05-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2329394&HistoricalAwards=false
• 关键词: HCC; Small; Incorporating; Procedural; Fairness

This research will analyze expectations and interactions of social media platform users with flagging tools in each phase of the flagging lifecycle. Platforms offer flagging, a technical feature that empowers users to report inappropriate posts or bad actors, to reduce online harm, such as hate speech, nonconsensual sharing of sexual photos, etc. However, prior research shows that reporting harms can be experienced as secondary victimization, especially when victims perceive a lack of procedural justice. Flags play a critical role in maintaining the feasibility of content moderation systems, an initial step to identifying content that requires careful review by moderators or automated tools. It is, therefore, vital to design flagging interfaces in ways that ease the negative experiences of reporting. To accomplish this goal, we must understand how users make sense of flagging, what information they seek, and how they navigate flagging interfaces.There will be three phases in this project: (1) Interviews will be conducted with social media users who have recently flagged a post to understand their motivations, mental models, and concerns prior to flagging. (2) A user study with interactive prototypes will examine the awareness, navigation, and usage issues encountered while using flagging interfaces to report a post. (3) Participatory design workshop sessions will develop prototypes for post-flagging information and communication systems. In each phase, the research output will be codesigned with individuals from marginalized communities, who face disproportionate online abuse. Analysis will draw from the interpretive lens of procedural justice and its notions of voice and consistency to investigate how users develop their fairness perceptions of the flagging processes. It will produce a taxonomy of flagging-decision trees, offering a generative set of design dimensions upon which platforms may alter future flagging implementations.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

这项研究将分析社交媒体平台用户在举报生命周期的每个阶段与举报工具的期望和互动。平台提供举报功能，这是一种技术功能，使用户能够举报不当帖子或不良行为者，以减少网络伤害，例如仇恨言论、未经同意分享性照片等。然而，先前的研究表明，举报伤害可能会被视为二次受害，特别是当受害者认为缺乏程序正义时。标记在维持内容审核系统的可行性方面发挥着关键作用，这是识别需要审核者或自动化工具仔细审核的内容的第一步。因此，以减轻报告负面体验的方式设计标记界面至关重要。为了实现这一目标，我们必须了解用户如何理解举报、他们寻求什么信息以及他们如何导航举报界面。该项目将分为三个阶段：（1）对最近接触过社交媒体的用户进行采访举报帖子以在举报之前了解他们的动机、心理模式和担忧。 (2) 使用交互式原型进行的用户研究将检查使用标记界面报告帖子时遇到的认知、导航和使用问题。 (3) 参与式设计研讨会将开发标记后信息和通信系统的原型。在每个阶段，研究成果都将与来自边缘化社区的个人共同设计，这些社区面临着不成比例的网络虐待。分析将从程序正义的解释视角及其声音和一致性的概念出发，调查用户如何发展他们对标记过程的公平性看法。它将产生标记决策树的分类法，提供一组生成的设计维度，平台可以根据这些维度改变未来的标记实施。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力优点和更广泛的影响进行评估，被认为值得支持审查标准。