Collaborative Research: CCRI: New: A Research News Recommender Infrastructure with Live Users for Algorithm and Interface Experimentation

合作研究：CCRI：新：研究新闻推荐基础设施与实时用户进行算法和界面实验

• 批准号: 2232553
• 负责人: Michael Ekstrand
• 金额: $ 15万
• 依托单位: Boise State University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-04-15 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2232553&HistoricalAwards=false
• 关键词: Collaborative; Research; CCRI; New; News

Machine learning recommender systems personalize users’ experiences online by ranking and selecting items to present based on users’ past behavior. For example, when a user visits an online retailer, the products shown are selected by a recommender system designed to help one find things to buy and to increase the vendors sales. Recommender systems are also behind most online news sources, and they can shape which news people see. Given the importance of recommender systems to individual choice, it is critical for researchers to be able to carry out studies to evaluate different designs and their impact on the users of the system. But conducting such studies is beyond the resources of most researchers. To get meaningful results requires building and sustaining a community of willing users who have given their permission to be studied. As a result, the amount of experimental research – and specifically experimental research on long-term users of a system – has plummeted. Almost all such studies are conducted by commercial recommendation platforms and their results are rarely made known to the public. This project is designed to develop a shared news recommender system specifically to enable researchers nationwide to be able to carry out experiments and learn just how different algorithms and interfaces affect users. This should create the knowledge that will allow the community to fully understand the impact of these systems and design new recommender systems that can enhance fairness and equity. When complete, this research infrastructure will support researchers in answering critical questions about how complex and often opaque recommender systems affect user behavior and to test new systems that can improve these systems and their outcomes.This community-centered project will design and build an experimental news recommender community infrastructure to support research in personalization and recommender systems, AI and machine learning, natural language processing, human-computer interaction, social computing, and other fields that would benefit from the ability to carry out online field experiments with long-term users of a system. The cloud-based software infrastructure includes a pluggable recommendation architecture in which researchers can deploy custom algorithms and interfaces, a feed of news articles starting with those obtained through a partnership with the Associated Press, experiment-support modules including consent, payment, and surveying of subjects, and support for two news interfaces—first a news digest and then a progressive web news browser. The infrastructure will maintain a set of long-term consented users, provide extensive support to researchers including overarching IRB protocols, training, sample experiments, datasets and metrics, and live support through a researcher support team. It will be governed by a community advisory board drawn from the researcher community with representatives of the content providers and end-users and charged with allocating experiment slots and steering the development and management of the infrastructure. By developing and deploying this research infrastructure, the investigators seek to empower individuals and small groups to study important questions in recommender systems, including questions about how different algorithms and interfaces can alter the diversity of sources and viewpoints represented and provide users with greater understanding and control over the content they explore. The investigators come from five institutions spread across the country and will in turn assemble and train a diverse team to take on this technically challenging and important work.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

机器学习推荐系统通过根据用户过去的行为排名和选择要呈现的商品来个性化用户的在线体验。例如，当用户访问在线零售商时，推荐系统会选择显示的产品，旨在帮助人们找到想要的东西。推荐系统也是大多数在线新闻来源的背后，它们可以决定人们看到的新闻。鉴于推荐系统对个人选择的重要性，研究人员能够进行研究至关重要。评估不同的设计及其对用户的影响但进行此类研究超出了大多数研究人员的资源范围，需要建立和维持一个愿意进行研究的用户社区，因此需要进行大量的实验研究。几乎所有此类研究都是由商业推荐平台进行的，其结果很少为公众所知。该项目旨在开发一个专门为全国研究人员提供支持的共享新闻推荐系统。能够进行实验并了解不同的算法和这应该创造知识，使社区能够充分了解这些系统的影响，并设计可以增强公平性和公平性的新推荐系统。完成后，该研究基础设施将支持研究人员回答有关复杂性的关键问题。不透明的推荐系统通常会影响用户行为，并测试可以改进这些系统及其结果的新系统。这个以社区为中心的项目将设计和构建一个实验性新闻推荐社区基础设施，以支持个性化和推荐系统、人工智能和机器学习方面的研究, 自然语言处理,人机交互、社交计算等将受益于与系统的长期用户进行在线现场实验的能力。基于云的软件基础设施包括可插入的推荐架构，研究人员可以在其中部署自定义算法和。界面，从与美联社合作获得的新闻文章开始，实验支持模块包括同意、付款和受试者调查，以及对两个新闻界面的支持——首先是新闻摘要，然后是渐进式网络新闻浏览器的基础设施将维护一组。长期同意的用户，为广泛的研究人员提供支持，包括总体 IRB 协议、培训、样本实验、数据集和指标，以及通过研究人员支持团队提供的实时支持。它将由来自研究人员社区的代表组成的社区顾问委员会进行管理。内容提供商和最终用户的职责，负责分配实验时段并指导基础设施的开发和管理。通过开发和部署这一研究基础设施，研究人员力求使个人和小组能够研究推荐系统中的重要问题，包括。关于不同算法和界面可以改变所代表的来源和观点的多样性，并使用户更好地理解和控制他们探索的内容。调查人员来自全国各地的五个机构，他们将组建和培训一支多元化的团队来应对这一技术挑战。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。