CHS: Small: Scientific Design of Interactive Human Computation Systems

CHS：小型：交互式人类计算系统的科学设计

• 批准号: 1525967
• 负责人: Mark Riedl
• 金额: $ 49.78万
• 依托单位: Georgia Tech Research Corporation
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-09-01 至 2019-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1525967&HistoricalAwards=false
• 关键词: CHS; Small; Scientific; Design; Interactive

Human computation systems are intelligent systems that organize humans to manually carry out computational processes that are too hard for current computational systems to solve, collect commonsense knowledge typically not available automatically, or label data. Designing them to serve recreational functions promises to overcome the need for worker monetary compensation, incentivizing crowd workers to generate data and solutions in exchange for non-monetary rewards. However, early attempts have generally not lived up to their potential, in large part because we do not understand how design decisions will impact human worker performance and engagement. This project will develop a science of design for human computation systems, in three ways: (1) Controlled experiments on how mechanics common to modern commercial social and mobile applications can be adapted to human computation. (2) An intelligent system that can automatically conduct large-scale experiments on the effects of different system designs on human workers. (3) Investigation of how the design knowledge automatically learned by the system can be used to support human software designers via intelligent tools.This research will result in (a) novel human computation design patterns, (b) new methodologies for studying the constituent parts of human computation systems, (c) new understanding of how those patterns affect human crowd worker performance and engagement, and (d) new approaches to the development of design tools that incorporate intelligent creativity support. An improved comprehension of the effects of design considerations on users will make it easier and quicker to design, develop, and deploy effective systems. The research will develop optimal experimental design algorithms that automatically generate variations of human computation systems and conduct tests of their effects on human users, resulting in a Bayesian model of the effects of software mechanics on crowd worker performance and engagement.

人类计算系统是智能系统，它组织人类手动执行当前计算系统难以解决的计算过程、收集通常无法自动获得的常识知识或标记数据。将它们设计为服务于娱乐功能有望克服对工人货币补偿的需求，激励众包工人生成数据和解决方案以换取非货币奖励。然而，早期的尝试通常没有发挥其潜力，很大程度上是因为我们不了解设计决策将如何影响人类工人的绩效和参与度。该项目将通过三种方式开发人类计算系统的设计科学：（1）关于现代商业社交和移动应用程序常见的机制如何适应人类计算的受控实验。 （2）智能系统，可以自动对不同系统设计对人类工人的影响进行大规模实验。 (3) 研究如何通过智能工具使用系统自动学习的设计知识来支持人类软件设计人员。这项研究将产生 (a) 新颖的人类计算设计模式，(b) 研究组成部分的新方法人类计算系统的新认识，（c）对这些模式如何影响人类群体工作者的表现和参与度的新理解，以及（d）开发包含智能创造力支持的设计工具的新方法。更好地理解设计考虑因素对用户的影响将使设计、开发和部署有效的系统变得更容易、更快捷。该研究将开发最佳的实验设计算法，自动生成人类计算系统的变化，并测试它们对人类用户的影响，从而形成软件机制对众包工作者绩效和参与度影响的贝叶斯模型。