Collaborative Research: Automated Analysis of Constructed Response Concept Inventories to Reveal Student Thinking: Forging a National Network for Innovative Assessment Methods

协作研究：自动分析构建的反应概念清单以揭示学生的思维：打造创新评估方法的国家网络

• 批准号: 1022673
• 负责人: Jennifer Knight
• 金额: $ 8.45万
• 依托单位: University of Colorado at Boulder
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2010
• 资助国家: 美国
• 起止时间: 2010-09-01 至 2014-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1022673&HistoricalAwards=false
• 关键词: Collaborative; Research; Automated; Analysis; Constructed

Numerous reports on the effectiveness of U.S. higher education in the Science, Technology, Engineering and Mathematics (STEM) disciplines call for increased emphasis on conceptual learning, rather than rote memorization. Suitable assessments (tests) of conceptual learning (often referred to as concept inventories or diagnostic question clusters), however, are few and are constrained by the ability to score the outcomes of the tests in a cost-effective manner. Multiple-choice assessments (selected responses) are more widespread in higher education, especially at medium to large institutions where class sizes are large, and where automated scoring provides the essential cost-effectiveness. Conversely, written response assessments (constructed responses), which are widely held to be superior at revealing actual student thinking, are quite rare in practice given the time and effort required for manual scoring. This project leverages the latest computerized tools and statistical techniques to make constructed response assessments more broadly available. Computer automation allows the use of these more insightful conceptual questions and tests with much larger numbers of students, thereby providing an enhanced understanding of students' conceptual learning. Project personnel work with developers of conceptual testing instruments to create constructed response versions of the tests coupled with the necessary computerized scoring tools with the eventual goal of providing computer-automated evaluation of conceptual thinking. The project is a collaboration among three major public universities.

关于美国高等教育在科学，技术，工程和数学（STEM）学科中的有效性的大量报告要求越来越重视概念学习，而不是死记硬背的记忆。但是，适当的概念学习评估（测试）（通常称为概念清单或诊断问题簇）很少，并且受到以具有成本效益的方式评分测试结果的能力。多项选择评估（选定的回答）在高等教育中更为普遍，尤其是在班级规模较大的大型机构中，自动评分提供了基本的成本效益。相反，鉴于手动评分所需的时间和精力，在揭示实际的学生思维方面被广泛认为是卓越的书面响应评估（构建的响应），这在揭示实际的学生思维方面非常罕见。该项目利用最新的计算机工具和统计技术使构造的响应评估更广泛地可用。计算机自动化允许使用这些更有见地的概念性问题和测试，并与大量的学生进行测试，从而增强了对学生概念学习的了解。项目人员与概念测试工具的开发人员合作，以创建测试的构造响应版本，再加上必要的计算机评分工具，并最终的目标是提供计算机自动化的概念思维评估。该项目是三所主要公立大学之间的合作。