Assessing College-Ready Computational Thinking

评估大学就绪计算思维

• 批准号: 2010314
• 负责人: Mark Wilson
• 金额: $ 239.77万
• 依托单位: University of California-Berkeley
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-09-01 至 2024-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2010314&HistoricalAwards=false
• 关键词: Assessing; College; Ready; Computational; Thinking

Because of the growing need for students to be college and career ready, high-quality assessments of college readiness skills are in high demand. To realize the goal of preparing students for college and careers, assessments must measure important competencies and provide rapid feedback to teachers. It is necessary to go beyond the limits of multiple-choice testing and foster the skills and thinking that lie at the core of college and career ready skills, such as computational thinking. Computational thinking is a set of valuable skills that can be used to solve problems, design systems, and understand human behavior, and is thus essential to developing a more STEM-literate public. Computational thinking is increasingly seen as a fundamental analytical skill that everyone, not just computer scientists, can use. The goal of this project is to develop learning progressions and assessment items targeting computational thinking. The items will be used for a test of college-ready critical reasoning skills and will be integrated into an existing online assessment system, the Berkeley Assessment System Software.The project will address a set of research questions focused on 1) clarifying computational thinking constructs, 2) usability, reliability of validity of assessment items and the information they provide, 3) teachers' use of assessments, and 4) relationships to student performance. The study sample of 2,700 used for the pilot and field tests will include all levels of students in 10th through 12th grade and first year college students (both community college and university level). The target population is students in schools which are implementing the College Readiness Program (CRP) of the National Mathematics and Science Institute. In the 2020-21 academic year 54 high schools across 11 states (CA, GA, FL, ID, LA, NC, NM, OH, TX, VA, and WA) will participate. This will include high school students in Advanced Placement classes as well as non-Advanced Placement classes. The team will use the BEAR Assessment System to develop and refine assessment materials. This system is an integrated approach to developing assessments that seeks to provide meaningful interpretations of student work relative to cognitive and developmental goals. The researchers will gather empirical evidence to develop and improve the assessment materials, and then gather reliability and validity evidence to support their use. In total, item response data will be collected from several thousand students. Student response data will be analyzed using multidimensional item response theory models.The Discovery Research preK-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools. Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

由于学生对大学和职业做好准备的需求不断增长，因此对大学准备技能的高质量评估的需求很高。为了实现让学生为大学和职业做好准备的目标，评估必须衡量重要的能力并向教师提供快速反馈。有必要超越多项选择测试的限制，培养大学和职业准备技能的核心技能和思维，例如计算思维。计算思维是一组有价值的技能，可用于解决问题、设计系统和理解人类行为，因此对于培养更具 STEM 素养的公众至关重要。计算思维越来越被视为一种基本分析技能，每个人（而不仅仅是计算机科学家）都可以使用。该项目的目标是开发针对计算思维的学习进程和评估项目。这些项目将用于测试大学准备的批判性推理技能，并将集成到现有的在线评估系统，即伯克利评估系统软件中。该项目将解决一系列研究问题，重点是：1）澄清计算思维结构， 2) 评估项目及其提供的信息的可用性、有效性的可靠性，3) 教师对评估的使用，以及 4) 与学生表现的关系。用于试点和实地测试的 2,700 名研究样本将包括 10 至 12 年级的各个级别的学生以及一年级大学生（社区学院和大学水平）。目标人群是正在实施国家数学和科学研究所大学准备计划（CRP）的学校的学生。 2020-21 学年，来自 11 个州（加利福尼亚州、佐治亚州、佛罗里达州、爱达荷州、洛杉矶、北卡罗来纳州、新墨西哥州、俄亥俄州、德克萨斯州、弗吉尼亚州和华盛顿州）的 54 所高中将参与其中。这将包括先修课程和非先修课程的高中生。 该团队将使用 BEAR 评估系统来开发和完善评估材料。该系统是一种开发评估的综合方法，旨在为与认知和发展目标相关的学生作业提供有意义的解释。研究人员将收集经验证据来开发和改进评估材料，然后收集可靠性和有效性证据来支持其使用。总共将从数千名学生收集项目响应数据。将使用多维项目响应理论模型对学生响应数据进行分析。Discovery Research preK-12 计划 (DRK-12) 旨在显着增强 preK-12 学生和学生对科学、技术、工程和数学 (STEM) 的学习和教学。教师通过研究和开发创新资源、模型和工具。 DRK-12 计划中的项目建立在 STEM 教育的基础研究和先前的研究和开发工作的基础上，为拟议项目提供理论和实证依据。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值进行评估，被认为值得支持以及更广泛的影响审查标准。