RAPID: DRL AI: The Development of a Digital Platform for Evaluating and Using AI-Generated Content for Academic Purposes

RAPID：DRL AI：开发用于评估和使用人工智能生成内容用于学术目的的数字平台

• 批准号: 2337969
• 负责人: Amy Hutchison
• 金额: $ 19.96万
• 依托单位: University of Alabama Tuscaloosa
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-10-01 至 2024-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2337969&HistoricalAwards=false
• 关键词: RAPID; DRL; AI; Development; Digital

The recent development of artificial intelligence (AI) tools such as ChatGPT and Bard present new opportunities and challenges for learners in the elementary and middle grades. Despite their potential for facilitating and supporting scientific reading and writing, there are pressing concerns about how AI tools can produce harmful, biased, and false content, which then gets reproduced by users who lack sufficient critical evaluation skills or do not understand the importance of evaluating AI-generated content. Thus, there is an urgent need to develop instructional materials and strategies to support students’ development of these important critical thinking skills. The purpose of this time-sensitive project is to develop a web-based platform, called Compose With AI, aimed at guiding students to evaluate AI-generated content and use factual information to compose common types of science-focused writing (e.g., composing arguments, claims or solutions related to science topics). The Compose with AI platform will: 1) guide students to gather and critically evaluate content produced by AI, 2) guide students on beneficial and ethical uses of content produced by AI, and 3) scaffold students’ use of AI-generated content as a model and resource for composing science-focused texts. Project researchers will use gathered data to determine what critical evaluation approaches and strategies inhibit and enhance students’ abilities to use and critically evaluate content generated with AI, including when using the Compose With AI platform. The project team will follow a design-based implementation research approach to evaluate the usefulness and usability of the Compose With AI. Data to address the address the research questions will be collected as participants engage in a guided task where they use Compose With AI to evaluate AI-generated content and generate a response to a prompt. A verbal reporting methodology will be used to understand students’ cognitive processes as they think aloud during the task (concurrently) and as they reflect on their work after the task (retrospectively). Verbal protocol analysis will focus on which approaches and strategies students selected from the list presented in the platform, how they used the strategies, which strategies were successful, and which uses of AI were most useful for integrating AI-generated content into their responses. Teacher participants will also provide feedback on the platform design and the student think-aloud tasks. All data will be combined and analyzed qualitatively to answer the research questions. Findings will be used to refine and publicly share the Compose With AI platform for classroom use. This proposal was received in response to the Dear Colleague Letter (DCL): Rapidly Accelerating Research on Artificial Intelligence in K-12 Education in Formal and Informal Settings (NSF 23-097) and funded by the Innovative Technology Experiences for Students and Teachers (ITEST) program, which supports projects that build understandings of practices, program elements, contexts and processes contributing to increasing students' knowledge and interest in science, technology, engineering, and mathematics (STEM) and information and communication technology (ICT) careers.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

ChatGPT 和 Bard 等人工智能 (AI) 工具的最新发展为中小学学习者带来了新的机遇和挑战，尽管它们在促进和支持科学阅读和写作方面具有潜力，但人们对人工智能工具如何发挥作用仍存在紧迫的担忧。产生有害的、有偏见的和虚假的内容，然后被缺乏批判性评估技能或不了解评估人工智能生成内容的重要性的用户复制。因此，迫切需要开发教学材料和策略来支持学生。 ' 发展这些重要的批判性思维技能。这个时间敏感项目的目的是开发一个名为 Compose With AI 的网络平台，旨在指导学生评估人工智能生成的内容并使用事实信息撰写常见类型的以科学为重点的写作（例如，撰写论点、 Compose with AI 平台将：1) 指导学生收集和批判性评估人工智能生成的内容，2) 指导学生有益且合乎道德地使用人工智能生成的内容，3) 为学生提供支持。 ' 使用人工智能生成的内容作为撰写以科学为中心的文本的模型和资源，项目研究人员将使用收集的数据来确定哪些批判性评估方法和策略会抑制和增强学生使用和批判性评估人工智能生成的内容的能力，包括在使用人工智能生成的内容时。 Compose With AI 平台。项目团队将遵循基于设计的实施研究方法来评估 Compose With AI 的有用性和可用性，以解决参与者参与指导任务时收集的研究问题。 Compose With AI 评估 AI 生成的内容口头报告方法将用于了解学生在任务期间（同时）大声思考以及任务结束后（回顾性）反思自己的工作时的认知过程。教师参与者还将提供反馈，了解学生从平台上列出的列表中选择哪些方法和策略、他们如何使用这些策略、哪些策略是成功的，以及人工智能的哪些使用对于将人工智能生成的内容整合到他们的回答中最有用。关于平台设计和学生所有数据都将被合并和定性分析，以回答研究问题，并用于完善和公开共享 Compose With AI 平台以供课堂使用。 ）：快速加速正式和非正式环境中 K-12 教育中的人工智能研究 (NSF 23-097)，并由学生和教师创新技术体验 (ITEST) 计划资助，该计划支持加深对实践、项目要素、背景和流程的理解的项目，有助于提高学生对科学、技术、工程和数学 (STEM) 以及信息和通信技术 (ICT) 职业的知识和兴趣。该奖项反映了 NSF 的法定使命通过使用基金会的智力优点和更广泛的影响审查标准进行评估，并被认为值得支持。