ITR: Creating the Next Generation of Intelligent Animated Conversational Agents

ITR：创建下一代智能动画对话代理

• 批准号: 0086107
• 负责人: Ronald Cole
• 金额: --
• 依托单位: University of Colorado at Boulder
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2000
• 资助国家: 美国
• 起止时间: 2000-09-01 至 2007-10-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0086107&HistoricalAwards=false
• 关键词: ITR; Creating; Next; Generation; Intelligent

This is the first year funding of a five-year continuing award. The goal of this project is to improve reading achievement of children with reading problems by designing computer-based interactive reading tutors that incorporate new speech and language technologies. The reading tutors will help English- and Spanish-speaking children learn to read by providing classroom teachers and reading specialists with tools to instruct and exercise the set of auditory, visual and linguistic skills needed to read, speech discrimination, speech production, phonological awareness, sound-to-letter mappings, vocabulary, fluency and comprehension. The tutors will be designed, tested and refined in collaboration with reading specialists and instructional designers, and tested with children in special education programs in elementary schools in Boulder Colorado. The tutors will incorporate new and improved auditory and visual speech recognition and facial animation technologies. Five partner sites - Oregon Graduate Institute (OGI), Universidad de las Americas, Puebla (UDLA), University of California, Santa Cruz (UCSC), University of California, San Diego (UCSD) and the University of Colorado (CU), will develop speech and language technologies. Research and development of children's speech recognizers will be conducted at UDLA for Spanish and at OGI for English. In addition, these sites will design and develop speech corpora to enable recognition research. UCSD will conduct research leading to development of head tracking and speech reading systems, and design and develop video corpora to enable this research. UCSC will conduct research leading to development of new animated faces with improved animation capabilities. System integration will be conducted at OGI, which will integrate auditory and visual recognition systems and facial animation systems into the CSLU Toolkit. CU will develop English reading tutors in collaboration with teachers, instructional designers and students, and conduct evaluations of project outcomes. UDLA will also develop and test Spanish versions of the tutors.The project is expected to produce significant advances in auditory and visual recognition technologies, including accurate recognition of children's speech, accurate recognition of visual features of speech, and the first real-time integration of auditory and visual speech recognition in language training applications. In addition, the PI and his team will achieve a new level of understanding of the structure of children's speech, and the processing of auditory and visual information in reading. Facial animation is expected to play a major role in engaging children, enabling them to enjoy the learning experience more and therefore spend more time on task. The PI expects to demonstrate that facial animation using visible articulators will improve speech discrimination and speech production skills, improved phonological awareness and improved reading. By integrating auditory and visual speech recognition and speech generation technologies into animated agents, and designing reading tutors that incorporate these agents in a well designed reading program, the PI hopes to improve reading achievement in schools. To optimize this outcome, the PI is working closely with reading specialists to incorporate their experience and best practices; and by developing formative and summative evaluation plans that assure fair and accurate assessment of the outcomes of the planned interventions.

这是五年持续奖的第一年资助。该项目的目标是通过设计结合新语音和语言技术的基于计算机的交互式阅读导师来提高有阅读问题的儿童的阅读成绩。 阅读导师将通过为课堂教师和阅读专家提供工具来指导和练习阅读所需的听觉、视觉和语言技能、言语辨别、言语产生、语音意识、声音到字母的映射、词汇、流利度和理解力。 这些导师将与阅读专家和教学设计师合作进行设计、测试和完善，并在科罗拉多州博尔德小学的特殊教育项目中对儿童进行测试。 导师将采用新的和改进的听觉和视觉语音识别以及面部动画技术。 五个合作院校 - 俄勒冈研究生院 (OGI)、普埃布拉美洲大学 (UDLA)、加州大学圣克鲁斯分校 (UCSC)、加州大学圣地亚哥分校 (UCSD) 和科罗拉多大学 (CU)开发语音和语言技术。 儿童语音识别器的研究和开发将在西班牙语的 UDLA 和英语的 OGI 进行。此外，这些网站将设计和开发语音语料库以实现识别研究。 加州大学圣地亚哥分校将开展头部跟踪和语音阅读系统开发的研究，并设计和开发视频语料库来支持这项研究。 UCSC 将开展研究，开发具有改进动画能力的新动画面孔。系统集成将在 OGI 进行，将听觉和视觉识别系统以及面部动画系统集成到 CSLU 工具包中。 CU将与教师、教学设计者和学生合作开发英语阅读导师，并对项目成果进行评估。 UDLA还将开发和测试西班牙语版本的导师。该项目预计将在听觉和视觉识别技术方面取得重大进展，包括儿童语音的准确识别、语音视觉特征的准确识别以及首次实时集成语言训练应用中的听觉和视觉语音识别。 此外，PI和他的团队将对儿童言语结构以及阅读中听觉和视觉信息的处理的理解达到新的水平。 面部动画预计将在吸引儿童方面发挥重要作用，使他们能够更多地享受学习体验，从而花更多时间完成任务。 PI 希望证明使用可见发音器官的面部动画将提高言语辨别能力和言语表达技能，提高语音意识并改善阅读能力。 通过将听觉和视觉语音识别以及语音生成技术集成到动画代理中，并设计阅读导师，将这些代理纳入精心设计的阅读程序中，PI 希望提高学校的阅读成绩。 为了优化这一结果，PI 正在与阅读专家密切合作，吸收他们的经验和最佳实践；制定形成性和总结性评价计划，确保对计划干预措施的结果进行公平和准确的评估。