Collaborative Research: Towards Life-like Computer Interfaces that Learn

协作研究：迈向逼真的学习计算机界面

• 批准号: 0703916
• 负责人: Jason Leigh
• 金额: $ 49.74万
• 依托单位: University of Illinois at Chicago
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2007
• 资助国家: 美国
• 起止时间: 2007-02-15 至 2012-01-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0703916&HistoricalAwards=false
• 关键词: Collaborative; Research; Towards; Life; like

This collaborative project, developing and evaluating lifelike, natural computer interfaces as portals to intelligent programs in the context of Decision Support System (DSS), aims at providing a natural interface that supports realistic spoken dialog, non-verbal cues, and the capability of learning to maintain its knowledge current and correct. The research objectives focus around the development of an avatar-based interface with which the DDS user can interact. Communication with the avatar takes place in spoken natural language combined with gesture expressions or by pointing on the screen. The system supports speaker-independent continuous speech input as a spontaneous dialog within the specified DSS domain. A robust backend that can respond intelligently to the questions asked by the DDS user is expected to generate the responses spoken in reply by the avatar with realistic inflection and visual expressions. The work develops, prototypes, and evaluates the desired user interface capabilities by using the model of a program officer to create a realistic avatar that can answer users' questions and respond in a humanly natural manner. The project extends a current sponsored project on information gathered related to a centers program where a program officer serves as subject matter expert. The recently-developed AlexDSS system that answers questions to users about the I/UCRC program provides the baseline intelligent system behind the avatar. The avatar interfaces are targeted for both general users as well as for experts responsible for updating/correcting the domain knowledge therein. The work represents a collaborative project between the Intelligent Systems Laboratory (ISL) at UCF and the Electronic Visualization Laboratory (EVL) at UIC. The EVL team focuses on avatar development encompassing Visualization and Interaction with Realistic Avatars and Evaluation of System Naturalness and Usability. The ISL team concentrates on Natural Language Recognition and on Automated Knowledge Update and Refinement.

该合作项目开发和评估逼真、自然的计算机界面，作为决策支持系统 (DSS) 背景下智能程序的门户，旨在提供支持逼真的口头对话、非语言提示和学习能力的自然界面保持其知识的最新性和正确性。研究目标集中于开发基于化身的界面，DDS 用户可以与该界面进行交互。与化身的交流是通过口语自然语言结合手势表达或通过指向屏幕来进行的。该系统支持与说话人无关的连续语音输入，作为指定 DSS 域内的自发对话。一个强大的后端可以智能地响应 DDS 用户提出的问题，预计会生成具有真实语调和视觉表达的虚拟人物的回答。这项工作通过使用项目官员的模型来开发、原型化和评估所需的用户界面功能，以创建一个现实的化身，可以回答用户的问题并以人类自然的方式做出反应。该项目扩展了当前赞助的项目，收集与中心项目相关的信息，其中项目官员担任主题专家。最近开发的AlexDSS系统可以回答用户有关I/UCRC计划的问题，提供了虚拟形象背后的基线智能系统。化身界面既针对普通用户，也针对负责更新/纠正其中领域知识的专家。这项工作是 UCF 智能系统实验室 (ISL) 和 UIC 电子可视化实验室 (EVL) 之间的合作项目。 EVL 团队专注于头像开发，包括可视化和与真实头像的交互以及系统自然性和可用性的评估。 ISL 团队专注于自然语言识别以及自动化知识更新和细化。