HCC: Medium: Collaborative Research: Generating Effective Dynamic Explanations in Augmented Reality

HCC：媒介：协作研究：在增强现实中生成有效的动态解释

• 批准号: 0905569
• 负责人: Steven Feiner
• 金额: $ 80.32万
• 依托单位: Columbia University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2009
• 资助国家: 美国
• 起止时间: 2009-09-01 至 2014-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0905569&HistoricalAwards=false
• 关键词: HCC; Medium; Collaborative; Research; Generating

To survive and flourish, people must interact with their environment in an organized fashion. To do so, they need to learn, imagine, and perform an assortment of transformations on and in the world. Primary among these are manipulation of objects and navigation in space. This project integrates research in computer science and cognitive science to develop and evaluate augmented reality tools to create effective dynamic explanations that enhance manipulation and navigation, in conjunction with identification and visualization. Augmented reality refers to user interfaces in which virtual material is integrated with and overlaid on the user?s experience of the real world; for example, by using tracked head-worn and hand-held displays. Dynamic explanations are task-appropriate sequences of actions, presented interactively, with appropriate added information. The tools will be created in collaboration with subject matter experts for exploratory use in indoor and outdoor real world domains: navigating and identifying landmarks in a wooded park area, assembling a piece of furniture, and navigating and visualizing for planning the site of a new urban campus. Cognitive science research will determine the best ways to convey explanations and information to people. Computer science research will address the design and implementation of systems that embody the best candidate approaches for identifying objects and locations, specifying actions, and adding non-visible information. In situ experiments will be used to assess and refine the systems. Manipulation, navigation, identification, and visualization are representative of important things that people do every day, ranging from fixing broken equipment to reaching a desired destination in an unfamiliar environment. The ways in which we perform these tasks could potentially be improved significantly through augmented reality systems designed using the principles to be developed by this project. Both the cognitive principles and the augmented reality tools will have broad applicability. The systems developed will inform the design of future systems that can aid the general public, for educational and recreational ends, as well as systems that can assist people with auditory, visual, or physical impairments.

为了生存和繁荣，人们必须以有组织的方式与环境互动。为此，他们需要学习、想象并在世界上和世界中进行各种转变。其中最主要的是物体的操纵和空间导航。该项目整合了计算机科学和认知科学的研究，开发和评估增强现实工具，以创建有效的动态解释，结合识别和可视化，增强操作和导航。增强现实是指用户界面中虚拟材料与现实世界的用户体验相集成并叠加；例如，通过使用跟踪式头戴式和手持式显示器。动态解释是适合任务的动作序列，以交互方式呈现，并带有适当的附加信息。这些工具将与主题专家合作创建，用于室内和室外现实世界领域的探索性使用：导航和识别树木繁茂的公园区域中的地标，组装一件家具，以及导航和可视化规划新城市的场地校园。认知科学研究将确定向人们传达解释和信息的最佳方式。计算机科学研究将解决系统的设计和实现，这些系统体现了识别对象和位置、指定操作和添加不可见信息的最佳候选方法。现场实验将用于评估和完善系统。 操纵、导航、识别和可视化是人们每天所做的重要事情的代表，从修复损坏的设备到在陌生的环境中到达所需的目的地。通过使用该项目开发的原理设计的增强现实系统，我们执行这些任务的方式可能会得到显着改善。认知原理和增强现实工具都将具有广泛的适用性。开发的系统将为未来的系统设计提供信息，这些系统可以帮助公众、达到教育和娱乐目的，以及可以帮助有听觉、视觉或身体障碍的人的系统。