CHS: Medium: Collaborative Research: Augmented Reality Agents with Pervasive Awareness, Appearance, and Abilities

CHS：媒介：协作研究：具有普遍意识、外观和能力的增强现实代理

• 批准号: 1800961
• 负责人: Gregory Welch
• 金额: $ 67.43万
• 依托单位: The University of Central Florida Board of Trustees
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-08-15 至 2024-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1800961&HistoricalAwards=false
• 关键词: CHS; Medium; Collaborative; Research; Augmented

Voice-based assistants that respond to commands of people can be thought of as virtual companions that are always standing by to play music, tell us the weather, turn the lights off, etc. While their powers to respond and act on our behalf are increasing, unlike real companions they are largely unaware of our presence, take little initiative, look like appliances rather than interaction partners, and have limited abilities to both respond to queries and to sense and control real objects around us. This project will develop Augmented Reality Agents (ARAs) to embody these voice-based assistants, making them more are aware of our appearance, emotions, and behaviors, giving dynamic visual representations that make us aware of their state and behaviors; and leveraging the growth in "Internet of Things" (IoT) infrastructure and devices to increase the breadth and depth of their awareness. Together, these advances will lead to more effective and accepted voice-based assistants, both in the home and beyond. Such ARAs have a number of potential applications, including healthcare (by increasing the realism of clinical simulation and training, or providing support for caregiving through remote communication and virtual companionship) and education (by being more engaging tutors or representing historically important individuals). To develop embodied Augmented Reality Agents (ARAs) with pervasive contextual awareness, appearance, and abilities the researchers will undertake a program of research aimed at the nexus of concepts and technologies associated with Augmented Reality (AR), Intelligent Virtual Agents (IVA), and the Internet of Things (IoT). To maximize the expected knowledge outcomes the researchers have organized their plans into three categories. First, they will develop new understanding of and priorities for ARA awareness, appearance, and abilities in a manner that does not require, nor depend on, a specific technological realization of automated behaviors. Second, they will use off-the-shelf and custom components to realize pervasive ARA functionality, to facilitate formative experiments related to basic ARA behaviors, and develop domain-specific applications and experiments. Third, the researchers will use application-specific realizations to assess the potential usefulness related to companionship and two areas of healthcare training: pediatric patient simulators and wide-area team-based medical training. The healthcare-focused work will leverage relevant courses at UF and UCF, and UCF's NSF REU center on the Internet of Things to engage students beyond their core team, in meaningful research.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

响应人们命令的基于语音的助手可以被认为是虚拟伙伴，它们总是站在一边播放音乐、告诉我们天气、关灯等。虽然它们代表我们做出响应和采取行动的能力正在增强与真正的同伴不同，它们基本上不知道我们的存在，很少采取主动，看起来像电器而不是互动伙伴，并且响应查询以及感知和控制我们周围的真实物体的能力有限。该项目将开发增强现实代理（ARA）来体现这些基于语音的助手，使它们更加了解我们的外表、情绪和行为，提供动态的视觉表示，使我们了解他们的状态和行为；并利用“物联网”（IoT）基础设施和设备的增长来提高他们意识的广度和深度。总之，这些进步将带来更有效、更被接受的语音助理，无论是在家庭还是在其他地方。此类 ARA 有许多潜在的应用，包括医疗保健（通过提高临床模拟和培训的真实性，或通过远程通信和虚拟陪伴提供护理支持）和教育（通过成为更具吸引力的导师或代表历史上重要的个人）。 为了开发具有普遍情境意识、外观和能力的具体增强现实代理（ARA），研究人员将开展一项研究计划，旨在将增强现实（AR）、智能虚拟代理（IVA）和物联网 (IoT)。为了最大限度地提高预期的知识成果，研究人员将他们的计划分为三类。首先，他们将以一种不需要、也不依赖于自动化行为的特定技术实现的方式，对 ARA 意识、外观和能力形成新的理解和优先事项。其次，他们将使用现成的和定制的组件来实现普遍的 ARA 功能，促进与基本 ARA 行为相关的形成性实验，并开发特定领域的应用程序和实验。第三，研究人员将使用特定于应用程序的实现来评估与陪伴和医疗保健培训两个领域相关的潜在有用性：儿科患者模拟器和基于团队的广域医疗培训。这项以医疗保健为重点的工作将利用 UF 和 UCF 的相关课程，以及 UCF 的 NSF REU 物联网中心，让核心团队之外的学生参与有意义的研究。该奖项反映了 NSF 的法定使命，并被认为值得通过以下方式获得支持：使用基金会的智力价值和更广泛的影响审查标准进行评估。

项目成果

The advantages of virtual dogs over virtual people: Using augmented reality to provide social support in stressful situations

虚拟狗相对于虚拟人的优势：利用增强现实在压力情况下提供社交支持

• DOI: 10.1016/j.ijhcs.2022.102838
• 发表时间: 2022
• 期刊: International Journal of Human-Computer Studies
• 影响因子: 5.4
• 作者: Norouzi, Nahal;Kim, Kangsoo;Bruder, Gerd;Bailenson, Jeremy N.;Wisniewski, Pamela;Welch, Gregory F.
• 通讯作者: Welch, Gregory F.

Physical-Virtual Agents for Healthcare Simulation

用于医疗保健模拟的物理虚拟代理

• DOI: 10.1145/3267851.3267876
• 发表时间: 2018
• 期刊: International Conference on Intelligent Virtual Agents
• 作者: Daher, Salam;Hochreiter, Jason;Norouzi, Nahal;Gonzalez, Laura;Bruder, Gerd;Welch, Greg
• 通讯作者: Welch, Greg

[POSTER] Matching vs. Non-Matching Visuals and Shape for Embodied Virtual Healthcare Agents

[海报] 实体虚拟医疗护理人员的匹配与不匹配视觉和形状

• 发表时间: 2019
• 期刊: IEEE Virtual Reality
• 作者: Daher, Salam;Hochreiter, Jason;Norouzi, Nahal;Schubert, Ryan;Bruder, Gerd;Gonzalez, Laura;Anderson, Mindi;Diaz, Desiree;Cendan, Juan;Welch, Greg
• 通讯作者: Welch, Greg

Analysis of the Saliency of Color-Based Dichoptic Cues in Optical See-Through Augmented Reality

• DOI: 10.1109/tvcg.2022.3195111
• 发表时间: 2023-12-01
• 期刊: IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS
• 影响因子: 5.2
• 作者: Erickson，Austin;Bruder，Gerd;Welch，Gregory F.
• 通讯作者: Welch，Gregory F.

Effects of Depth Information on Visual Target Identification Task Performance in Shared Gaze Environments

共享注视环境中深度信息对视觉目标识别任务表现的影响

• DOI: 10.1109/tvcg.2020.2973054
• 发表时间: 2020
• 期刊: IEEE Transactions on Visualization and Computer Graphics
• 影响因子: 5.2
• 作者: Erickson, Austin;Norouzi, Nahal;Kim, Kangsoo;LaViola, Joseph J.;Bruder, Gerd;Welch, Gregory F.
• 通讯作者: Welch, Gregory F.