CAREER: Networked Multi-User Augmented Reality for Mobile Devices

职业：移动设备的联网多用户增强现实

• 批准号: 1942700
• 负责人: Jiasi Chen
• 金额: $ 53.89万
• 依托单位: University of California-Riverside
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-05-01 至 2025-04-30
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1942700&HistoricalAwards=false
• 关键词: CAREER; Networked; Multi; User; Augmented

Augmented reality (AR) is an emerging technology with potential applications in many fields, including education, entertainment, and public safety. In single-user AR, a user's perception is augmented by overlaying virtual objects onto the real world. In multi-user AR, multiple users are able to view and interact with a common set of virtual objects. However, in today's multi-user AR applications, users can experience poor performance (such as high latency or inconsistent views of the virtual objects by different users) due to the AR application's lack of advanced networking capabilities. This project seeks to address such user experience issues by developing the network capabilities of the underlying AR platform, in order to support future multi-user AR applications.The vision of this project is to create AR-enabling technology where multiple users can visually scan the environment, and a common set of relevant virtual objects swiftly pop up on top of the real-world objects. To accomplish this, the AR devices need to efficiently compute and exchange information amongst themselves, in order to synchronize their joint understanding of the real and virtual worlds. The planned research has three main technical components: (1) measuring and characterizing multi-user AR applications; (2) adapting an AR application to the computing and networking conditions; and (3) adapting the network to the needs of an AR application. Evaluation scenarios include an educational AR classroom application, as well as mobile clients in a 5G testbed.The success of this project will open up a new class of multi-user AR applications in a broad range of fields, including education (for example, multiple AR-equipped students in a classroom) and public safety (for example, multiple AR-equipped first responders in a disaster scenario). The findings from this project will impact how application developers design AR applications and how network operators manage AR network traffic. The multi-user AR platform will be incorporated into undergraduate classes and a campus makerspace, as well as in outreach efforts at local hackathons and high school workshops, with the aim of encouraging women to enter and stay in engineering fields.Results from this project, including papers, simulation and application code, and AR quality evaluation and benchmarking tools, will be available at the project website https://github.com/multi-user-ar. The website and code will be available and supported for the duration of this project, and preserved online thereafter.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

增强现实（AR）是一种新兴技术，在教育、娱乐和公共安全等许多领域具有潜在的应用前景。在单用户 AR 中，通过将虚拟对象叠加到现实世界上来增强用户的感知。在多用户 AR 中，多个用户能够查看一组通用的虚拟对象并与之交互。然而，在当今的多用户 AR 应用中，由于 AR 应用缺乏先进的网络功能，用户可能会遇到性能不佳的情况（例如高延迟或不同用户对虚拟对象的视图不一致）。该项目旨在通过开发底层 AR 平台的网络功能来解决此类用户体验问题，以支持未来的多用户 AR 应用。该项目的愿景是创建 AR 支持技术，让多个用户可以直观地扫描环境中，一组常见的相关虚拟对象会迅速弹出在现实世界对象之上。为了实现这一目标，AR 设备需要在它们之间高效地计算和交换信息，以便同步它们对现实世界和虚拟世界的共同理解。计划的研究包含三个主要技术组成部分：（1）测量和表征多用户 AR 应用； (2) 使AR应用适应计算和网络条件； (3) 使网络适应 AR 应用的需求。评估场景包括教育 AR 课堂应用程序以及 5G 测试台中的移动客户端。该项目的成功将为包括教育在内的广泛领域开辟一类新的多用户 AR 应用程序（例如，多用户 AR 应用程序）。教室里配备 AR 的学生）和公共安全（例如，灾难场景中多个配备 AR 的急救人员）。该项目的研究结果将影响应用程序开发人员设计 AR 应用程序的方式以及网络运营商管理 AR 网络流量的方式。多用户 AR 平台将被纳入本科生课程和校园创客空间，以及当地黑客马拉松和高中研讨会的推广工作，旨在鼓励女性进入并留在工程领域。该项目的结果是，包括论文、模拟和应用代码以及 AR 质量评估和基准测试工具，将在项目网站 https://github.com/multi-user-ar 上提供。该网站和代码将在该项目期间可用并受到支持，并在此后在线保存。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

SLAM-share: visual simultaneous localization and mapping for real-time multi-user augmented reality

SLAM-share：实时多用户增强现实的视觉同步定位和建图

• DOI: 10.1145/3555050.3569142
• 发表时间: 2022-11
• 期刊: Proceedings of the 18th International Conference on emerging Networking EXperiments and Technologies
• 作者: Dhakal, Aditya;Ran, Xukan;Wang, Yunshu;Chen, Jiasi;Ramakrishnan, K. K.
• 通讯作者: Ramakrishnan, K. K.

VIA: Visibility-aware Web-based Virtual Reality

VIA：基于网络的可见性虚拟现实

• DOI: 10.1145/3485444.3487641
• 发表时间: 2021-11-08
• 期刊: Proceedings of the 26th International Conference on 3D Web Technology
• 作者: Carter Slocum;Jingwen Huang;Jiasi Chen
• 通讯作者: Jiasi Chen

Multi-user augmented reality with communication efficient and spatially consistent virtual objects

多用户增强现实，具有高效通信和空间一致的虚拟对象

• DOI: 10.1145/3386367.3431312
• 发表时间: 2020-01
• 期刊: Proceedings of the 16th International Conference on emerging Networking EXperiments and Technologies
• 作者: Ran, Xukan;Slocum, Carter;Tsai, Yi;Apicharttrisorn, Kittipat;Gorlatova, Maria;Chen, Jiasi
• 通讯作者: Chen, Jiasi

Breaking Edge Shackles: Infrastructure-Free Collaborative Mobile Augmented Reality

打破边缘束缚：无基础设施的协作移动增强现实

• DOI: 10.1145/3560905.3568546
• 发表时间: 2022-11-06
• 期刊: Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems
• 作者: Kittipat Apicharttrisorn;Jiasi Chen;Vyas Sekar;Anthony G. Rowe;S. Krishnamurthy
• 通讯作者: S. Krishnamurthy