REU Site: Collaborative: Making Augmented and Virtual Reality Accessible

REU 网站：协作：让增强现实和虚拟现实变得触手可及

• 批准号: 2051053
• 负责人: Steven Feiner
• 金额: $ 17.24万
• 依托单位: Columbia University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-05-15 至 2024-04-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2051053&HistoricalAwards=false
• 关键词: REU; Site; Collaborative; Making; Augmented

Augmented and virtual reality (XR) technologies are becoming popular consumer products. However, at present XR devices, development tools, and content pose major accessibility challenges for people with disabilities. How can you describe a 3D virtual environment to a person with a visual impairment? How should you present captions in 3D to a person who is hard-of-hearing? How can a person with a motor control disability navigate a 3D world? This REU Site brings together Profs. Shiri Azenkot and Brian Smith, experts in accessibility, along with Prof. Steven Feiner, an augmented reality and 3D interaction pioneer. The site will train students to be future leaders in XR accessibility. Students will receive training in accessibility and XR, engage in the research process from ideation to presentations, and join a community of scholars and practitioners who will provide career advice and mentorship. In addition, the projects undertaken by REU students will form the basis for new collaborations among the investigators and other collaborators at Columbia and Cornell. The site will recruit students from underrepresented backgrounds, especially students with disabilities. The target is to have a mixed-ability cohort where half the students have a disability and half do not. Students will participate in a range of formal and informal learning, including an XR development "bootcamp," conversations with XR experts across academia and industry, and presentations on their work progress. Students will work on projects at the intersection of accessibility and XR. Examples of possible projects include designing descriptions that provide overviews of virtual environments for people who are blind and designing effective navigation techniques in a virtual environment, also for people who are blind. The broader impacts of this proposal are two-fold. First, it supports the NSF’s mission of broadening participation by focusing recruitment efforts on students from underrepresented groups, especially students with disabilities. Second, the focus of the research will benefit people with disabilities around the world. As XR becomes an increasingly popular consumer platform, the REU research will help ensure that it provides an equal user experience to people regardless of their disability status.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

增强现实和虚拟现实 (XR) 技术正在成为流行的消费产品，但是，目前 XR 设备、开发工具和内容给残疾人士带来了重大的无障碍挑战，如何向视力障碍人士描述 3D 虚拟环境。 ? 您应该如何向有听力障碍的人提供 3D 字幕？这个 REU 网站汇集了无障碍专家 Shiri Azenkot 和 Brian Smith，该网站将与增强现实和 3D 交互先驱 Steven Feiner 教授合作，将学生培养成为 XR 无障碍方面的未来领导者。学生将接受无障碍和 XR 方面的培训，参与从构思到演示的研究过程，并加入一个研究项目。此外，REU 学生开展的项目将为哥伦比亚大学和康奈尔大学的研究人员和其他合作者之间的新合作奠定基础，特别是来自代表性不足的背景的学生。目标是建立一个混合能力群体，其中一半学生有残疾，一半没有残疾，学生将参加一系列正式和非正式的学习，包括 XR 开发“训练营”、与 XR 专家的对话。学生将在学术界和工业界开展有关可访问性和 XR 交叉领域的项目的演示，包括设计为盲人提供虚拟环境概述的描述以及设计有效的导航技术。虚拟环境，也适合那些该提案具有双重影响，首先，它支持国家科学基金会扩大参与的使命，重点关注代表性不足的群体的学生，特别是残疾学生；其次，该研究的重点将惠及残疾人。随着 XR 成为越来越受欢迎的消费者平台，REU 的研究将有助于确保它为人们提供平等的用户体验，无论其残疾状况如何。该奖项反映了 NSF 的法定使命，并通过使用评估被认为值得支持。基金会的智力价值以及更广泛的影响审查标准。

项目成果

Towards Accessible Sports Broadcasts for Blind and Low-Vision Viewers

为盲人和弱视观众提供无障碍体育广播

• DOI: 10.1145/3544549.3585610
• 发表时间: 2023-04
• 期刊: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems
• 作者: Jain, Gaurav;Hindi, Basel;Courtien, Connor;Wyrick, Conrad;Xu, Xin Yi;Malcolm, Michael C;Smith, Brian A.
• 通讯作者: Smith, Brian A.

Uncovering Visually Impaired Gamers’ Preferences for Spatial Awareness Tools Within Video Games

揭示视障游戏玩家对视频游戏中空间感知工具的偏好

• DOI: 10.1145/3517428.3544802
• 发表时间: 2022-10
• 期刊: Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility
• 作者: Nair, Vishnu;Ma, Shao;Gonzalez Penuela, Ricardo E.;He, Yicheng;Lin, Karen;Hayes, Mason;Huddleston, Hannah;Donnelly, Matthew;Smith, Brian A.
• 通讯作者: Smith, Brian A.

Towards a Generalized Acoustic Minimap for Visually Impaired Gamers

为视障玩家打造通用声学小地图

• DOI: 10.1145/3474349.3480177
• 发表时间: 2021-10
• 期刊: UIST '21: The Adjunct Publication of the 34th Annual ACM Symposium on User Interface Software and Technology
• 作者: Nair, Vishnu;Ma, Shao;Huddleston, Hannah;Lin, Karen;Hayes, Mason;Donnelly, Matthew;Gonzalez, Ricardo E;He, Yicheng;Smith, Brian A.
• 通讯作者: Smith, Brian A.