REU Site: Collaborative: Making Augmented and Virtual Reality Accessible

REU 网站：协作：让增强现实和虚拟现实变得触手可及

• 批准号: 2051053
• 负责人: Steven Feiner
• 金额: $ 17.24万
• 依托单位: Columbia University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-05-15 至 2024-04-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2051053&HistoricalAwards=false
• 关键词: REU; Site; Collaborative; Making; Augmented

Augmented and virtual reality (XR) technologies are becoming popular consumer products. However, at present XR devices, development tools, and content pose major accessibility challenges for people with disabilities. How can you describe a 3D virtual environment to a person with a visual impairment? How should you present captions in 3D to a person who is hard-of-hearing? How can a person with a motor control disability navigate a 3D world? This REU Site brings together Profs. Shiri Azenkot and Brian Smith, experts in accessibility, along with Prof. Steven Feiner, an augmented reality and 3D interaction pioneer. The site will train students to be future leaders in XR accessibility. Students will receive training in accessibility and XR, engage in the research process from ideation to presentations, and join a community of scholars and practitioners who will provide career advice and mentorship. In addition, the projects undertaken by REU students will form the basis for new collaborations among the investigators and other collaborators at Columbia and Cornell. The site will recruit students from underrepresented backgrounds, especially students with disabilities. The target is to have a mixed-ability cohort where half the students have a disability and half do not. Students will participate in a range of formal and informal learning, including an XR development "bootcamp," conversations with XR experts across academia and industry, and presentations on their work progress. Students will work on projects at the intersection of accessibility and XR. Examples of possible projects include designing descriptions that provide overviews of virtual environments for people who are blind and designing effective navigation techniques in a virtual environment, also for people who are blind. The broader impacts of this proposal are two-fold. First, it supports the NSF’s mission of broadening participation by focusing recruitment efforts on students from underrepresented groups, especially students with disabilities. Second, the focus of the research will benefit people with disabilities around the world. As XR becomes an increasingly popular consumer platform, the REU research will help ensure that it provides an equal user experience to people regardless of their disability status.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

增强和虚拟现实（XR）技术正在成为流行的消费产品。但是，目前，XR设备，开发工具和内容对残疾人构成了重大可访问性挑战。您如何为有视觉障碍的人描述3D虚拟环境？您应该如何将3D字幕呈现给听力障碍的人？有运动控制障碍的人如何导航3D世界？此REU网站汇集了教授。 Shiri Azenkot和Brian Smith，可访问性的专家，以及Steven Feiner教授，这是一个增强现实和3D互动先驱。该网站将培训学生成为XR可访问性的未来领导者。学生将接受有关可访问性和XR的培训，从事从构想到演讲的研究过程，并加入一个学者和从业者社区，他们将提供职业建议和心态。此外，REU学生开展的项目将构成哥伦比亚和康奈尔大学调查人员和其他合作者之间新合作的基础。该网站将招募来自代表性不足的背景的学生，尤其是残疾学生。目标是具有一半学生患有残疾而一半的混合能力队列。学生将参加一系列正式和非正式的学习，包括XR开发“ Bootcamp”，与学术界和行业的XR专家进行对话，以及有关其工作进展的演讲。学生将在可访问性和XR的交汇处进行项目。可能的项目的示例包括设计描述，这些描述为盲目的人提供虚拟环境的概述，并在虚拟环境中设计有效的导航技术，也适用于盲人。该提案的更广泛影响是两个方面。首先，它支持NSF的使命，即通过将招聘工作集中在代表性不足的群体（尤其是残疾学生）的学生上，以扩大参与。其次，研究的重点将使世界各地的残疾人受益。随着XR成为一个越来越受欢迎的消费者平台，REU研究将有助于确保它为人们提供平等的用户体验，无论其残疾状况如何。该奖项反映了NSF的法定任务，并通过使用基金会的知识分子优点和更广泛的影响评估标准来评估值得支持。

项目成果

Towards Accessible Sports Broadcasts for Blind and Low-Vision Viewers

为盲人和弱视观众提供无障碍体育广播

• DOI: 10.1145/3544549.3585610
• 发表时间: 2023
• 期刊: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems
• 作者: Jain, Gaurav;Hindi, Basel;Courtien, Connor;Wyrick, Conrad;Xu, Xin Yi;Malcolm, Michael C;Smith, Brian A.
• 通讯作者: Smith, Brian A.

Towards a Generalized Acoustic Minimap for Visually Impaired Gamers

为视障玩家打造通用声学小地图

• DOI: 10.1145/3474349.3480177
• 发表时间: 2021
• 期刊: UIST '21: The Adjunct Publication of the 34th Annual ACM Symposium on User Interface Software and Technology
• 作者: Nair, Vishnu;Ma, Shao-en;Huddleston, Hannah;Lin, Karen;Hayes, Mason;Donnelly, Matthew;Gonzalez, Ricardo E;He, Yicheng;Smith, Brian A.
• 通讯作者: Smith, Brian A.

Uncovering Visually Impaired Gamers’ Preferences for Spatial Awareness Tools Within Video Games

揭示视障游戏玩家对视频游戏中空间感知工具的偏好

• DOI: 10.1145/3517428.3544802
• 发表时间: 2022
• 期刊: Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility
• 作者: Nair, Vishnu;Ma, Shao-en;Gonzalez Penuela, Ricardo E.;He, Yicheng;Lin, Karen;Hayes, Mason;Huddleston, Hannah;Donnelly, Matthew;Smith, Brian A.
• 通讯作者: Smith, Brian A.