REU Site: Computational Imaging and Mixed-Reality for Visual Media Creation and Visualization

REU 网站：用于视觉媒体创建和可视化的计算成像和混合现实

• 批准号: 1950534
• 负责人: Suren Jayasuriya
• 金额: $ 32.4万
• 依托单位: Arizona State University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-08-01 至 2023-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1950534&HistoricalAwards=false
• 关键词: REU; Site; Computational; Imaging; Mixed

This Research Experiences for Undergraduates (REU) Site award funds a new site focused on the creation of visual computing systems at the School of Arts, Media and Engineering at Arizona State University. The REU Site will recruit eight students each summer for a ten-week long experience in computational imaging and mixed-reality research. From augmented and virtual reality to computational photography and the Internet of Things, applications built on real-time, high-quality visual sensing are becoming central to everyday computing. All of these applications exhibit two competing demands: complex, domain-specific sensing capabilities on one hand and systems considerations such as energy efficiency, data bandwidth, and latency on the other. This REU site aims to enable students to conduct research on the design of new visual computing systems for these applications to solve these challenges. Further, students will be exposed to the emerging area of media arts and sciences to understand how the systems they build can be utilized for visual media creation. Students will have the opportunity to present their work in both scientific publications and conferences as well as novel dissemination through public exhibition, outreach to the local community, and engagement with a wider audience interested in visual media. Undergraduate students will be recruited from a broad range of fields including computer science, electrical engineering, and digital media arts and sciences. Recruitment efforts will focus on students from state universities, minority-serving institutions, and community colleges, particularly from under-served populations who are interested in visual media technologies. This will enable new, diverse audiences to be exposed to visual computing research and its applications in society. The primary objective of this REU site is to train undergraduate researchers in the areas of computational imaging and photography, virtual/augmented/mixed reality, and visualization technologies. These students will work on projects that addresses research questions such as: (a) How can the physics of light and sound transport be incorporated/exploited into acquisition systems effectively? (b) What are the signal processing constraints for sampling high-dimensional visual data effectively? (c) How can we characterize the energy, performance, and scalability of efficient system architectures and algorithms for the sensing, distribution, and playback of high-quality immersive spatial data? As part of these projects, hardware and software co-design will be emphasized to realize mobile and embedded systems which are energy-efficient and extend the visual capabilities of sensing and processing. The second objective is to have students' engagement with the general public through applications demonstrating their research projects. This is primarily accomplished through tools from the media arts and sciences that emphasize real-time demonstrations, public exhibition, digital media content creation, and on-going dialogue about the science and engineering behind these systems. These combined objectives will train undergraduate researchers to build exciting, novel visual computing systems that have wide application to relevant sensor, visualization, gaming, and entertainment industries that utilize this technology.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该本科生研究体验 (REU) 网站奖资助了亚利桑那州立大学艺术、媒体和工程学院的一个新网站，该网站专注于创建视觉计算系统。 REU 站点每年夏天将招收 8 名学生，进行为期十周的计算成像和混合现实研究体验。从增强现实和虚拟现实到计算摄影和物联网，基于实时、高质量视觉传感的应用程序正在成为日常计算的核心。所有这些应用都表现出两种相互竞争的需求：一方面是复杂的、特定领域的传感功能，另一方面是能源效率、数据带宽和延迟等系统考虑因素。该 REU 网站旨在让学生能够针对这些应用程序进行新视觉计算系统的设计研究，以解决这些挑战。此外，学生将接触媒体艺术和科学的新兴领域，以了解如何将他们构建的系统用于视觉媒体创作。学生将有机会在科学出版物和会议上展示他们的作品，并通过公共展览、当地社区的推广以及与对视觉媒体感兴趣的更广泛受众的接触来传播新颖的作品。本科生将来自广泛的领域，包括计算机科学、电气工程、数字媒体艺术和科学。招聘工作将集中于来自州立大学、少数族裔服务机构和社区学院的学生，特别是对视觉媒体技术感兴趣的服务不足人群的学生。这将使新的、多样化的受众能够接触到视觉计算研究及其在社会中的应用。该 REU 网站的主要目标是培训计算成像和摄影、虚拟/增强/混合现实和可视化技术领域的本科研究人员。这些学生将从事解决研究问题的项目，例如：（a）如何将光和声音传输的物理学有效地纳入/利用到采集系统中？ (b) 有效采样高维视觉数据的信号处理限制是什么？ (c) 我们如何表征用于感知、分发和回放高质量沉浸式空间数据的高效系统架构和算法的能量、性能和可扩展性？作为这些项目的一部分，将强调硬件和软件协同设计，以实现节能的移动和嵌入式系统，并扩展传感和处理的视觉功能。第二个目标是让学生通过展示其研究项目的应用程序与公众互动。这主要是通过媒体艺术和科学的工具来实现的，这些工具强调实时演示、公共展览、数字媒体内容创建以及有关这些系统背后的科学和工程的持续对话。这些综合目标将培训本科生研究人员构建令人兴奋的新颖视觉计算系统，这些系统可广泛应用于利用该技术的相关传感器、可视化、游戏和娱乐行业。该奖项反映了 NSF 的法定使命，并通过评估被认为值得支持利用基金会的智力优势和更广泛的影响审查标准。