REU Site: Computational Imaging and Mixed-Reality for Visual Media Creation and Visualization

REU 网站：用于视觉媒体创建和可视化的计算成像和混合现实

• 批准号: 1950534
• 负责人: Suren Jayasuriya
• 金额: $ 32.4万
• 依托单位: Arizona State University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-08-01 至 2023-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1950534&HistoricalAwards=false
• 关键词: REU; Site; Computational; Imaging; Mixed

This Research Experiences for Undergraduates (REU) Site award funds a new site focused on the creation of visual computing systems at the School of Arts, Media and Engineering at Arizona State University. The REU Site will recruit eight students each summer for a ten-week long experience in computational imaging and mixed-reality research. From augmented and virtual reality to computational photography and the Internet of Things, applications built on real-time, high-quality visual sensing are becoming central to everyday computing. All of these applications exhibit two competing demands: complex, domain-specific sensing capabilities on one hand and systems considerations such as energy efficiency, data bandwidth, and latency on the other. This REU site aims to enable students to conduct research on the design of new visual computing systems for these applications to solve these challenges. Further, students will be exposed to the emerging area of media arts and sciences to understand how the systems they build can be utilized for visual media creation. Students will have the opportunity to present their work in both scientific publications and conferences as well as novel dissemination through public exhibition, outreach to the local community, and engagement with a wider audience interested in visual media. Undergraduate students will be recruited from a broad range of fields including computer science, electrical engineering, and digital media arts and sciences. Recruitment efforts will focus on students from state universities, minority-serving institutions, and community colleges, particularly from under-served populations who are interested in visual media technologies. This will enable new, diverse audiences to be exposed to visual computing research and its applications in society. The primary objective of this REU site is to train undergraduate researchers in the areas of computational imaging and photography, virtual/augmented/mixed reality, and visualization technologies. These students will work on projects that addresses research questions such as: (a) How can the physics of light and sound transport be incorporated/exploited into acquisition systems effectively? (b) What are the signal processing constraints for sampling high-dimensional visual data effectively? (c) How can we characterize the energy, performance, and scalability of efficient system architectures and algorithms for the sensing, distribution, and playback of high-quality immersive spatial data? As part of these projects, hardware and software co-design will be emphasized to realize mobile and embedded systems which are energy-efficient and extend the visual capabilities of sensing and processing. The second objective is to have students' engagement with the general public through applications demonstrating their research projects. This is primarily accomplished through tools from the media arts and sciences that emphasize real-time demonstrations, public exhibition, digital media content creation, and on-going dialogue about the science and engineering behind these systems. These combined objectives will train undergraduate researchers to build exciting, novel visual computing systems that have wide application to relevant sensor, visualization, gaming, and entertainment industries that utilize this technology.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

这项针对本科生（REU）网站奖的研究经验为一个新的网站提供了一个专注于亚利桑那州立大学艺术，媒体和工程学院创建视觉计算系统的新网站。 REU网站每年夏天将招募八名学生，以在计算成像和混合现实研究方面长期经验。从增强和虚拟现实到计算摄影和物联网，建立在实时的应用程序，高质量的视觉传感已成为日常计算的核心。所有这些应用都表现出两个竞争要求：一方面复杂的，特定于域的传感功能以及系统注意事项，例如能源效率，数据带宽和延迟。此REU网站旨在使学生能够为这些应用程序设计新的视觉计算系统设计，以解决这些挑战。此外，学生将接触到媒体艺术和科学的新兴领域，以了解如何将其构建的系统用于视觉媒体创建。学生将有机会在科学出版物和会议上介绍他们的作品，以及通过公开展览，向当地社区推广，并与对视觉媒体感兴趣的更广泛的受众互动。本科生将在包括计算机科学，电气工程以及数字媒体艺术和科学在内的各种领域招募。招聘工作将集中在州立大学，少数派服务机构和社区学院的学生上，特别是来自对视觉媒体技术感兴趣的人口不足的人群。这将使新的，不同的受众能够接触到视觉计算研究及其在社会中的应用。该REU站点的主要目的是在计算成像和摄影，虚拟/增强/混合现实以及可视化技术方面培训本科研究人员。这些学生将在诸如：（a）如何将光线和声音运输物理学的物理学有效地纳入收购系统中，从而解决研究问题的项目？ （b）有效采样高维视觉数据的信号处理限制是什么？ （c）我们如何表征高质量沉浸式空间数据的感应，分布和播放的有效系统体系结构和算法的能量，性能和可扩展性？作为这些项目的一部分，将强调硬件和软件共同设计，以实现节能的移动和嵌入式系统，并扩展感应和处理的视觉功能。第二个目标是通过展示其研究项目的应用程序与学生与公众的交往。这主要是通过媒体艺术和科学的工具来实现的，这些工具强调实时演示，公共展览，数字媒体内容创建以及有关这些系统背后的科学和工程的持续对话。这些结合的目标将培训本科研究人员，建立令人兴奋的新型视觉计算系统，这些系统广泛应用于使用这项技术的相关传感器，可视化，游戏和娱乐行业。该奖项反映了NSF的法定任务，并被认为是值得通过基金会的智力和更广泛影响的评估来通过评估来支持的，这是值得的。