CGV: Small: Interactive Sound Rendering for Large-Scale Virtual Environments

CGV：小型：大型虚拟环境的交互式声音渲染

• 批准号: 1840864
• 负责人: Ming Lin
• 金额: $ 22.77万
• 依托单位: University of Maryland, College Park
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-01-01 至 2019-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1840864&HistoricalAwards=false
• 关键词: CGV; Small; Interactive; Sound; Rendering; CGV; Small; Interactive; Sound; Rendering

Auditory experience is an integral part of our daily life. Our perception of sound affects how we interpret and respond to various events around us. Overall, interactive modeling and simulation of sound effects and auditory events can significantly enhance numerous scientific and engineering applications, and also support more intuitive human-computer interaction for desktop and mobile applications. It also offers an alternative means to visualize datasets with complex characteristics (multi-dimensional, abstract, conceptual, spatial-temporal, etc.). Yet despite the fact that hearing is one of our dominant senses, sound rendering has not received as much attention as visual rendering to better serve as an effective communication channel for human-computer systems, and interactive audio rendering still poses major computational challenges. In this project, the PI focuses on rendering of aural effects, with attention to a greater correlation between sound and visual rendering, to communicate information (events, spatial extent, physical setting, emotion, ambience, etc.) to a user in a virtual world and to thereby increase the user's sense of presence and spaciousness while improving his/her ability to locate sound sources. The PI's goal is to make radical advance in interactive sound rendering and application-specific auditory interaction techniques in order to achieve high-fidelity auditory interfaces for large-scale virtual reality. In particular, she will address the computational bottlenecks in example-guided, physics-based sound synthesis, develop new hybrid algorithms for creating realistic acoustic effects in complex, dynamic 3D virtual environments, demonstrate the techniques on acoustic walkthrough for a variety of applications, and evaluate the resulting auditory systems and their impact on target applications. The work will build upon the PI's prior accomplishments to make several major scientific advances that will significantly extend the state of the art in auditory displays and human-centric computing. Project outcomes will include new hybrid acoustic algorithms for realistic sound effects, novel example-guided physics-based sound synthesis, innovative applications of auditory displays, and better understanding of human auditory perception.Broader Impacts: Applications of interactive sound rendering enabled by this project will span a wide variety of domains, include assistive technology for the visually impaired, multimodal human-centric interfaces, immersive teleconferencing, rapid prototyping of acoustic spaces for urban planning, structural design, and noise control. Project outcomes, including scientific advances and software systems, will be disseminated through websites, publications, workshops, community outreach, and other professional contacts. In addition to acoustic simulation, this research will ultimately offer fundamental scientific foundations for solving wave/sound propagation problems in complex domains for seismology, geophysics, meteorology, engineering design, urban planning, etc.

听觉体验是我们日常生活中不可或缺的一部分。 我们对声音的看法会影响我们如何解释和应对周围的各种事件。 总体而言，声音效果和听觉事件的交互式建模和模拟可以显着增强众多科学和工程应用，并支持更直观的人类计算机交互，以供台式机和移动应用程序进行。 它还提供了一种可视化具有复杂特征（多维，抽象，概念，时空等）的数据集的替代方法。 然而，尽管听力是我们的主要感官之一，但声音渲染并没有像视觉渲染那样受到更好的关注，而以更好地充当人类计算机系统的有效通信渠道，而交互式音频渲染仍然带来了重大的计算挑战。 在该项目中，PI着重于对听觉效果的渲染，并关注声音和视觉渲染之间的更大相关性，以向虚拟世界中的用户传达信息（事件，空间范围，身体环境，情感，氛围等），从而提高用户的存在感和宽敞感，同时提高他/她/她/她的能力找到声音的能力。 PI的目标是在交互式声音渲染和特定于应用的听觉交互技术中取得激进的进步，以实现大规模虚拟现实的高保真听觉接口。 特别是，她将在示例引导的，基于物理的声音合成中解决计算瓶颈，开发新的混合算法，以在复杂的，动态的3D虚拟环境中产生现实的声学效果，展示了用于各种应用程序的声学演练的技术，并评估了各种听觉系统及其对目标应用程序的影响。 这项工作将基于PI的先前成就，以实现几项重大的科学进步，这些进步将大大扩展在听觉显示和以人为中心的计算方面的最新状态。 项目成果将包括用于现实声音效果的新型混合声学算法，基于物理学的新颖示例，基于物理学的声音综合，对听觉显示的创新应用以及对人类听觉知觉的更好理解。Boader的影响：该项目的互动声音的应用，该项目启用了该项目的各种辅助技术，包括越来越多的人类，包括互动的人类，包括跨越的互动，跨越了跨越的互动，包括跨性别的Importive Importime Importime Importive Importive Impoirip，contrive Importime Impoirem Impoir dodip，电信，用于城市规划的声学空间的快速原型，结构设计和噪声控制。 包括科学进步和软件系统在内的项目成果将通过网站，出版物，研讨会，社区外展和其他专业联系人进行传播。 除了声学模拟外，这项研究最终还将为解决地震学，地球物理学，气象学，工程设计，城市规划等的复杂领域中解决波浪/声音传播问题提供基本科学基础。