Swarm Social Sound Modulators

Swarm 社交声音调制器

• 批准号: EP/V037846/1
• 负责人: Sriram Subramanian
• 金额: $ 116.79万
• 依托单位: University College London
• 依托单位国家: 英国
• 项目类别: Research Grant
• 财政年份: 2021
• 资助国家: 英国
• 起止时间: 2021 至 无数据
• 项目状态: 未结题
• 来源: https://gtr.ukri.org/projects?ref=EP%2FV037846%2F1
• 关键词: Swarm; Social; Sound; Modulators

The UK is a world-leader in creating interactive applications that are enabled by computational manipulation of acoustic wave fronts. Three examples of such applications include mid-air haptics, directional audio, and volumetric 3D particle displays. Using a phased array of ultrasonic speakers that are precisely and individually controlled, we can create high pressure focal points in mid-air. Modulating these focal points in various ways, it is possible to 1) create rich tactile sensations when touched by the bare hands, 2) steer directional sounds that propagate over long distances un-attenuated, 3) levitate small particles that when rapidly moved in space emulate volumetric 3D shapes due to a phenomenon called persistence of vision.The exploitation of these amazing new technologies is uniquely available to Ultraleap (a UK based company) and Sussex University who have a long and productive history of collaboration. For example, Ultraleap is currently combining hand-tracking and ultrasonic mid-air haptic feedback solutions for applications ranging from VR training simulators, automotive interfaces, gaming machines, and next generation digital signage kiosks. Similarly, Sussex University is creating multimodal 3D displays based on rapidly updating ultrasonic phased arrays to create persistence of vision when moving acoustically levitated objects. A significant constraint to the wide-scale deployment of the underlying technology of phased arrays is the cost and complexity of a non-modular system because it limits applicability. For example, there is no one size fits all phased array with most integrated solutions needing to be custom developed.In this project, we will circumvent such problems altogether by creating simple and low cost modular spatial sound modulator (SSM) units i.e. smaller arrays of acoustic sources, to be placed around the interactive space, that can collectively out-perform the single large monolithic solution we currently have. Moreover, we will take a leap forward in sound-field control by removing scalability and reusability issues thus opening up the exploitation of phased array technologies into other applications domains that can benefit from the non-contact delivery of haptic feedback, steerable directional sound, and/or volumetric 3D particle displays. Specifically, we will draw on the well-developed literature of multi-agent game theory and distributed computing and use them to build a decentralised swarm architecture that can flexibly accommodate numerous SSM units. Each SSM will emit and modulate the sound-field nearby it while sharing a common awareness of the contextual details with its swarm host, while the desired collective behaviour will emerge from the interactions between multiple SSMs and their interactions with the environment.There are several anticipated benefits to our proposed approach. Firstly, by designing simple, independent SSMs we are able to address multiple commercial applications using the same primitive unit, while simultaneously streamlining the manufacturing pipeline. These modular units can be used individually or combined in a myriad of ways to create new applications. Secondly, by enabling a distributed control architecture, swarm SSMs can seamlessly and progressively scale up. By incrementally combining larger numbers of modular units, customers can initially use a small number of SSM units, and dynamically grow the capabilities of their interactive multimodal system by adding new devices according to the application needs. Finally, by using game theory we will enable SSMs to dynamically cooperate with each other as to meet application objectives independent of the application logic and the arrangement of our modular devices thus simplifying the development and design process and enabling creative designers to focus on the delivery of evermore immersive and multimodal experiences.

英国是世界领导者，可以通过计算声波阵线的计算操纵来创建交互式应用程序。此类应用的三个示例包括空中触觉，定向音频和体积3D粒子显示。使用精确且单独控制的超声波扬声器的相分阵列，我们可以在空中创建高压焦点。以各种方式调节这些焦点，可能是1）在裸手触摸时产生丰富的触觉感觉，2）转向方向的声音，在长期远距离散发出较长距离的情况下，3）在空间中迅速移动时悬浮的小颗粒，这些颗粒在太空中迅速移动时，由于这些现象的持续存在，因此依赖于这些技术的持续性。和苏塞克斯大学的合作历史悠久而富有成效。例如，Ultraleap目前正在将手工跟踪和超声波中空触觉解决方案结合起来，用于应用程序，从VR培训模拟器，汽车接口，游戏机和下一代数字标牌亭。同样，苏塞克斯大学正在基于快速更新超声阶段阵列的快速更新，以创建多模式3D显示屏，以在移动声音悬浮的对象时创造视力的持久性。对分阶段阵列的基础技术的广泛部署的重大限制是非模块化系统的成本和复杂性，因为它限制了适用性。例如，没有一个尺寸适合所有分阶段的阵列，其中大多数集成的解决方案需要自定义。在这个项目中，我们将通过创建简单和低成本的模块化模块化空间调制器（SSM）单元，即较小的声学源，可以将互动空间放置在围绕互动空间的较小的杂音，从而可以集体地将单个单元素放置在当前的大小元素上，我们可以将其放置在互动空间中。此外，我们将通过消除可伸缩性和可重复性问题来向前迈进。具体来说，我们将借鉴多代理游戏理论的发达文献，并分发计算，并使用它们来构建一个可以灵活地容纳众多SSM单元的分散的群体体系结构。每个SSM都会散发和调节附近的声场，同时与群体寄主共享对上下文细节的共同认识，而所需的集体行为将从多个SSM与它们与环境的相互作用之间的相互作用中出现。这对我们提出的方法有一些预期的好处。首先，通过设计简单独立的SSM，我们可以使用相同的原始单元来解决多个商业应用程序，同时简化制造管道。这些模块化单元可以单独使用或以多种创建新应用程序的方式组合。其次，通过启用分布式控制体系结构，SWARM SSM可以无缝，逐步扩展。通过逐步组合大量的模块化单元，客户最初可以使用少量的SSM单元，并根据应用需求添加新设备，动态增长其交互式多模式系统的功能。最后，通过使用游戏理论，我们将使SSM能够相互动态合作，以实现独立于应用程序逻辑和模块化设备的布置的应用程序目标，从而简化了开发和设计过程，并使创意设计师能够专注于Evermore Immersime Immersive和多模式体验。

项目成果

Actively Reconfigurable Segmented Spatial Sound Modulators

主动可重构分段空间声音调制器

• DOI: 10.1002/admt.202301459
• 发表时间: 2023
• 期刊: Advanced Materials Technologies
• 影响因子: 6.8
• 作者: Hardwick J

OpenMPD: A Low-Level Presentation Engine for Multimodal Particle-Based Displays

OpenMPD：用于基于粒子的多模式显示的低级呈现引擎

• DOI: 10.1145/3572896
• 发表时间: 2023
• 期刊: ACM Transactions on Graphics
• 影响因子: 6.2
• 作者: Montano-Murillo R

DataLev: Mid-air Data Physicalisation Using Acoustic Levitation

DataLev：使用声学悬浮进行空中数据物理化

• DOI: 10.1145/3544548.3581016
• 发表时间: 2023
• 作者: Gao L