User Interaction with self-supporting free-form physical objects

用户与自支撑自由形式物理对象的交互

• 批准号: EP/N014197/1
• 负责人: Sriram Subramanian
• 金额: $ 130.41万
• 依托单位: University of Sussex
• 依托单位国家: 英国
• 项目类别: Research Grant
• 财政年份: 2016
• 资助国家: 英国
• 起止时间: 2016 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=EP%2FN014197%2F1
• 关键词: User; Interaction; self; supporting; free

The primary goal of this project is enhance human-computer interaction by dynamically creating and manipulating physical shapes by levitating and moving a large collections of lightweight 3D objects using principles of acoustic levitation. The proposed idea is illustrated in Figure 1 where one ultrasound transducers is placed as a floor mat and a large collection of polystyrene beads create the shape of a dog that can wag its tail. This will enable us to represent complex datasets in a physical form and allow users to dynamically manipulate it. We are now moving away from traditional human-computer interaction techniques like buttons, keyboards and mice to touch (e.g., Smartphones and multi-touch gestures) and touchless interactions (as with the Kinect and Leap Motion controllers). The limiting factor in these new forms of interactions is, ironically, the lack of any physicality and lack of any co-located feedback. One has no controller or interface element to physically touch and interact with and the visual feedback that may be available is disconnected from the location of the gesture.In our vision, the computer will control the existence, form, and appearance of complex levitating objects composed of "levitating atoms". Users can reach into the levitating matter, feel it, manipulate it, and hear how they deform it with all feedback originating from the levitating object's position in mid-air, as it would with objects in real life. This will change how people use technology as they can interact with technology in the same way they would with real objects in their natural environment.We see many possible benefits of physicalisations for the individual and society: they make data more accessible by leveraging our perceptual exploration skills via active perception, depth perception, non-visual senses, and intermodal perception; give novel exploration possibilities to the visually impaired; support learning via cognitive benefits of direct manipulation of physical artefacts; bring data to the real world for communication and exhibition and; and finally act as tools for engaging audiences with information.

该项目的主要目标是通过使用声音悬浮原理悬浮和移动大量轻量级3D对象来动态创建和操纵物理形状，从而增强人类计算机的交互作用。提出的想法如图1所示，其中一个超声传感器被放置为地板垫子，大量聚苯乙烯珠会产生可以摇动尾巴的狗的形状。这将使我们能够以物理形式表示复杂的数据集，并允许用户动态操纵它。现在，我们正在脱离传统的人类计算机交互技术，例如按钮，键盘和鼠标（例如，智能手机和多点触摸手势）和无触摸交互（与Kinect和Leap Motion Controller一样）。具有讽刺意味的是，这些新形式的互动形式的限制因素是缺乏任何物理性和缺乏共同确定的反馈。一个人没有控制器或接口元素可以物理接触和与之交互，并且可能可用的视觉反馈与手势的位置断开。在我们的视觉上，计算机将控制由“悬浮原子”组成的复杂悬浮物体的存在，形式和外观。用户可以探讨悬浮物，感觉，操纵它，并听到他们如何通过所有反馈来构造它，这些反馈源自悬浮对象在空中的位置，就像现实生活中的对象一样。这将改变人们如何以技术与技术互动的方式与自然环境中的真实物体进行相同的方式进行改变。我们看到个人和社会的物理化的许多可能的好处：他们通过通过积极的感知，深度感知，非视觉感官和间断感知来利用我们的感知探索技能来使数据更加访问；为视障人士赋予新颖的探索可能性；通过直接操纵物理伪像的认知益处来支持学习；将数据带到现实世界中进行沟通和展览以及；最终充当吸引观众使用信息的工具。

项目成果

Project Telepathy

心灵感应计划

• DOI: 10.1145/3027063.3053129
• 发表时间: 2017
• 作者: Bourland A

Enhancing dynamic positioning performance inside mid-air acoustic levitator

增强空中声悬浮器内的动态定位性能

• DOI: 10.1121/1.5101293
• 发表时间: 2019
• 期刊: The Journal of the Acoustical Society of America
• 作者: Fushimi T

Nonlinear trapping stiffness of mid-air single-axis acoustic levitators

• DOI: 10.1063/1.5034116
• 发表时间: 2018-07-16
• 期刊: APPLIED PHYSICS LETTERS
• 影响因子: 4
• 作者: Fushimi, T.;Hil, T. L.;Drinkwater, B. W.
• 通讯作者: Drinkwater, B. W.

Acoustic levitation for multimodal volumetric display

• DOI: 10.1117/12.2569328
• 发表时间: 2020-08
• 作者: R. Hirayama;D. M. Plasencia;N. Masuda;S. Subramanian

A volumetric display for visual, tactile and audio presentation using acoustic trapping

• DOI: 10.1038/s41586-019-1739-5
• 发表时间: 2019-11-14
• 期刊: NATURE
• 影响因子: 64.8
• 作者: Hirayama, Ryuji;Plasencia, Diego Martinez;Subramanian, Sriram
• 通讯作者: Subramanian, Sriram