Collaborative Research: HCC: Medium: "Unboxing" Haptic Texture Perception: Closing the Loop from Skin Contact Mechanics to Novel Haptic Device

合作研究：HCC：媒介：“拆箱”触觉纹理感知：闭合从皮肤接触力学到新型触觉设备的循环

• 批准号: 2312153
• 负责人: Melisa Orta Martinez
• 金额: $ 55.76万
• 依托单位: Carnegie-Mellon University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-10-01 至 2026-09-30
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2312153&HistoricalAwards=false
• 关键词: Collaborative; Research; HCC; Medium; Unboxing

Modern virtual-reality devices attempt to create a realistic sense of touch in the absence of physical surfaces and objects, but as of yet they fall short. Indeed, no existing interfaces for the sense of touch, known as “haptic interfaces," are capable of replicating one of the most fundamental aspects of touch: how a textured surface feels during direct skin contact. Interfaces that simulate contact through a tool eliminate features that are available only from skin contact, but the interfaces that do allow direct skin contact are currently insufficient to convey material and fine-grained structural details of surfaces. Put simply, they do not feel realistic. This project promotes the progress of science and technology by providing a new approach to the design of haptic devices aimed at producing highly realistic virtual textures, and it will take a step towards understanding touch perception that addresses a previously unstudied component: the detailed physical interaction between the skin and the surface it contacts. The development of our proposed haptic technology and further understanding of our sense of touch can benefit applications in human-machine interaction, such as creating more immersive virtual environments and improving the control of remote robots. There are also multiple applications in education and virtual-reality development, especially for blind and visually impaired people, that would benefit from advanced understanding of touch perception and better tools for creating virtual experiences. In addition, as we know from past technological developments in the basic science of perception, such as the study of hearing that led to cutting-edge audio interfaces, it is likely that we underestimate the technological advancements that will result from a better understanding of this powerful sense modality.This project will develop novel haptic technologies based on three complementary objectives: (1) Formulate models of the contact mechanics of human skin using direct imaging by “Optical Coherence Tomography” of the fingerpad sliding over a texture, coupled with Boundary Element and Finite Element Methods that can be used to characterize and model responses within the skin layers during interactions with texture. (2) Fabricate haptic devices that instantiate the model mechanisms and parameters, so as to recreate skin-texture interactions. These devices will include a pin array capable of spatially distributed, high-bandwidth control of normal and lateral excitation, as well as an electromagnetic haptic device that uses elastomers embedded with ferromagnetic particles to transmit perpendicular and shear forces to the user in response to controllable magnetic fields. (3) Validate and extend the models by means of human-user studies with both physical textures and the haptic devices of Objective 2, using psychophysical experimental techniques and broader haptic interface studies. This objective will test whether model-based actuation is sufficient to create rich haptic perceptual experience. Success will establish principles for realistic texture rendering in next generation haptic devices.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

现代虚拟现实设备试图在没有物理表面和物体的情况下创建真实的触觉，但迄今为止，它们确实还不够，现有的触觉界面（称为“触觉界面”）无法实现。复制触摸最基本的方面之一：直接皮肤接触时纹理表面的感觉如何通过工具模拟接触的界面消除了只能通过皮肤接触获得的功能，但允许直接皮肤接触的界面目前还不够。输送物料和细粒度简而言之，他们感觉不真实，该项目通过提供一种旨在产生高度逼真的虚拟纹理的触觉设备设计新方法来促进科学和技术的进步，并且它将朝着理解迈出一步。触摸感知解决了以前未研究过的问题：皮肤与其接触的表面之间的详细物理交互。我们提出的触觉技术的发展以及对触觉的进一步理解可以有利于人机交互中的应用，例如创造更多。沉浸式虚拟环境和改进远程机器人的控制在教育和虚拟现实开发中也有多种应用，特别是对于盲人和视障人士来说，这将受益于对触摸感知的深入理解和更好的创建虚拟体验的工具。从过去感知基础科学的技术发展来看，例如对听觉的研究导致了尖端音频接口的出现，我们很可能低估了更好地理解这种强大的感觉模式所带来的技术进步。这个项目将基于三个互补目标开发新颖的触觉技术： (1) 使用指垫在纹理上滑动的“光学相干断层扫描”直接成像，结合可用于表征和模拟皮肤层内响应的边界元和有限元方法，制定人体皮肤的接触力学模型(2) 制造实例化模型机制和参数的触觉设备，以便重新创建皮肤纹理交互。这些设备将包括能够对正常进行空间分布、高带宽控制的引脚阵列。 (3) 通过横向激励的人类用户研究以及使用嵌入铁磁颗粒的弹性体来响应可控磁场向用户传递垂直力和剪切力的电磁触觉设备来验证和扩展模型。使用心理物理实验技术和更广泛的触觉界面研究来测试目标 2 的物理纹理和触觉设备，该目标将测试基于模型的驱动是否足以创造丰富的内容。触觉感知体验的成功将为下一代触觉设备中的真实纹理渲染建立原则。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。