CHS: Large: Collaborative Research: TextureShop: Tools for the Composition and Display of Virtual Texture

CHS：大型：协作研究：TextureShop：虚拟纹理的合成和显示工具

• 批准号: 1518602
• 负责人: James Colgate
• 金额: $ 117.47万
• 依托单位: Northwestern University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-07-01 至 2021-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1518602&HistoricalAwards=false
• 关键词: CHS; Large; Collaborative; Research; TextureShop

When we interact with the physical world touch is a vitally important sensory channel, but when we interact with the digital world that is not yet the case. Historically, this situation may have been principally due to inadequate tactile displays, but that limitation is quickly disappearing. Increasingly, the principal limitation is the lack of tactile content. The goal of this collaborative research that involves scientists at three institutions is to empower the content creator, by enabling people to perform the same sorts of operations with tactile textures that they routinely perform with photographs. Those operations include "capturing" a texture, building a mathematical representation of it, creating and displaying synthetic versions that feel very much like the original, enhancing it in various ways (e.g., making it rougher or more velvety), and ultimately "composing" novel textures that nonetheless feel realistic and credible. As a tangible step in this direction, an open source, open hardware project begun under prior NSF support will be continued and expanded. That project resulted in the distribution of surface haptic devices to about a dozen different labs, leading to a variety of research studies. In this project, a low-cost surface haptic display and a variety of applications and software tools will be distributed to about 50 early adopters in the research community. Those individuals will be engaged in this research (e.g., by helping to "tag" various textures), and will be empowered to carry out their own research. In addition, workshops will be organized at major human-computer interaction conferences to support the growing surface haptics community.This work is timely and compelling for a number of reasons. One, scientific understanding of the physical and neuronal bases of texture perception has advanced considerably in recent years. For instance, the relationships between vibrations on the skin (produced when a finger slides across a surface), spike timing in afferent neurons, and high-level percepts such as recognition of a specific texture, have recently been elucidated. Two, "surface haptic" technologies for displaying texture to the bare fingertips have also advanced significantly and can now display complex stimuli across the full bandwidth of tactile acuity. Three, the prevalence of touch screen interfaces has created a plethora of applications such as children's e-books, interfaces for the blind, games, and automobile control panels, which would be well-served by high quality tactile content. The merit of this research is that it will provide a principled foundation for both the creation and manipulation of that content. Contributions will include: the development of a "tactile camera" that is able to capture the relevant frictional and vibratory data from which realistic textures can be recreated; a novel mathematical representation of the salient aspects of texture as well as algorithms for synthesizing artificial textures on the basis of that representation; a suite of techniques for enhancing aspects of texture by direct operation on the mathematical representation, interpolation between multiple textures, and interaction with audio cues; and finally a set of tools for composing novel textures including search, texture combination and scale transformation.

当我们与物理世界互动时，是一个至关重要的感官渠道，但是当我们与数字世界互动时，情况尚未如此。 从历史上看，这种情况可能主要是由于触觉显示不足，但这种限制很快消失了。 越来越多的主要限制是缺乏触觉含量。 这项涉及三个机构科学家的合作研究的目的是通过使人们能够通过触觉纹理进行相同的操作来增强内容创建者的能力，这些操作与照片相同。 这些操作包括“捕获”纹理，构建其数学表示，创建和显示非常像原始的合成版本，以各种方式增强它（例如，使其变得更粗糙或更柔软），并最终“构成”新颖的纹理，这些新颖的纹理使人感到不可真实和可信。 作为朝这个方向迈出的切实步骤，将继续并扩大开放源代码，开放的硬件项目开始并扩展。 该项目导致表面触觉设备的分布到大约十几个不同的实验室，从而导致各种研究。 在这个项目中，低成本的表面触觉显示以及各种应用程序和软件工具将分配给研究社区中约50个早期采用者。 这些人将参与这项研究（例如，通过帮助“标记”各种纹理），并有权进行自己的研究。 此外，将在主要的人力计算机会议上组织研讨会，以支持不断增长的表面触觉社区。由于多种原因，这项工作是及时而引人注目的。 第一，近年来，对纹理感知的身体和神经元基础的科学理解已经大大提高。 例如，最近已经阐明了皮肤上的振动（手指滑动在表面上滑动时产生的），传入神经元中的尖峰时序以及诸如识别特定纹理的高级知觉的峰值。 第二，用于裸露指尖的纹理的“表面触觉”技术也已经大大提高，现在可以在触觉敏锐度的完整带宽上表现出复杂的刺激。 第三，触摸屏接口的流行率创建了许多应用程序，例如儿童电子书，盲人，游戏和汽车控制面板的界面，这将由高质量的触觉内容提供良好的服务。 这项研究的优点是，它将为该内容的创建和操纵提供原则上的基础。 贡献将包括：开发“触觉摄像机”，能够捕获可以从中重新创建现实纹理的相关摩擦和振动数据；纹理显着方面的一种新颖的数学表示以及根据该表示形式合成人造纹理的算法；通过直接操作数学表示，多种纹理之间的插值以及与音频提示的相互作用来增强纹理方面的一组技术；最后，一组用于构成新纹理的工具，包括搜索，纹理组合和比例转换。