Visuo-haptic object processing, memory representations and multisensory integration

视觉触觉对象处理、记忆表​​征和多感官整合

• 批准号: RGPIN-2020-05049
• 负责人: Desmarais, Genevieve
• 金额: $ 2.04万
• 依托单位: Mount Allison University
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2022
• 资助国家: 加拿大
• 起止时间: 2022-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=763994
• 关键词: Visuo; haptic; object; processing; memory

How does your mind connect the sensation of an object in your hand with the sight of the same object? Why do you experience a single object and not two? If you hold a key, the key you feel in your hand and the one you see are perceived as a single object. We do this seamlessly, without having to think about it, and we are able to recognize the key when we see it and when we touch it. Yet, much of the research done on how we recognize objects has focused mostly recognizing objects by sight, and not by touch. Also, recent research that has looked at integrating the senses has done so using complex objects for which it is difficult to understand how objects differ or the kind of information people use when recognizing the object. My research program uses novel objects that vary on fixed dimensions - we can therefore tell how the objects differ, and what information people use when recognizing them. I plan to use these novel objects to study three important questions about the information we keep in memory about objects and how we recognize objects when we see or touch them. The first question is: what kind of information do we store in memory? Is it a visual image of the object or a verbal description of the object? To answer that question, I will ask people to learn to recognize new objects, but I will also interfere with their learning by presenting additional information. The key here is that if the information I present is similar to the information people are using to create object memories, then it will be more difficult to create these memories. The second question is: how do we use our sense of vision and touch when we create these memories? Is one sense more important than the other? To answer that question, I will ask people to learn to recognize objects by looking at them, by touching them, or by looking and touching objects at the same time. If one sense is more important than the other senses for creating memories, people will be better at completing the experiment when using that sense. Finally, the third question is: is vision more important than touch when identifying objects? To answer this question, I will ask people to identify objects by sight or by touch, but present another object to the other sense at the same time - people are supposed to ignore that second object. If the `second sense' is important, people will not be able to ignore that second object, and they may be slower and less accurate when identifying objects. My research has important implications and applications. It will help us learn the kind of information that memories contain, and how we create and access these memories. This information will also be helpful when we design technology like cell phones that incorporate sound (a ringtone), sight (the screen), and touch (a vibration). Finally, my research may help clinicians who are helping others overcome sensory loss like blindness, by letting them know how they can use other senses.

您的头脑如何将手中的物体的感觉与同一对象的视线联系起来？为什么您会遇到一个对象而不是两个对象？如果握住钥匙，则您的手感觉钥匙，而看到的钥匙被视为一个对象。我们无缝地进行此操作，而无需考虑它，当我们看到钥匙以及触摸它时，我们就能识别钥匙。然而，许多关于我们如何识别对象的研究主要是通过视力识别对象，而不是通过触摸识别对象。同样，最近研究整合感官的研究已经完成了，因此使用复杂的对象很难理解对象如何不同或人们在识别对象时使用的信息种类。我的研究计划使用的新物体在固定尺寸上有所不同 - 因此，我们可以判断对象有何不同，以及人们在识别它们时使用哪些信息。我计划使用这些新颖的对象研究有关我们记忆中有关对象的信息以及在看到或触摸对象时如何识别对象的三个重要问题。第一个问题是：我们在内存中存储哪种信息？它是对象的视觉图像还是对象的口头描述？为了回答这个问题，我将要求人们学会识别新对象，但我还将通过提供其他信息来干预他们的学习。这里的关键是，如果我提供的信息类似于人们创建对象记忆的信息，那么创建这些记忆将更加困难。第二个问题是：当我们创建这些记忆时，我们如何利用我们的视觉和触摸感？一种感觉比另一个重要吗？要回答这个问题，我将要求人们通过同时查看对象，触摸和触摸对象来学习识别对象。如果一种感觉比创造记忆的其他感觉更重要，那么人们在使用这种感觉时会更好地完成实验。最后，第三个问题是：识别对象时的视觉比触摸更重要吗？要回答这个问题，我将要求人们通过视力或触摸识别对象，但同时向其他意义提出了另一个对象 - 人们应该忽略第二个对象。如果“第二意义”很重要，那么人们将无法忽略第二个对象，并且在识别对象时它们的速度较慢且准确。我的研究具有重要的含义和应用。它将帮助我们学习记忆所包含的信息，以及如何创建和访问这些记忆。当我们设计诸如配合声音（铃声），视线（屏幕）和触摸（振动）之类的技术时，此信息也将有所帮助。最后，我的研究可以帮助他人通过让他们知道如何使用其他感官来帮助他人克服诸如失明之类的感觉丧失的临床医生。