I-Corps: Translation Potential of Bidirectional Neural Communication for Extended Reality Technologies

I-Corps：双向神经通信在扩展现实技术中的转化潜力

• 批准号: 2419142
• 负责人: Huanyu Cheng
• 金额: $ 5万
• 依托单位: Pennsylvania State Univ University Park
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2024
• 资助国家: 美国
• 起止时间: 2024-04-01 至 2025-03-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2419142&HistoricalAwards=false
• 关键词: Corps; Translation; Potential; Bidirectional; Neural

The broader impact of this I-Corps project is the development of next-generation extended reality technologies with integrated wearable biomedical sensors. The development of wearable technology for Augmented Reality/Virtual Reality (AR/VR) headsets has the potential to change how people use and embrace these technologies. By creating a controller platform that relies on user feedback, people can interact with devices that are more user-friendly. Additionally, the ability of these devices to detect materials can allow users to interact with virtual objects using natural hand gestures. By improving the understanding of and response to human actions, these devices will make the AR/VR experience more immersive and enjoyable. Overall, this advancement brings the users closer to seamlessly blending the real and virtual worlds, potentially making these technologies more accessible and beneficial.This I-Corps project utilizes experiential learning coupled with a first-hand investigation of the industry ecosystem to assess the translation potential of the technology. The solution is based on the development of a cost-effective, waterproof sensor made from carbon for Augmented Reality/Virtual Reality (AR/VR) headsets. This sensor will gather data on eye movements (electrooculography - EOG), muscle activity (electromyography - EMG), and brainwaves (electroencephalography - EEG), allowing for the precise prediction of human emotions and responses. The new wearable technology for AR/VR headsets introduces a versatile sensing platform to enable two-way neural communication between users and devices. Its soft, flexible design minimizes motion for accurate data collection, while carbon-based electrodes help maintain a high signal-to-noise ratio. Simultaneously, a piezoelectric sensor detects hand gestures and materials, dynamically enhancing user interaction. This advancement integrates seamlessly with headsets, offering a cost-effective, scalable, and waterproof solution. Drawing from neuroscience, materials science, and artificial intelligence, this interdisciplinary approach expands the possibilities of wearable technology, promising an enhanced user experiences in AR/VR environments.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该 I-Corps 项目的更广泛影响是开发具有集成可穿戴生物医学传感器的下一代扩展现实技术。增强现实/虚拟现实 (AR/VR) 耳机可穿戴技术的发展有可能改变人们使用和接受这些技术的方式。通过创建依赖于用户反馈的控制器平台，人们可以与更加用户友好的设备进行交互。此外，这些设备检测材料的能力可以让用户使用自然的手势与虚拟对象进行交互。通过提高对人类行为的理解和响应，这些设备将使 AR/VR 体验更加身临其境和令人愉悦。总体而言，这一进步使用户更接近于无缝融合现实世界和虚拟世界，从而可能使这些技术更易于使用和受益。该 I-Corps 项目利用体验式学习以及对行业生态系统的第一手调查来评估翻译潜力该技术的。该解决方案基于开发用于增强现实/虚拟现实 (AR/VR) 耳机的经济高效的碳纤维防水传感器。该传感器将收集有关眼球运动（眼电图 - EOG）、肌肉活动（肌电图 - EMG）和脑电波（脑电图 - EEG）的数据，从而能够精确预测人类情绪和反应。用于 AR/VR 耳机的新型可穿戴技术引入了多功能传感平台，可实现用户和设备之间的双向神经通信。其柔软、灵活的设计最大限度地减少了运动，以实现准确的数据收集，而碳基电极有助于保持高信噪比。同时，压电传感器检测手势和材料，动态增强用户交互。这一进步与耳机无缝集成，提供了经济高效、可扩展且防水的解决方案。这种跨学科方法借鉴了神经科学、材料科学和人工智能，扩展了可穿戴技术的可能性，有望在 AR/VR 环境中增强用户体验。该奖项反映了 NSF 的法定使命，并通过使用基金会的评估进行评估，被认为值得支持。智力价值和更广泛的影响审查标准。