STTR Phase I: Virtual Interfaces using Multi-Protocol, Augmented-Reality Activation-Based Control Transfer

STTR 第一阶段：使用多协议、基于增强现实激活的控制传输的虚拟接口

• 批准号: 2151524
• 负责人: Dominick Lee
• 金额: $ 25.6万
• 依托单位: GYROPALM, LLC
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-09-01 至 2023-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2151524&HistoricalAwards=false
• 关键词: STTR; Phase; Virtual; Interfaces; using

The broader impact/commercial potential of this Small Business Technology Transfer (STTR) Phase I project provides virtual interfaces that can be dynamically customized to address the challenge of user adoption in augmented reality (AR) products. This project overcomes previous limitations for AR such as the lack of interoperability, user-acceptance, scalability, and application-aware user intent recognition. While the AR market is projected to grow, wearable collaboration has unexplored potential. Users empowered by this project may be able to easily collaborate alongside skilled experts as well as robotic interfaces in the same medium. Through contextually-aware dynamic controls, manufacturing businesses can lower the risk of human-error while increasing fulfillment capabilities, as employees working from home can stay physically connected and remain engaged with minimal compromise. The AR innovation proposed in this project has application across multiple industries, including manufacturing, training, and emergency simulations.This Small Business Technology Transfer (STTR) Phase I project aims to create a framework for scalable experimentation of virtual interfaces that empower users to search, tag, and store meaningful data using gesture interactions in a secure and private manner. This project seeks to provide context-based, hands-free interaction with wireless devices while minimizing the need to set up sensors (such as optical components or microphones) in controlled environments and providing visual feedback and accessibility to the end user. A wrist-worn wearable captures pre-trained gesture data, and a pair of augmented reality (AR) glasses identifies and analyzes an object within the context of said gestures to control a mechatronic device, such as a robot, to perform occupational tasks. This dynamic process uses factors such as the user’s gaze area, physical location, and computer application. The improvement upon gesture control may allow a separate visual unit, such as the AR glasses, to wirelessly receive and display the gesture intents and perform contextually-aware, meaningful interactions with a clear distinction across a plurality of devices or digitally tagged objects associated with a specific use-case.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该小型企业技术转让 (STTR) 第一阶段项目具有更广泛的影响/商业潜力，提供可动态定制的虚拟界面，以应对增强现实 (AR) 产品中用户采用的挑战。该项目克服了 AR 之前的限制，例如。缺乏互操作性、用户接受度、可扩展性和应用感知的用户意图识别虽然 AR 市场预计会增长，但该项目赋予的用户可能能够轻松地与熟练的协作。通过上下文感知的动态控制，制造企业可以降低人为错误的风险，同时提高履行能力，因为在家工作的员工可以保持物理联系并以最小的妥协保持参与。该项目提出的创新可应用于多个行业，包括制造、培训和紧急模拟。这个小型企业技术转让（STTR）第一阶段项目旨在创建一个可扩展的虚拟界面实验框架，使用户能够搜索、标记、并使用手势交互存储有意义的数据该项目旨在以安全且私密的方式提供与无线设备的基于上下文的免提交互，同时最大限度地减少在受控环境中设置传感器（例如光学组件或麦克风）的需要，并提供最终的视觉反馈和可访问性。用户佩戴在手腕上的可穿戴设备捕捉预先训练的手势数据，一副增强现实（AR）眼镜识别并缝合所述手势背景下的物体，以控制机电设备（例如机器人）执行职业任务。这个动态过程使用诸如以下因素：用户的注视区域、物理位置和计算机应用程序的改进可以允许单独的视觉单元（例如 AR 眼镜）无线接收和显示手势意图，并执行上下文感知、有意义的交互，并进行清晰的区分。与特定用例相关的多个设备或数字标记对象。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。