SBIR Phase I: Robotic system outputting natural tactile-sign language to aid Deaf and Deafblind communication

SBIR 第一阶段：输出自然触觉手语的机器人系统以帮助聋人和聋盲人进行交流

• 批准号: 2212930
• 负责人: Samantha Johnson
• 金额: $ 25.6万
• 依托单位: TATUM ROBOTICS LLC
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-02-15 至 2023-10-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2212930&HistoricalAwards=false
• 关键词: SBIR; Phase; Robotic; system; outputting

The broader impact/commercial potential of this Small Business Innovation Research (SBIR) Phase I project will contribute to the fields of low-cost anthropomorphic robotics as well as machine translation. Leveraging advancements in low-cost manufacturing and deep learning, the project is developing an accessible and state-of-the-art complaint robot with robust remote processing. Using remote processing to avoid expensive microprocessors and memory capabilities, the proposed cloud server can capture any wifi-based communication and entertainment, while translating language with custom standards and user preferences in real-time. By granting DeafBlind (DB) individuals newfound independence and privacy, the success of the project will revolutionize how DB individuals interact with their community as well as provide immediate access to the abled world’s resources. The market opportunity is estimated at $213 billion annually. This product will have a significant impact on the assistive technology field, targeting the historically underserved DB populations, for whom there is little innovation. Importantly, this would be the first commercialized signing robot. This Small Business Innovation Research (SBIR) Phase I project will provide a convenient and accessible method for DeafBlind (DB) people to interact with the world. The current lack of communication aides among the DB community requires all people with severe deafblindness to rely on human interpreters to interact with the hearing/sighted world. However, with extensive lead times for these expensive services, DB individuals regularly experience isolation and loneliness. This research aims to achieve a fully compliant, flexible fingerspelling anthropomorphic hand. Additionally, this research aims to develop the first architecture for translating between a spoken and signed language. Technical research requires investigation into motion capture mapping and storage of continuous motion as well as tendon actuation schemes to achieve a low-cost 18 degrees of freedom robotic hand. Additionally, linguistics research explores DB language usage (syntax, morphology, sign production, etc.) as well as preferences based on demographic data. Anticipated technical results include a robotic hand that can sign with 90% recognition from DB users, signing at variable speeds ranging from one to two signs per second with accurate translation patterns between the source language and outputted tactile signs.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

这项小型企业创新研究（SBIR）I阶段项目的更广泛的影响/商业潜力将为低成本拟人化机器人技术和机器翻译带来贡献。利用低成本制造和深度学习的进步，该项目正在开发具有强大远程处理的可访问且最先进的投诉机器人。使用远程处理来避免昂贵的微处理器和内存功能，建议的云服务器可以捕获任何基于WiFi的通信和娱乐，同时以自定义标准和用户的偏好来实时转换语言。通过授予聋哑人（DB）个人新发现的独立性和隐私，该项目的成功将彻底改变数据库个人如何与社区互动，并立即访问能够获得能力的世界资源。市场机会每年估计为2130亿美元。该产品将对辅助技术领域产生重大影响，以历史悠久的DB人群为目标，而这些DB人群几乎没有创新。重要的是，这将是第一个商业化的签名机器人。这项小型企业创新研究（SBIR）I阶段项目将为聋哑人（DB）人与世界互动提供便利且易于访问的方法。目前，数据库社区中缺乏沟通助手要求所有患有严重聋哑人的人都依靠人类口译员与听力/视力世界互动。但是，在这些昂贵的服务中，DB个人经常经历隔离和孤独感。这项研究旨在获得完全合规的，灵活的手指手指。此外，这项研究旨在开发第一个在口语和签名语言之间翻译的体系结构。技术研究需要研究捕获运动映射和连续运动以及肌腱动作方案的研究，以实现低成本18度的自由机器人手。此外，语言学研究还探讨了DB语言使用（语法，形态，标志生产等）以及基于人口统计数据的偏好。 Anticipated technical results include a robotic hand that can sign with 90% recognition from DB users, signing at variable speeds ranging from one to two signs per second with accurate translation patterns between the source language and outputted tactile signs.This award reflects NSF's statutory mission and has been deemed honestly of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.