NSF Convergence Accelerator Track H: Phase II Smart Wearables for Expanding Workplace Access for People with Blindness and Low Vision

NSF 融合加速器轨道 H：第二阶段智能可穿戴设备，扩大失明和低视力人士的工作场所使用范围

• 批准号: 2345139
• 负责人: John Ross Rizzo
• 金额: $ 500万
• 依托单位: New York University Medical Center
• 依托单位国家: 美国
• 项目类别: Cooperative Agreement
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-12-15 至 2026-11-30
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2345139&HistoricalAwards=false
• 关键词: NSF; Convergence; Accelerator; Track; Phase

There are 285 million people with blindness and low vision (pBLV) worldwide. One dramatic correlate of vision loss is unemployment, with rates as high as 81% in urban environments. Employment disparities stem, in large part, from difficulties with transportation to and from work and wayfinding within the workplace itself. This project takes a fundamental step in addressing the employment challenges of pBLV through a powerful assistive-navigation platform, the Visually Impaired Smart Service System for Spatial Intelligence and Onboard Navigation (VIS4ION). VIS4ION is a discreet, instrumented backpack with an array of miniaturized sensors integrated into straps that connect to an embedded system for computational analysis. Real-time audio and tactile feedback are provided through a binaural bone conduction headset and an optional reconfigured waist strap turned haptic interface. A prototype platform, partly developed through the Phase 1 Convergence Accelerator Grant, provides valuable microservices for pBLV, including real-time navigation, scene understanding, and obstacle avoidance, all of which could transform workplace experiences for pBLV. This translational Phase 2 project broadly seeks to bring the current VIS4ION prototype to a commercial system for impact in real complex workplace environments. The work will leverage new developments in conversational AI, machine vision, networking, and haptics, along with extensive trials with users. To realize the goals for this multi-faceted project, a transdisciplinary team has been assembled that spans technology development, engineering, translational medicine, and business management, supported by partners in private industry (Google, AT&T, and Qualcomm), non-profits for pBLV (Lighthouse Guild and VISIONS), and government agencies for transport and disabilities (MTA, DOT, and NYC office for persons with disabilities).This translational project will be executed in four inter-connected tasks: (1) boosting independent AI-based microservices for smart wearables with a specific focus on a navigation pipeline that supports indoor and outdoor journeys, with zero infrastructural requirements; (b) enhancing coordinated microservices through custom AI ensembles and conversational AI; (c) building network connectivity resilience through unique video rate-adaptation algorithms; and (d) executing extensive system usability testing in transit hubs, hospitals, and workplaces. Beyond the envisioned impact on medicine, science, engineering, and improving the lives of pBLV, this program will foster formal and informal learning opportunities for graduate, undergraduate, medical, and high school students in clinical and fundamental STEM/STEAM research. These training opportunities will foster multi-pronged and multi-disciplinary team approaches critical to the development of innovative solutions for complex real-world problems.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

全球有2.85亿人失明和低视力（PBLV）。视力丧失的一种戏剧性相关是失业，在城市环境中的比率高达81％。就业差异在很大程度上是由于在工作场所本身内部的运输和寻求方向而遇到的困难。该项目通过一个强大的辅助 - 行动平台（用于空间智能和车载导航（Vis4ion）的视觉障碍智能服务系统（Vis4ion），通过强大的辅助助攻平台解决PBLV的就业挑战。 Vis4ion是一个谨慎的仪器背包，其中包含一系列的微型传感器集成到皮带中，连接到嵌入式系统进行计算分析。实时音频和触觉反馈是通过双耳骨传导耳机和可选的重新配置的腰带变成触觉界面的。一个原型平台部分通过第1阶段收敛加速器拨款开发，为PBLV提供了宝贵的微服务，包括实时导航，场景理解和避免障碍物，所有这些都可以改变PBLV的工作场所体验。这个转化阶段2项目广泛地试图将当前的Vis4ion原型带到商业系统中，以在真正的复杂工作场所环境中影响。这项工作将利用与用户进行的广泛试验，利用对话AI，机器视觉，网络和触觉的新发展。 To realize the goals for this multi-faceted project, a transdisciplinary team has been assembled that spans technology development, engineering, translational medicine, and business management, supported by partners in private industry (Google, AT&T, and Qualcomm), non-profits for pBLV (Lighthouse Guild and VISIONS), and government agencies for transport and disabilities (MTA, DOT, and NYC office for persons with残疾）。该翻译项目将在四个相互连接的任务中执行：（1）提高基于AI的独立微服务用于智能可穿戴设备，特别关注支持室内和室外旅行的导航管道，具有零基础架构要求； （b）通过自定义AI合奏和对话AI增强协调的微服务； （c）通过独特的视频速率适应算法建立网络连接弹性； （d）在公交枢纽，医院和工作场所执行大量系统可用性测试。除了对医学，科学，工程和改善PBLV生活的影响外，该计划还将为临床和基本的STEM/Steam Research促进研究生，本科，医学和高中生的正式和非正式学习机会。这些培训机会将促进多支管和多学科团队的方法对于为复杂现实世界中的创新解决方案开发至关重要。该奖项反映了NSF的法定任务，并认为值得通过基金会的知识分子优点和更广泛的影响来评估通过评估来提供支持。