Collaborative Research: CNS Core: Small: SmartSight: an AI-Based Computing Platform to Assist Blind and Visually Impaired People

合作研究：中枢神经系统核心：小型：SmartSight：基于人工智能的计算平台，帮助盲人和视障人士

• 批准号: 2418188
• 负责人: Mohsen Amini Salehi
• 金额: $ 24.97万
• 依托单位: University of North Texas
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-10-01 至 2024-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2418188&HistoricalAwards=false
• 关键词: Collaborative; Research; CNS; Core; Small

This project will design SmartSight, a platform that combines the computing ability of the device-to-cloud continuum with Artificial Intelligence (AI) methods to enable ambient perception for blind and visually impaired people (VIP), thereby improving their quality of life and social inclusion. SmartSight operates based on smart glasses and provides real-time perception for its user by efficiently deploying machine learning and approximate computing methods across a continuum of tiers—from local tiers (device and edge) to remote tiers (fog and cloud platforms). SmartSight uses federated learning to take advantage of collective observations of users and improve its perception accuracy. The platform is robust against failure in its communication with remote tiers and is able to provide its basic functionality using only local tiers. For that purpose, SmartSight dynamically adjusts approximate computing knobs and allocates critical tasks to resources, only if they can produce timely results. A prototype of SmartSight will be developed and tested with blind and VIP to assess its usability, robustness, convenience, and discreteness. SmartSight enables “AI+Systems for social good.” The project results will impact not only the forefront of scientific discovery, but also society by improving the quality of life and social inclusion of the blind and VIP. Other citizens who suffer from some form of cognitive decline (e.g., Alzheimer's disease) will benefit from SmartSight technology and be able to function as independent members of society. The steps towards addressing these hurdles not only will improve the quality of life for these people but will also bring about a remarkable cost-saving to society as a whole. The potential gain is even greater when considered on a global scale. The intelligent resource allocation and approximate computing methods that will be developed for the SmartSight platform can be adapted to other soft real-time computing systems, and the proposed efficient and scalable approaches for automated parameter tuning and ubiquitous model execution can be employed in other tunable software systems.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该项目将设计SmartSight，该平台将设备对云的计算能力与人工智能（AI）方法相结合，以使环境感知能够对盲人和视力障碍者（VIP）（VIP），从而改善了他们的生活质量和社会包容性。 SmartSight基于智能眼镜运行，并通过有效地部署机器学习和近似层次的计算方法来为其用户提供实时感知，从本地层（设备和边缘）到远程层（雾和云平台）。 SmartSight使用联合学习来利用对用户的集体观察并提高其看法准确性。该平台在与远程层的通信中的失败中非常强大，并且只能使用本地层提供其基本功能。为此，仅当它们能够及时产生结果时，SmartSight会动态调整近似计算旋钮并将关键任务分配给资源。将通过盲目和VIP来开发和测试Smartsight的原型，以评估其可用性，鲁棒性，便利性和离散性。 SmartSight可以实现“社会利益的AI+系统”。该项目的结果不仅会影响科学发现的最前沿，而且还会通过改善盲人和VIP的社会包容来改善社会。遭受某种形式认知能力下降的其他公民（例如，阿尔茨海默氏病）将受益于聪明的技术，并能够充当社会的独立成员。解决这些障碍的步骤不仅可以改善这些人的生活质量，而且还将为整个社会带来惊人的成本节省。在全球范围内考虑时，潜在的收益更大。可以为智能平台开发的智能资源分配和近似计算方法可以适应其他软的实时计算系统，并且提议的有效且可扩展的方法可以在其他可调的软件系统中进行自动参数调整和无处不在的模型执行的拟议高效，可扩展的方法，这些奖项可以反映出NSF的众多奖励，并依靠NSF的智力启用，并具有良好的构建支持。 标准。