PostureCheck: A vision-based compensatory-posture-detection tool to enhance performance of the BURT® upper-extremity stroke-therapy device

PostureCheck：一种基于视觉的补偿姿势检测工具，可增强 BURT® 上肢中风治疗设备的性能

• 批准号: 10156853
• 负责人: Paolo Bonato
• 金额: $ 81.34万
• 依托单位: BARRETT TECHNOLOGY, LLC
• 依托单位国家: 美国
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-09-22 至 2023-04-30
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/10156853
• 关键词: Activities of Daily Living; Adult; American; Architecture; Artificial Intelligence; Chronic; Clinic; Clinical Research; Complement; Data; Data Set; Detection; Devices; Ensure; Exercise; Exercise Therapy; Feedback; Future; Goals; Group Therapy; Hand; Individual; Intervention; Intervention Studies; Intuition; Learning; Machine Learning; Measures; Medical Device; Monitor; Motion; Motor; Movement; Names; Nervous System Trauma; Occupational Therapist; Outcome; Patient Education; Patients; Pattern; Performance; Phase; Physiological; Posture; Psychological Transfer; Quality of life; Randomized Clinical Trials; Rehabilitation Centers; Rehabilitation device; Rehabilitation therapy; Research Personnel; Research Project Grants; Robot; Robotics; Side; Small Business Innovation Research Grant; Stroke; Structure; Supervision; Survivors; System; Techniques; Technology; Therapeutic; Time; United States National Institutes of Health; Upper Extremity; Vision; Weight; Work; arm; arm movement; base; chronic stroke; cost; cost effective; cost efficient; deep learning; design; disability; dosage; exercise rehabilitation; experience; functional independence; haptic feedback; image processing; improved; improved functioning; interest; motor impairment; motor learning; motor recovery; preservation; recruit; robot assistance; robot rehabilitation; robotic system; software development; stroke patient; stroke rehabilitation; stroke survivor; stroke therapy; tool; visual feedback

Project Summary/Abstract This Small Business Innovation Research (SBIR) Phase-II project proposes the deployment of an AI-powered image-processing tool, named PostureCheck™, to automatically detect when patients perform undesirable compensatory movements during robot-assisted upper-extremity (UE) rehabilitation exercises. The system is based on a standard video camera and the artificial intelligence (AI) software developed under the NIH Phase-I project. PostureCheck™ will be fully integrated with Barrett Technology's existing Burt® UE rehabilitation robot, ensuring that patients are provided appropriate and timely feedback to encourage the correct performance of therapeutic exercises without requiring constant therapist supervision. Burt® is an FDA-listed UE rehabilitation robot that supports the weight of a patient's arm and hand while the patient moves his/her arm to interact with on-screen games. Burt® offers guided assistance, visual and haptic feedback, and activities and assessments to both help train the patient and measure progress. Clinical studies have shown that Burt® can be used to improve patients' performance in one-on-one sessions with a therapist. However, the system lacks the capability for a single therapist to monitor and work with several patients and Burt® systems at one time. The proposed SBIR Phase-II activities are organized in three aims. In Aim 1, the annotated dataset generated in Phase-I will be used to develop three separate AI modules. These modules will be integrated into a framework that allows therapists to monitor the outcome of the modules, and, through feedback, enable the system to auto- adapt to improve performance continuously. In Aim 2, stakeholder feedback will be gathered and integrated to design multiple user interfaces for the PostureCheck™ tool. Specific interfaces will be created for use by therapists during and after RT sessions. PostureCheck™ will be integrated with the Burt® device to empower therapists to provide effective feedback to patients and deter the use of compensatory movements. Finally, in Aim 3, forty-two stroke survivors will be recruited in an interventional study deploying the PostureCheck™ and Burt® systems. Subjects will undergo eighteen RT sessions in either an individual or group therapy format. Motor performance between groups will be compared to gather information about the suitability of the combined systems for multi-patient RT therapy in future rehabilitation centers. The long-term commercial goal of the project is to provide a practical Burt®-plus-PostureCheck™ system to empower therapists to supervise multiple patients simultaneously through a gamut of useful functionalities. The system will be suitable for deployment in clinics as well as rehabilitation centers such as wellness gyms.

项目概要/摘要 这个小企业创新研究 (SBIR) 第二阶段项目建议部署人工智能驱动的 名为 PostureCheck™ 的图像处理工具，可自动检测患者何时出现不良行为 机器人辅助上肢（UE）康复训练期间的补偿运动。 基于标准摄像机和 NIH 第一阶段开发的人工智能 (AI) 软件 PostureCheck™ 项目将与 Barrett Technology 现有的 Burt® UE 康复机器人完全集成。 确保向患者提供适当和及时的反馈，以鼓励患者正确执行 无需治疗师持续监督的治疗练习。 Burt® 是 FDA 列出的 UE 康复机器人，可支撑患者手臂和手的重量，同时 患者移动手臂与屏幕游戏互动，Burt® 提供视觉和触觉指导帮助。 反馈、活动和评估，以帮助培训患者和衡量临床研究进展。 已经表明 Burt® 可用于改善患者在与治疗师一对一治疗中的表现。 然而，该系统缺乏单个治疗师监控多个患者并与多个患者一起工作的能力，并且 一次性使用 Burt® 系统。 拟议的 SBIR 第二阶段活动分为三个目标：目标 1 生成带注释的数据集。 第一阶段将用于开发三个独立的人工智能模块，这些模块将被集成到一个框架中。 这使得治疗师能够监控模块的结果，并通过反馈使系统能够自动 在目标 2 中，将收集利益相关者的反馈并整合以不断提高绩效。 为 PostureCheck™ 工具设计多个用户界面 将创建特定界面以供使用。 RT 疗程期间和之后治疗师将与 Burt® 设备集成，以增强治疗师的能力。 治疗师向患者提供有效的反馈并阻止使用代偿性动作。 目标 3，将招募 42 名中风幸存者参与一项部署 PostureCheck™ 的干预研究， Burt® 系统。受试者将接受 18 次个人或团体运动治疗形式的 RT 疗程。 将比较各组之间的表现，以收集有关组合的适用性的信息 未来康复中心的多患者 RT 治疗系统。 该项目的长期商业目标是提供实用的 Burt®-plus-PostureCheck™ 系统 使治疗师能够通过一系列有用的功能同时监督多名患者。 系统将适合部署在诊所以及健身中心等康复中心。