PostureCheck: A vision-based compensatory-posture-detection tool to enhance performance of the BURT® upper-extremity stroke-therapy device

PostureCheck：一种基于视觉的补偿姿势检测工具，可增强 BURT® 上肢中风治疗设备的性能

• 批准号: 10437603
• 负责人: Paolo Bonato
• 金额: $ 81.78万
• 依托单位: BARRETT TECHNOLOGY, LLC
• 依托单位国家: 美国
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-09-22 至 2024-04-30
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/10437603
• 关键词: Activities of Daily Living; Adult; American; Architecture; Artificial Intelligence; Chronic; Clinic; Clinical Research; Complement; Data; Data Set; Detection; Devices; Ensure; Exercise; Exercise Therapy; Feedback; Future; Goals; Group Therapy; Hand; Individual; Intervention; Intervention Studies; Intuition; Learning; Machine Learning; Measures; Medical Device; Monitor; Motion; Motor; Movement; Names; Nervous System Trauma; Occupational Therapist; Outcome; Patient Education; Patients; Pattern; Performance; Phase; Physiological; Posture; Quality of life; Randomized Clinical Trials; Rehabilitation Centers; Rehabilitation device; Rehabilitation therapy; Research Personnel; Research Project Grants; Robot; Robotics; Side; Small Business Innovation Research Grant; Stroke; Structure; Supervision; Survivors; System; Techniques; Technology; Therapeutic; Time; United States National Institutes of Health; Upper Extremity; Vision; Weight; Work; arm; arm movement; base; chronic stroke; cost; cost effective; cost efficient; deep learning; design; disability; dosage; exercise rehabilitation; experience; functional independence; haptic feedback; image processing; improved; improved functioning; interest; motor impairment; motor learning; motor recovery; preservation; recruit; robot assistance; robot rehabilitation; robotic system; software development; stroke patient; stroke rehabilitation; stroke survivor; stroke therapy; tool; transfer learning; visual feedback

Project Summary/Abstract This Small Business Innovation Research (SBIR) Phase-II project proposes the deployment of an AI-powered image-processing tool, named PostureCheck™, to automatically detect when patients perform undesirable compensatory movements during robot-assisted upper-extremity (UE) rehabilitation exercises. The system is based on a standard video camera and the artificial intelligence (AI) software developed under the NIH Phase-I project. PostureCheck™ will be fully integrated with Barrett Technology's existing Burt® UE rehabilitation robot, ensuring that patients are provided appropriate and timely feedback to encourage the correct performance of therapeutic exercises without requiring constant therapist supervision. Burt® is an FDA-listed UE rehabilitation robot that supports the weight of a patient's arm and hand while the patient moves his/her arm to interact with on-screen games. Burt® offers guided assistance, visual and haptic feedback, and activities and assessments to both help train the patient and measure progress. Clinical studies have shown that Burt® can be used to improve patients' performance in one-on-one sessions with a therapist. However, the system lacks the capability for a single therapist to monitor and work with several patients and Burt® systems at one time. The proposed SBIR Phase-II activities are organized in three aims. In Aim 1, the annotated dataset generated in Phase-I will be used to develop three separate AI modules. These modules will be integrated into a framework that allows therapists to monitor the outcome of the modules, and, through feedback, enable the system to auto- adapt to improve performance continuously. In Aim 2, stakeholder feedback will be gathered and integrated to design multiple user interfaces for the PostureCheck™ tool. Specific interfaces will be created for use by therapists during and after RT sessions. PostureCheck™ will be integrated with the Burt® device to empower therapists to provide effective feedback to patients and deter the use of compensatory movements. Finally, in Aim 3, forty-two stroke survivors will be recruited in an interventional study deploying the PostureCheck™ and Burt® systems. Subjects will undergo eighteen RT sessions in either an individual or group therapy format. Motor performance between groups will be compared to gather information about the suitability of the combined systems for multi-patient RT therapy in future rehabilitation centers. The long-term commercial goal of the project is to provide a practical Burt®-plus-PostureCheck™ system to empower therapists to supervise multiple patients simultaneously through a gamut of useful functionalities. The system will be suitable for deployment in clinics as well as rehabilitation centers such as wellness gyms.

项目摘要/摘要 这项小型企业创新研究（SBIR）II期项目提出部署AI驱动的 图像处理工具（名为PossureCheck™）自动检测患者何时表现不佳 机器人辅助上超级性（UE）康复练习期间的补偿性运动。系统是 基于NIH I期制定的标准摄像机和人工智能（AI）软件 项目。 PossureCheck™将与Barrett Technology现有的Burt®UE康复机器人完全集成 确保为患者提供适当和及时的反馈，以鼓励正确的表现 治疗锻炼，而无需持续的治疗师监督。 Burt®是一种FDA上市的UE康复机器人，可支持患者手臂和手的重量 病人移动他/她的手臂与屏幕上的游戏互动。 Burt®提供指导的帮助，视觉和触觉 反馈，活动和评估以帮助培训患者并衡量进度。临床研究 已经表明，Burt®可用于与治疗师一对一的课程中的患者表现。 但是，该系统缺乏单个治疗师与几名患者监测和工作的能力， Burt®系统一次。 提出的SBIR II期活动以三个目的组织。在AIM 1中，生成的注释数据集 在阶段中，I将用于开发三个单独的AI模块。这些模块将集成到一个框架中 这使治疗师可以监视模块的结果，并通过反馈使系统能够自动 适应不断提高性能。在AIM 2中，利益相关者的反馈将收集并集成到 为PostureCheck™工具设计多个用户接口。将创建特定的接口 治疗师在RT课程中和之后。 PossureCheck™将与Burt®设备集成以授权 治疗师向患者提供有效的反馈并确定补偿运动的使用。最后，在 AIM 3，将在部署PossureCheck™的介入研究中招募42个中风生存 Burt®系统。受试者将以个人或团体治疗格式进行18个RT课程。发动机 将比较小组之间的性能，以收集有关合并的适用性的信息 未来康复中心多患者RT治疗的系统。 该项目的长期商业目标是为实用的Burt®Plus-Posturecheck™系统提供 仅仅通过一系列有用的功能来授权治疗师来监督多个患者。 系统适合在诊所和康复中心（例如健康健身房）部署。