Intuitive, complete neural control of tablet computers for communication

对平板电脑进行直观、完整的神经控制以进行通信

基本信息

批准号：
10641962
负责人：
LEIGH R HOCHBERG
金额：
$ 79.8万
依托单位：
BROWN UNIVERSITY
依托单位国家：
美国
项目类别：
财政年份：
2019
资助国家：
美国
起止时间：
2019-04-01 至 2025-06-30
项目状态：
未结题

来源：
https://reporter.nih.gov/project-details/10641962
关键词：
Amyotrophic Lateral Sclerosis Augmentative and Alternative Communication BRAIN initiative Brain Brain Stem Infarctions Calibration Caregivers Clinical Research Clinical Trials Collaborations Communication Competence Computer software Computers Darkness Data Detection Development Devices Dimensions Disease Family Fatigue Feedback Friends Gestures Hand Home Human Human Activities Implant Individual Industry Injury Institution Intention Interactive Communication Intuition Knowledge Language Lighting Location Locked-In Syndrome Methods Modeling Modernization Motor Motor Cortex Movement Mus National Institute on Deafness and Other Communication Disorders Neurons Outcome Measure Paralysed Participant Pattern Performance Persons Research Research Support Residual state Signal Transduction Speech Speed Surveys System Tablet Computer Tablets Technology Testing Time Touch sensation Translating Translations United States National Institutes of Health arm awake brain computer interface communication device deep learning design expectation experience feasibility trial first-in-human flexibility improved innovation long short term memory motor disorder motor impairment neural neural implant neuroregulation nonhuman primate novel phrases preference tool touchscreen two-dimensional wireless

项目摘要

Project Summary Conventional augmentative and alternative communication (AAC) devices for people with severe speech and motor impairments (SSMI) rely on residual motor function, inherently limiting communication throughput. Commercially available AAC solutions require daily caregiver setup, need frequent recalibration often from a technically savvy caregiver, are often unable to be used in dark lighting conditions, and can encumber or fatigue important remaining physical abilities. Furthermore, for people with progressive motor dysfunction due to amyotrophic lateral sclerosis (ALS), even the most well-designed AAC devices will eventually fail as movements become unreliable. For people with brainstem stroke, ALS, and other disorders causing locked-in syndrome (LIS) or SSMI, brain-computer interfaces (BCIs) hold promise as a method of enabling communication that does not rely upon speech or voluntary movement. In prior NIDCD-supported research, our BrainGate research team provided early proofs of principle of a powerful intracortical brain-computer interface (iBCI) that decodes movement intentions directly from brain activity. This technology has allowed people to control a cursor on a computer screen for communication simply by imagining movements of their own arm. The proposed NIDCD U01 clinical research will further the development and testing of a fully implanted iBCI that could provide robust, intuitive control of industry-grade communication apps for people with LIS or SSMI. By leveraging the ongoing pilot clinical trials of the investigational BrainGate system, we aim to (1) improve the robustness and accuracy of neurally actuated point-and click, in part through the translation of neuronal activity from human premotor and motor cortex, (2) expand the number of input dimensions to tablet computers available via neural activity, allowing intended hand gesture commands to control communication apps on touch-screen tablet computers, and (3) rigorously compare the performance of the investigational BrainGate system to trial participants’ conventional AAC systems with respect to communication competence, information throughput, user preference and outcomes measures. By incorporating the feedback of six individual participants with paralysis, this feasibility trial will optimize a powerful iBCI for communication and will establish the metrics needed for a subsequent pivotal trial of a fully implanted, always-available iBCI communication system for people with SSMI.

项目概要适用于患有以下疾病的人的传统增强和替代通信 (AAC) 设备严重言语和运动障碍（SSMI）本质上依赖于残余运动功能限制商用 AAC 解决方案每天需要的通信吞吐量。护理人员设置，通常需要技术娴熟的护理人员进行频繁的重新校准，通常无法在黑暗的照明条件下使用，并且可能会阻碍或疲劳重要的剩余部分进一步的身体能力，对于由于以下原因而患有进行性运动功能障碍的人肌萎缩侧索硬化症 (ALS)，即使是设计最精良的 AAC 设备最终也会对于患有脑干中风、ALS 和其他疾病的人来说，运动会变得不可靠。导致闭锁综合征 (LIS) 或 SSMI 的疾病、脑机接口 (BCI) 承诺作为一种不依赖言语或自愿的沟通方法在之前 NIDCD 支持的研究中，我们的 BrainGate 研究团队提供了早期的成果。强大的皮质内脑机接口（iBCI）的原理证明，可解码这项技术可以让人们直接从大脑活动中控制运动意图。计算机屏幕上的光标，只需想象自己的动作即可进行交流拟议的 NIDCD U01 临床研究将进一步开发和测试完全植入的 iBCI，可以提供对工业级通信的强大、直观的控制通过利用正在进行的试点临床试验，为 LIS 或 SSMI 患者开发应用程序。研究性 BrainGate 系统，我们的目标是 (1) 提高神经驱动的点击，部分是通过神经活动的翻译人类前运动和运动皮层，（2）将输入维度数量扩展到平板电脑计算机通过神经活动可用，允许预期的手势命令来控制触摸屏平板电脑上的通信应用程序，以及（3）严格比较研究性 BrainGate 系统对试验参与者传统 AAC 的性能系统的通信能力、信息吞吐量、用户偏好通过将六个人的反馈与结果措施相结合。瘫痪，该可行性试验将优化强大的 iBCI 进行通信，并将建立完全植入、始终可用的 iBCI 的后续关键试验所需的指标 SSMI 患者的通信系统。