Engaging new cognitive and motor signals to improve communication prostheses

利用新的认知和运动信号来改善沟通假体

基本信息

批准号：
10675705
负责人：
Shaul Druckmann
金额：
$ 64.45万
依托单位：
STANFORD UNIVERSITY
依托单位国家：
美国
项目类别：
财政年份：
2015
资助国家：
美国
起止时间：
2015-04-01 至 2025-08-31
项目状态：
未结题

来源：
https://reporter.nih.gov/project-details/10675705
关键词：
Adult Area Augmentative and Alternative Communication BRAIN initiative Body part Brain Classification Clinical Research Cognitive Collaborations Communication Complex Computers Contralateral Dimensions Electronic Mail Evaluation Four-dimensional Freedom Funding Generations Goals Hand Health Personnel Healthcare Home Human Implant Institution Internet Ipsilateral Left Letters Lower Extremity Maps Measures Methods Modernization Motor Motor Cortex Movement Mus National Institute on Deafness and Other Communication Disorders Outcome Participant Performance Persons Population Procedures Prosthesis Quadriplegia Recreation Research Research Support Signal Transduction Site Social Interaction Source Speech Speed Standardization System Tablet Computer Techniques Technology Testing United States National Institutes of Health Upper Extremity Work arm brain computer interface clinical research site communication device computational platform design falls first-in-human high dimensionality improved kinematics literate loved ones marginalization mobile computing motor impairment neural nonhuman primate novel performance tests success tool two-dimensional ubiquitous computing virtual wireless

项目摘要

PROJECT SUMMARY While current augmentative and alternative communication (AAC) devices present a variety of access methods for message generation to benefit people with complex communication needs, there still exists a group of literate adults with severe speech and motor impairments (SSMI) who cannot identify a functional means for typing, which is an important tool for computer-based communication. In prior NIDCD- supported research, our research team developed a high performance intracortical brain-computer interface (iBCI) that decodes movement intentions directly from brain activity. This technology has allowed people to control a cursor on a computer screen for communication simply by imagining movements of their own arm. The proposed R01 clinical research will extend this prior work on improving the performance of iBCI systems, as part of the multi-site BrainGate consortium, and utilizing a new fully- implantable, wireless system being developed under separate NIH BRAIN Initiative funded project. The goals of the project are to leverage the discovery of new motor and cognitive signals in human motor cortex to implement and evaluate three new methods for iBCI typing and general purpose computer use: (1) an automatic Error Detect and Undo (EDU) system that uses error-related signals from motor cortex, (2) decoding techniques that create continuous high degree-of-freedom control signals from motor cortex to increase rates of point-and-click iBCI typing in 3D and 4D as compared with 2D, and (3) decoding techniques that classify multiple different “click” signals from motor cortex. A rigorous uniform experimental procedure with clear evaluation metrics will be utilized across all three Specific Aims, in all three research participants, and at each clinical site using a standardized suite of iBCI tasks, assuring consistency across sessions and participants. Upon completion, this project will advance both the capabilities of iBCIs for communication and our understanding of the function of human motor cortex.

项目摘要而当前的增强和替代通信（AAC）设备呈现了各种访问消息生成的方法使有复杂沟通需求的人受益，仍然存在无法识别功能性的识字成年人（SSMI）的识字成年人组（SSMI）打字的手段，这是基于计算机通信的重要工具。在先前的nidcd-中我们的研究团队支持研究，开发了高性能的心脏内脑机构计算机界面（IBCI）直接从大脑活动中解码运动意图。这项技术允许人们仅通过想象的动作来控制计算机屏幕上的光标以进行通信他们自己的手臂。拟议的R01临床研究将扩展此先前的工作，以改善 IBCI系统的性能，作为多站点紫色财团的一部分，并使用新的全面在独立的NIH大脑倡议资助项目下开发的可植入的无线系统。这该项目的目标是利用人类电动机中新电动机和认知信号的发现用于实施和评估IBCI打字和通用计算机使用的三种新方法的皮层：（1）自动误差检测和撤消（EDU）系统，该系统使用与Motor Cortex的错误相关信号，（2）解码技术产生电动机皮层连续的高度自由度控制信号与2D相比，要增加3D和4D的点击IBCI键入率，（3）解码从电动机皮层分类多个不同的“点击”信号的技术。严格的制服在所有三个特定目的中，都将利用具有明确评估指标的实验程序三名研究参与者以及每个临床部位使用标准化的IBCI任务套件，以确保会议和参与者之间的一致性。完成后，该项目将促进 IBCI的能力进行交流和我们对人类运动皮层功能的理解。

项目成果

期刊论文数量（19）

专著数量（0）

科研奖励数量（0）

会议论文数量（0）

专利数量（0）

Initial conditions combine with sensory evidence to induce decision-related dynamics in premotor cortex.

DOI：
10.1038/s41467-023-41752-2
发表时间：
2023-10-16
期刊：
NATURE COMMUNICATIONS
影响因子：
16.6
作者：
Boucher, Pierre O.;Wang, Tian;Carceroni, Laura;Kane, Gary;Shenoy, Krishna V.;Chandrasekaran, Chandramouli
通讯作者：
Chandrasekaran, Chandramouli

Brain control of bimanual movement enabled by recurrent neural networks.

DOI：
10.1038/s41598-024-51617-3
发表时间：
2024-01-18
期刊：
Scientific reports
影响因子：
4.6
作者：
通讯作者：

Measurement, manipulation and modeling of brain-wide neural population dynamics.

DOI：
10.1038/s41467-020-20371-1
发表时间：
2021-01-27
期刊：
Nature communications
影响因子：
16.6
作者：
Shenoy KV;Kao JC
通讯作者：
Kao JC

Virtual typing by people with tetraplegia using a self-calibrating intracortical brain-computer interface.

DOI：
10.1126/scitranslmed.aac7328
发表时间：
2015-11-11
期刊：
Science translational medicine
影响因子：
17.1
作者：
Jarosiewicz B;Sarma AA;Bacher D;Masse NY;Simeral JD;Sorice B;Oakley EM;Blabe C;Pandarinath C;Gilja V;Cash SS;Eskandar EN;Friehs G;Henderson JM;Shenoy KV;Donoghue JP;Hochberg LR
通讯作者：
Hochberg LR

Inferring single-trial neural population dynamics using sequential auto-encoders.

DOI：
10.1038/s41592-018-0109-9
发表时间：
2018-10
期刊：
Nature methods
影响因子：
48
作者：
Pandarinath C;O'Shea DJ;Collins J;Jozefowicz R;Stavisky SD;Kao JC;Trautmann EM;Kaufman MT;Ryu SI;Hochberg LR;Henderson JM;Shenoy KV;Abbott LF;Sussillo D
通讯作者：
Sussillo D