CRCNS: Avian Model for Neural Activity Driven Speech Prostheses

CRCNS：神经活动驱动言语假肢的鸟类模型

基本信息

批准号：
10671028
负责人：
TIMOTHY Q GENTNER
金额：
$ 31.1万
依托单位：
UNIVERSITY OF CALIFORNIA, SAN DIEGO
依托单位国家：
美国
项目类别：
财政年份：
2019
资助国家：
美国
起止时间：
2019-08-01 至 2024-07-31
项目状态：
已结题

来源：
https://reporter.nih.gov/project-details/10671028
关键词：
Acceleration Acoustics Algorithms Anatomy Animal Model Animals Area Artificial Intelligence Basic Science Behavior Behavioral Birds Brain Cell Nucleus Characteristics Clinical Research Clinical assessments Communication Communities Complement Complex Comprehension Computer Interface Computer software Computers Course Content Data Data Science Data Set Development Diagnosis Disease Educational Materials Educational workshop Electrodes Engineering Evaluation Feedback Finches Future Generations Goals High School Outreach High School Student Human Implant Individual Infrastructure Injury Instruction Knowledge Language Language Disorders Larynx Learning Learning Module Limb Prosthesis Limb structure Limes Machine Learning Maps Methods Modeling Motor Motor Cortex Neurodegenerative Disorders Neurosciences Outcome Measure Output Patients Performance Play Prevention Principal Investigator Production Prosthesis Quadriplegia Recording of previous events Research Robot Role Running Self-Help Devices Signal Transduction Songbirds Space Models Speech Speech Development Students System Techniques Technology Testing Time Translating Translations Upper Extremity Voice Work auditory feedback base bird song brain computer interface brain machine interface data sharing design effectiveness testing functional electrical stimulation functional restoration graduate student hackathon high school human subject improved large datasets machine learning algorithm meetings mind control model development motor control multidisciplinary neural neural model neural prosthesis neurodevelopment neurophysiology neurotransmission nonhuman primate novel open source operation programs repository response signal processing success undergraduate student vocal learning vocalization web site

项目摘要

Understanding the physical, computational, and theoretical bases of human vocal communication, speech, is crucial to improved comprehension of voice, speech and language diseases and disorders, and improving their diagnosis, treatment and prevention. Meeting this challenge requires knowledge of the neural and sensorimotor mechanisms of vocal motor control. Our project will directly investigate the neural and sensorimotor mechanisms involved in the production of complex, natural, vocal communication signals. Our results will directly enhance brain-computer interface technology for communication and will accelerate the development of prostheses and other assistive technologies for individuals with communications deficits due to injury or disease. We will develop a vocal prosthetic that directly translates neural signals in cortical sensorimotor and vocal-motor control regions into vocal communication signals output in real-time. Building on success using non-human primates for brain computer interfaces for general motor control, the prosthetic will be developed in songbirds, whose acoustically rich, learned vocalizations share many features with human speech. Because the songbird vocal apparatus is functipnally and anatomically similar to the human larynx, and the cortical regions that control it are closely analogous to speech motor-control areas of the human brain, songbirds offer an ideal model for the proposed studies. Beyond the application of our work to human voice and speech, development of the vocal prosthetic will enable novel speech-relevant studies in the songbird model that can reveal fundamental mechanisms of vocal learning and production. In the first stage of the project, we collect a large data set of simultaneously recorded neural activity and vocalizations. In stage two, we will apply machine learning and artificial intelligence techniques to develop algorithms that map neural recordings to vocal output and enable us to estimate intended vocalizations directly from neural data. In stage three, we will develop computing infrastructure to run these algorithms in real-time, predicting intended vocalizations from neural activity as the animal is actively producing these vocalizations. In stage four, we will test the effectiveness of the prosthetic by substituting the bird's own vocalization with the output from our prosthetic system. Success will set the stage for testing of these technologies in humans and translation to multiple assistive devices. In addition to our research goals, the project will engage graduate, undergraduate, and high school students through the development of novel educational modules that introduce students to brain machine interface and multidisciplinary studies that span engineering and the basic sciences. RELEVANCE (See instructions): Developing a vocal prosthesis will directly enhance brain-computer interface technology for communication and accelerate the realization of prostheses and other assistive technologies for individuals with communications deficits due to injury or disease. The basic knowledge of the neural and sensorimotor mechanisms of vocal motor control acquired will impact understanding of multiple voice, speech, and language diseases and disorders. The techniques developed will enabling novel future studies of vocal production and development.

了解人类声音交流、语音、对于提高对声音、言语和语言疾病和障碍的理解至关重要，并且改善他们的诊断、治疗和预防。应对这一挑战需要了解发声运动控制的神经和感觉运动机制。我们的项目将直接研究神经网络和感觉运动机制参与复杂、自然、声音交流的产生信号。我们的成果将直接增强脑机接口通信技术，并将加速为患有此类疾病的人开发假肢和其他辅助技术由于受伤或疾病而导致的沟通障碍。我们将开发一种可以直接翻译的发声假肢皮质感觉运动和发声运动控制区域的神经信号转化为发声通讯信号实时输出。建立在使用非人类灵长类动物脑机接口成功的基础上一般运动控制，假肢将在鸣禽身上开发，它们的声音丰富，学识渊博发声与人类言语有许多共同特征。因为鸣禽的发声器官是功能和解剖学上与人类喉部相似，并且控制它的皮质区域也密切相关与人脑的言语运动控制区域类似，鸣禽为大脑提供了一个理想的模型。拟议的研究。除了我们的工作应用于人类声音和言语之外，声乐假肢将使鸣禽模型中与言语相关的新研究成为可能，该研究可以揭示声音学习和产生的基本机制。在项目的第一阶段，我们收集了同时记录的神经活动和发声的大数据集。在第二阶段，我们将申请机器学习和人工智能技术来开发将神经记录映射到的算法声音输出并使我们能够直接从神经数据估计预期的发声。在第三阶段，我们将开发计算基础设施来实时运行这些算法，预测预期的发声来自动物积极发出这些声音时的神经活动。在第四阶段，我们将测试通过用我们假肢的输出代替鸟自己的发声来验证假肢的有效性系统。成功将为这些技术在人类身上的测试和转化为多种技术奠定基础。辅助设备。除了我们的研究目标外，该项目还将吸引研究生、本科生和高中生通过开发新颖的教育模块向学生介绍脑机接口和跨越工程和基础科学的多学科研究。相关性（参见说明）：开发发声假体将直接增强脑机接口通信技术并加速为患有此类疾病的人提供假肢和其他辅助技术由于受伤或疾病而导致的沟通障碍。神经和感觉运动的基础知识获得的发声运动控制机制将影响对多种声音、言语和语言的理解语言疾病和障碍。开发的技术将使声乐的新颖的未来研究成为可能生产和开发。