CRCNS: Avian Model for Neural Activity Driven Speech Prostheses

CRCNS：神经活动驱动言语假肢的鸟类模型

基本信息

批准号：
10671028
负责人：
TIMOTHY Q GENTNER
金额：
$ 31.1万
依托单位：
UNIVERSITY OF CALIFORNIA, SAN DIEGO
依托单位国家：
美国
项目类别：
财政年份：
2019
资助国家：
美国
起止时间：
2019-08-01 至 2024-07-31
项目状态：
已结题

来源：
https://reporter.nih.gov/project-details/10671028
关键词：
Acceleration Acoustics Algorithms Anatomy Animal Model Animals Area Artificial Intelligence Basic Science Behavior Behavioral Birds Brain Cell Nucleus Characteristics Clinical Research Clinical assessments Communication Communities Complement Complex Comprehension Computer Interface Computer software Computers Course Content Data Data Science Data Set Development Diagnosis Disease Educational Materials Educational workshop Electrodes Engineering Evaluation Feedback Finches Future Generations Goals High School Outreach High School Student Human Implant Individual Infrastructure Injury Instruction Knowledge Language Language Disorders Larynx Learning Learning Module Limb Prosthesis Limb structure Limes Machine Learning Maps Methods Modeling Motor Motor Cortex Neurodegenerative Disorders Neurosciences Outcome Measure Output Patients Performance Play Prevention Principal Investigator Production Prosthesis Quadriplegia Recording of previous events Research Robot Role Running Self-Help Devices Signal Transduction Songbirds Space Models Speech Speech Development Students System Techniques Technology Testing Time Translating Translations Upper Extremity Voice Work auditory feedback base bird song brain computer interface brain machine interface data sharing design effectiveness testing functional electrical stimulation functional restoration graduate student hackathon high school human subject improved large datasets machine learning algorithm meetings mind control model development motor control multidisciplinary neural neural model neural prosthesis neurodevelopment neurophysiology neurotransmission nonhuman primate novel open source operation programs repository response signal processing success undergraduate student vocal learning vocalization web site

项目摘要

Understanding the physical, computational, and theoretical bases of human vocal communication, speech, is crucial to improved comprehension of voice, speech and language diseases and disorders, and improving their diagnosis, treatment and prevention. Meeting this challenge requires knowledge of the neural and sensorimotor mechanisms of vocal motor control. Our project will directly investigate the neural and sensorimotor mechanisms involved in the production of complex, natural, vocal communication signals. Our results will directly enhance brain-computer interface technology for communication and will accelerate the development of prostheses and other assistive technologies for individuals with communications deficits due to injury or disease. We will develop a vocal prosthetic that directly translates neural signals in cortical sensorimotor and vocal-motor control regions into vocal communication signals output in real-time. Building on success using non-human primates for brain computer interfaces for general motor control, the prosthetic will be developed in songbirds, whose acoustically rich, learned vocalizations share many features with human speech. Because the songbird vocal apparatus is functipnally and anatomically similar to the human larynx, and the cortical regions that control it are closely analogous to speech motor-control areas of the human brain, songbirds offer an ideal model for the proposed studies. Beyond the application of our work to human voice and speech, development of the vocal prosthetic will enable novel speech-relevant studies in the songbird model that can reveal fundamental mechanisms of vocal learning and production. In the first stage of the project, we collect a large data set of simultaneously recorded neural activity and vocalizations. In stage two, we will apply machine learning and artificial intelligence techniques to develop algorithms that map neural recordings to vocal output and enable us to estimate intended vocalizations directly from neural data. In stage three, we will develop computing infrastructure to run these algorithms in real-time, predicting intended vocalizations from neural activity as the animal is actively producing these vocalizations. In stage four, we will test the effectiveness of the prosthetic by substituting the bird's own vocalization with the output from our prosthetic system. Success will set the stage for testing of these technologies in humans and translation to multiple assistive devices. In addition to our research goals, the project will engage graduate, undergraduate, and high school students through the development of novel educational modules that introduce students to brain machine interface and multidisciplinary studies that span engineering and the basic sciences. RELEVANCE (See instructions): Developing a vocal prosthesis will directly enhance brain-computer interface technology for communication and accelerate the realization of prostheses and other assistive technologies for individuals with communications deficits due to injury or disease. The basic knowledge of the neural and sensorimotor mechanisms of vocal motor control acquired will impact understanding of multiple voice, speech, and language diseases and disorders. The techniques developed will enabling novel future studies of vocal production and development.

了解人声交流，语音，言语的物理，计算和理论基础，对于改善语音，语音和语言疾病和疾病的理解至关重要，以及改善其诊断，治疗和预防。应对这个挑战需要了解声带控制的神经和感觉运动机制。我们的项目将直接调查神经以及与复杂，自然声音交流的生产有关的感觉运动机制信号。我们的结果将直接增强用于通信的大脑计算机界面技术，并将加快为患有个人的个人和其他辅助技术的发展由于受伤或疾病而导致的通信缺陷。我们将开发直接翻译的人声假肢皮层感觉运动和声音控制区域中的神经信号进入声音传播信号实时输出。在成功的基础上使用非人类灵长类动物用于大脑计算机接口普通运动控制，假肢将在鸣禽中开发，他们的听觉丰富，学会了发声与人类言语具有许多功能。因为鸣禽的声乐设备是功能性和解剖学上与人喉的相似，并且控制其紧密的皮质区域类似于人脑的语音运动控制区域，鸣禽为拟议的研究。除了我们的作品在人类的声音和言语中的应用之外，人声假肢将在鸣禽模型中实现与语音相关的研究，以揭示声乐学习和生产的基本机制。在项目的第一阶段，我们收集了大量数据集同时记录了神经活动和发声。在第二阶段，我们将申请机器学习和人工智能技术以开发将神经记录映射到的算法声音输出并使我们能够直接从神经数据中估算预期的发声。在第三阶段，我们将开发计算基础架构实时运行这些算法，以预测预期的发声从神经活动中，动物正在积极产生这些发声。在第四阶段，我们将测试假肢的有效性通过将鸟自己的发声代替我们的假肢产量系统。成功将为在人类中测试这些技术的测试奠定阶段，并将其转换为多个辅助设备。除了我们的研究目标外，该项目还将吸引研究生，本科生和高中生通过开发新颖的教育模块，向学生介绍跨越工程和基本科学的脑机界面和多学科研究。相关性（请参阅说明）：开发声乐假体将直接增强用于通信的脑部计算机界面技术并加快为具有由于受伤或疾病而导致的通信缺陷。神经和感觉运动的基本知识获得的声音电动机控制机制将影响对多种语音，语音和的理解语言疾病和疾病。所开发的技术将使人声的未来研究生产和发展。