CRCNS: Avian Model for Neural Activity Driven Speech Prostheses

CRCNS：神经活动驱动言语假肢的鸟类模型

• 批准号: 10408524
• 负责人: TIMOTHY Q GENTNER
• 金额: $ 21.93万
• 依托单位: UNIVERSITY OF CALIFORNIA, SAN DIEGO
• 依托单位国家: 美国
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-08-01 至 2024-07-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/10408524
• 关键词: Acoustics; Algorithms; Anatomy; Animals; Area; Artificial Intelligence; Basic Science; Behavior; Behavioral; Birds; Border Community; Brain; Brain region; Collection; Communication; Communities; Complement; Complex; Comprehension; Computer software; Data; Data Collection; Data Set; Development; Diagnosis; Disease; Educational workshop; Engineering; FAIR principles; Future; Goals; High School Student; Hour; Human; Individual; Infrastructure; Injury; Interdisciplinary Study; Knowledge; Language; Language Disorders; Larynx; Learning Module; Limb structure; Machine Learning; Maps; Measurement; Metadata; Modeling; Motor; Neurodegenerative Disorders; Neurons; Neurosciences; Online Systems; Outcome; Output; Performance; Prevention; Production; Prosthesis; Research; Resource Sharing; Running; Self-Examination; Self-Help Devices; Signal Transduction; Software Tools; Songbirds; Speech; Speech Development; Stimulus; Students; System; TRUST principles; Techniques; Technology; Testing; Time; Training; Translating; Translations; Validation; Visualization software; Voice; Work; base; brain computer interface; brain machine interface; cohort; community based research; data exploration; data repository; data reuse; data sharing; data tools; design; effectiveness testing; functional restoration; hackathon; improved; indexing; large datasets; large scale data; meetings; member; mind control; motor control; multidisciplinary; neural model; neural prosthesis; neurodevelopment; neurotransmission; nonhuman primate; novel; open source; parent project; prototype; relating to nervous system; software repository; success; terabyte; tool; undergraduate student; virtual; vocal learning; vocalization; webinar

Understanding the physical, computational, and theoretical bases of human vocal communication, speech, is crucial to improved comprehension of voice, speech and language diseases and disorders, and improving their diagnosis, treatment and prevention. Meeting this challenge requires knowledge of the neural and sensorimotor mechanisms of vocal motor control. Our project will directly investigate the neural and sensorimotor mechanisms involved in the production of complex, natural, vocal communication signals. Our results will directly enhance brain-computer interface technology for communication and will accelerate the development of prostheses and other assistive/augmentative technologies for individuals with communications deficits due to injury or disease. We will develop a vocal prosthetic that directly translates neural signals in cortical sensorimotor and vocal-motor control regions into vocal communication signals output in real-time. Building on success using non-human primates for brain computer interfaces for general motor control, the prosthetic will be developed in songbirds, whose acoustically rich, learned vocalizations share many features with human speech. Because the songbird vocal apparatus is functionally and anatomically similar to the human larynx, and the cortical regions that control it are closely analogous to speech motor-control areas of the human brain, songbirds offer an ideal model for the proposed studies. Beyond the application of our work to human voice and speech, development of the vocal prosthetic will enable novel speech-relevant studies in the songbird model that can reveal fundamental mechanisms of vocal learning and production. In the first stage of the project, we collect a large data set of simultaneously recorded neural activity and vocalizations. In stage two, we will apply machine learning and artificial intelligence techniques to develop algorithms that map neural recordings to vocal output and enable us to estimate intended vocalizations directly from neural data. In stage three, we will develop computing infrastructure to run these algorithms in real-time, predicting intended vocalizations from neural activity as the animal is actively producing these vocalizations. In stage four, we will test the effectiveness of the prosthetic by substituting the bird’s own vocalization with the output from our prosthetic system. Success will set the stage for testing of these technologies in humans and translation to multiple assistive devices. In addition to our research goals, the project will engage graduate, undergraduate, and high school students through the development of novel educational modules that introduce students to brain machine interface and multidisciplinary studies that span engineering and the basic sciences.

了解人声的身体，计算和理论基础 沟通，言语，对于改善语音，语音和语言的理解至关重要 疾病和疾病，改善其诊断，治疗和预防。满足这个 挑战需要了解声带控制的神经和感觉运动机制。 我们的项目将直接研究与该项目有关的神经和感觉运动机制 生产复杂，自然的声音交流信号。我们的结果将直接增强 用于通信的大脑计算机接口技术，并将加速 假体和其他辅助/增强技术 由于受伤或疾病而导致的缺陷。我们将开发一种直接翻译中性的人声假肢 皮层感觉运动和声音控制区域中的信号进入声音交流信号 实时输出。在成功的基础上使用非人类隐私进行大脑计算机接口 对于一般运动控制，假肢将在鸣禽中开发 博学的发声与人类言语具有许多功能。因为鸣禽的声音 设备在功能和解剖学上与人喉和皮质区域相似 控制它与人脑的语音运动控制区密切相似，歌手 为拟议的研究提供理想的模型。除了我们的作品对人类声音的应用之外 和言语，发声假体的发展将使与语音相关的新研究在 可以揭示声带学习和生产的基本机制的鸣禽模型。在 该项目的第一阶段，我们收集了大量的数据集，简单地记录了神经活动和 发声。在第二阶段，我们将将机器学习和人工智能技术应用于 开发将神经记录映射到人声输出并使我们能够估算预期的算法 直接来自神经数据的发声。在第三阶段，我们将开发计算基础架构 实时运行这些算法，预测神经活动的预期发声 动物正在积极产生这些发声。在第四阶段，我们将测试 假肢通过将鸟自己的发声替换为我们的假肢系统的产出。 成功将为在人类中测试这些技术的测试奠定阶段，并将其转换为多个 辅助设备。除了我们的研究目标外，该项目还将参与毕业生， 通过开发新型教育模块，本科生和高中生 向学生介绍了跨越大脑机器界面和多学科研究 工程和基本科学。