AR/MR software for improving communication and education outcomes of minimally verbal autistic people

AR/MR 软件可改善语言能力极低的自闭症患者的沟通和教育成果

• 批准号: 571326-2021
• 负责人: Krishnamurthy, DiwakarD
• 金额: $ 3.64万
• 依托单位: University of Calgary
• 依托单位国家: 加拿大
• 项目类别: Alliance Grants
• 财政年份: 2022
• 资助国家: 加拿大
• 起止时间: 2022-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=751867
• 关键词: AR; MR; software; improving; communication

There are at least 3 million autistic children and adults in North America alone who cannot communicate effectively using speech. Not being able to share their thoughts, beliefs, and desires is arguably the most significant aspect of their disability, severely limiting their ability to participate in educational, social, employment, and community settings. Additionally, the financial impact of autism is immense. Studies suggest that in Canada the total direct medical, non-medical, and loss of productivity costs associated with autism are at least $30 billion annually. Thus, offering minimally verbal autistic individuals effective alternative ways of communication can have transformative socio-economic impacts. Unfortunately, most existing communication interventions have been shown to be ineffective. One limitation of traditional approaches to communication interventions is that they do not account for the significant motor and sensory challenges that many minimally verbal autistic individuals face. For example, producing intelligible speech requires the precise motor coordination of the vocal apparatus. As a result, minimally verbal autistic individuals may be better able to learn how to communicate in other ways, including written form. This project is developing new software solutions based on Augmented/Mixed Reality (AR) technologies to improve communication and education outcomes for this population. The key innovation is the design of an immersive system that systematically improves motor, i.e., pointing, skills of minimally verbal individuals whilst engaging them with challenging, age-appropriate educational material and literacy activities. The system will leverage wearable sensors to monitor the stress levels of individuals and tailor the virtual environment with accommodations to address sensory challenges. The software arising out of this project will enable minimally verbal individuals to communicate fluently by pointing at letters. This would open educational, social, and employment opportunities that most autistic individuals are never afforded. This will in turn lead to better inclusion and considerable economic benefits.

仅在北美，至少有300万自闭症儿童和成人无法有效地使用语音进行沟通。无法分享他们的思想，信念和欲望可以说是他们残疾的最重要方面，严重限制了他们参与教育，社会，就业和社区环境的能力。此外，自闭症的财务影响是巨大的。研究表明，在加拿大，与自闭症相关的直接医疗，非医疗和生产率损失每年至少为300亿加元。因此，提供最小口头自闭症的人有效的替代沟通方式可以产生变革性的社会经济影响。不幸的是，大多数现有的通信干预措施已被证明是无效的。 传统方法进行交流干预措施的一种局限性是，它们不考虑许多最小口头自闭症患者所面临的重大运动和感官挑战。例如，产生可理解的语音需要声乐器的精确运动协调。结果，最小口头的自闭症患者可能会更好地学习如何以其他方式（包括书面形式）进行交流。该项目正在开发基于增强/混合现实（AR）技术的新软件解决方案，以改善该人群的沟通和教育成果。关键的创新是系统的设计，该系统系统地改善了运动，即指向，最少口头的人的技能，同时让他们参与具有挑战性的，适合年龄的教育材料和识字活动。该系统将利用可穿戴的传感器来监视个人的压力水平，并通过适应性来量身定制虚拟环境，以应对感官挑战。该项目产生的软件将使最低限度地说话的人通过指向信件来流利地交流。 这将开放大多数自闭症患者永远无法提供的教育，社会和就业机会。反过来，这将带来更好的包容性和可观的经济利益。