EAPSI: Audio Attendant: A User Interface for Learning Peripheral Sounds

EAPSI：音频助理：用于学习外围声音的用户界面

• 批准号: 1614291
• 负责人: Kristin Williams
• 金额: $ 0.54万
• 依托单位: Williams Kristin
• 依托单位国家: 美国
• 项目类别: Fellowship Award
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-06-15 至 2017-05-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1614291&HistoricalAwards=false
• 关键词: EAPSI; Audio; Attendant; User; Interface

The Korean orthography makes clear the relationship between written and spoken language to facilitate phonological decoding of its written form. When a person learns a language, they learn to represent the sounds of the language in meaningful categories. Insofar as dyslexia is a struggle with mapping sounds to their written form, the expression of dyslexia in the Korean language is likely to differ significantly from other languages such as English or Spanish. This project proposes to design and create a user interface accessible in a mobile context that facilitates phonological awareness in the Korean language. The research will be performed in collaboration with Dr. Joonhwan Lee of the Human Computer Interaction and Design Lab at Seoul National University in Korea. The project will inform development of a lightweight dyslexia screener that could be deployed by nonexperts (for free or minimal cost) from around the world to support access to needed resources for a person with dyslexia. The work will advance research areas as language-based assistive technology, human-computer interaction for individuals with cognitive disabilities, and crowdsourcing and will contribute to identifying individuals with dyslexia irrespective of their native language to help make the web accessible to persons with language impairments from around the world.Prior work highlights a role for a system that can help a person implicitly learn sound categories that are specific to a target language, though may not be at the center of a person?s attention or part of their lexicon. This project will investigate how auditory cues can be integrated in a contextually appropriate manner when balancing cues with attending to conversation. Building on Edge, et al., we will extend contextual vocabulary learning of a target language to contextual learning of sound categories. We will determine what sound categories should be acquired by adapting a scoring system of importance that has been found to work well for dynamic visual displays when driving, to an auditory attention service that reflects the learner?s goals and contextual importance. Finally, we will design and create a user interface for learning contextual audio categories based off this prior work to be used in a mobile setting during conversation.This award under the East Asia and Pacific Summer Institutes program supports summer research by a U.S. graduate student and is jointly funded by NSF and the National Research Foundation of Korea.

韩国拼字法清楚地表明了书面语言和口语之间的关系，以促进其书面形式的语音解码。当一个人学习一种语言时，他们会学会在有意义的类别中代表语言的声音。就阅读障碍而言，在将声音映射到书面形式的情况下，韩语阅读障碍的表达可能与其他语言（例如英语或西班牙语）有很大差异。该项目建议在移动环境中设计和创建可访问的用户界面，以促进韩语语言的语音意识。 该研究将与韩国首尔国立大学人类计算机互动和设计实验室的Joonhwan Lee博士合作进行。该项目将为您可以从世界各地提供的非智商（免费或最低成本）部署的轻质阅读障碍筛查器提供信息，以支持患有阅读障碍的人所需的资源。这项工作将在基于语言的辅助技术，对认知障碍的人的人力计算以及众包的互动中推进研究领域，并将有助于确定患有阅读障碍的人，无论其母语如何帮助使世界上的语言障碍的人能够帮助某种人物的角色，以使某人的角色符合某种构成的目标，虽然可以使某人的角色涉及某种障碍，虽然可以使某人的角色具有特定的范围，但仍能在某种程度上涉及，虽然可以使某种含义的依据，虽然是一个与众不同的人，虽然是一个有影响力的人，虽然是一个构成的目标，而不是一个构成的目标。人的注意力或词典的一部分。该项目将调查如何在平衡线索与进行对话的情况下平衡线索时如何以适当的方式集成听觉线索。在Edge等人的基础上，我们将把目标语言的上下文词汇学习扩展到声音类别的上下文学习。我们将通过调整评分的重要性系统来确定应该获得哪些声音类别，该系统在开车时发现对动态视觉显示功能非常有效，以反映出学习者的目标和上下文重要性的听觉注意力服务。 最后，我们将设计并创建一个用户界面，以学习基于在对话期间在移动环境中使用的这项先前工作的上下文音频类别。在东亚和太平洋夏季学院计划下，该奖项支持美国研究生的夏季研究，并由NSF和NSF和韩国国家研究基金会共同资助。