Research on communicational support by sign language for the Hearing Disabled from a cognitive scientific perspective

认知科学视角下听力障碍者手语沟通支持研究

基本信息

批准号：
16091103
负责人：
NAGASHIMA Yuji
金额：
$ 1.92万
依托单位：
Kogakuin University
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research on Priority Areas
财政年份：
2004
资助国家：
日本
起止时间：
2004 至 2006
项目状态：
已结题

项目摘要

The hearing impairment group has aimed at the communication support using information-and-communication terminals for the hearing impaired people. It has also aimed at the research and development of systems for recognition, generation, coding, and transmission in the view point of engineering and cognitive science, together with fundamental technologies for their support. We have proposed ways of the communication support necessary for the hearing impaired, based on their needs that we have investigated.The hearing impairment group has four subgroups for: sign language perception and coding, sign language animation generation, sign language recognition, and investigation of the hearing impaired people's needs.We have set up the extended hearing impairment working group along with the visual impairment group, which has analyzed phonemes of oral languages in detail. Holding several meetings and work camps, the working group has worked on the development of sIGNDEX V3, which plans to tackle the problems of distinctive features, phonemes, and morphemes of Japanese Sign Language, utilizing the outcomes of sIGNDEX V2. We have so far determined how to describe the distinctive features, and how to extract the morphemes. We continue this working group next year.We have also worked on a problem of mental workload, which is mental stress that sign language users undergo during interactive communication. We have found that NASA-TLX is effective enough for measuring the degree of mental workload.Our findings will appear in journals such as the one of the Institute of Electronics, Information and Communication Engineering, and the one of Human Interface Society.The four subgroups continue to work on how to share their data, to unite the evaluation methods, and to coordinate the tasks of the subgroups.

听力障碍小组针对听力障碍者的信息和通信终端旨在进行沟通支持。它还针对工程和认知科学的识别，生成，编码和传播系统的研究和开发，以及基本技术的支持。根据我们已经调查的需求，我们提出了听力障碍所必需的沟通支持方法。听力障碍小组有四个子组：手语感知和编码，手语动画的生成，手语识别以及对听力障碍人们的需求。我们与视觉障碍小组建立了扩展的听力障碍工作组，该小组已详细分析了口服语言的音素。该工作组举行了几次会议和工作营，一直致力于SignDex V3的开发，该公司计划利用SignDex V2的结果来解决日本手语的独特功能，音素和词素的问题。到目前为止，我们已经确定了如何描述独特的特征以及如何提取词素。我们明年继续这个工作组。我们还致力于精神工作量的问题，这是在互动交流期间征兆语言使用者的心理压力。我们发现，NASA-TLX足以衡量心理工作的程度。我们的发现将出现在电子，信息和通信工程研究所之一等期刊中，以及人类界面社会之一。继续致力于如何共享他们的数据，团结评估方法并协调子组的任务。