Fundamentals Studies about Recognition Mechanism Analysis for a Description Method of Sign language as Interaction Language

手语作为交互语言的描述方法的识别机制分析基础研究

基本信息

批准号：
14208030
负责人：
NAGASHIMA Yuji
金额：
$ 33.03万
依托单位：
KOGAKUIN UNIVERSITY
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research (A)
财政年份：
2002
资助国家：
日本
起止时间：
2002 至 2005
项目状态：
已结题

项目摘要

A purpose of this research is scientifically clarify the mechanism of a linguistic function of a non-manual signals and a recognition function for communication of sign language. I got the following main result by this research through a research period.1.In analysis of mechanism of the recognition, I have analyzed a meaning processing process based on a event-related potential N400 measurement. As a result, because it is understood that N400 is observed in semantic congruity sentence by sign language and the character, and the potential is large in the character stimulation, and was shown the difference of the processing process by the presentation modality.2.In analysis support system, we have been constructing synchronous input and analysis system for video image and motion-captured data such as location and orientation of the hands and head in relation of the magnetic source. Simultaneously, we have been measuring hands configuration by gloved type sensors. As a result of using thi … More s system in actual analysis, it has solved the various kinds of problems that depended on visual inspection.3.In description method, it strengthened a description function of a non-finger signal of a hierarchical morpheme NVGS model of sign language.4.In analysis of conversation model, it was defining the lower limit of detection (LLD) of delay in sign conversation. Evaluation of the effect of delay was carried out by double stimulus impairment scale method (DSIS). The results showed that LLD of alternate counting was 100 msec, and LLD of "summing numbers" was 200 msec. Ceneralizing the results obtained so far, it is concluded that dialogue by sign language in more tolerant than speech dialogue.5.In low-bit rate digital encoding of moving picture of sign language, a new encoding method suitable for sign language is presented based on above mentioned characteristics of sign language. As a result, an encoding image data using our proposed method is more possible at a low bit rate in comparison with an existing method.This research purpose and the execution plan were almost achieved as above. In addition, results of research are presented in Journal and Transaction of IEICE, Journal and Transactions of Human Interface Society, Journal of IEE, International Conference, etc.I feel necessity to develop this research. On the basis of result of this research, I continue analysis work from the side of cognitive science through conversation analysis of sign language. Less

这项研究的目的是科学阐明了非人工信号的语言功能的机制，以及识别手语的识别功能。 1.在识别机制的分析中，我通过事件相关的潜在n400测量分析了意义处理过程。 As a result, because it is understood that N400 is observed in semantic congruity Sentence by sign language and the character, and the potential is large in the character stimulation, and was shown the difference of the processing process by the presentation modality.2.In analysis support system, we have been constructing synchronous input and analysis system for video image and motion-captured data such as location and orientation of the hands and head in relation of the magnetic source.同时，我们一直在通过手套型传感器测量手构型。由于在实际分析中使用了更多的系统，它解决了取决于视觉检查的各种问题。3。在描述方法中，它增强了指示语言层次词素NVGS模型的非手指信号的描述功能。4。在对话模型的分析中，它确定了延迟延迟对话的降低（LLD）。通过双刺激损伤量表方法（DSIS）进行延迟效应的评估。结果表明，替代计数的LLD为100毫秒，“求和数”的LLD为200毫秒。迄今为止获得的结果，得出的结论是，与语音对话更宽容地通过手语对话。5.IN低位率数字编码手语的动态图片，一种适用于手语的新编码方法是基于上述手语的特征来提出的。结果，与现有方法相比，使用我们提出的方法的编码图像数据更有可能以较低的比率。此研究目的和执行计划几乎如上所述。此外，研究结果在IEICE的期刊和交易，人类界面协会期刊和交易中，IEE期刊，国际会议等。我认为开发这项研究必不可少。根据这项研究的结果，我通过对手语的对话分析从认知科学的一边进行分析工作。较少的