A prototype of a Japanese Sign Language Communication Agent Model based on Information Infrastructure

基于信息基础设施的日语手语交流代理模型原型

• 批准号: 08555094
• 负责人: YAMAGUCHI Toru
• 金额: $ 6.27万
• 依托单位: Utsunomiya University
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (A)
• 财政年份: 1996
• 资助国家: 日本
• 起止时间: 1996 至 1997
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-08555094/
• 关键词: Information Infrastructure; Japanese Sign Language Interface; Agent; Communication; Characteristic Expression Database; 手話; 知的システム; 対話

An interactive communication has been made possible by a rapid advance in Information Infrastructure. We constructed an interactive Japanese sign language interface using vocabulary specific to medical diagnoses and realized an online system which supports flexible communication between hearing people and deaf people. To realize this system, technical elements shown in the following items have been carried forward individually ; items 1-3 by Mr.Yamaguchi and item 4 by Mr.Kamata.1.Recognition of Japanese sign language movements2.Registration and learining if Japanese sign language movements3.Generation of Japanese sign language animation4.Construction of a characteristic expression database in Japanese sign languageThis year, we integrated the above-mentioned items 1-3 into one interactive Japanese sign language interface. In this system, a doctor's speech is displayd as animated Japanese sign language. Conversely, a patient's sign language is converted into Japanese script. In this way, this system supports a conversation between a doctor and a patient as if they were speaking to each other directly. We added two functions : first, a hand shape recognition to item 1 and second, a display which is easy to see for deaf people using creative thinking based on chaotic retrieval. And we have used the data available regarding item 4 for this system. As a result of these improvements, we have gotten better results of recognition and display than the previous system.

信息基础架构的快速进步使交互式通信成为可能。我们使用特定于医学诊断的词汇构建了一个互动的日本手语界面，并实现了一个在线系统，该系统支持听力人和聋人之间的灵活交流。为了实现这一系统，以下项目中显示的技术要素已单独运送； Yamaguchi先生的项目1-3和Kamata先生的项目4。在此系统中，医生的语音作为动画日语语言显示。相反，患者的手语将转换为日语脚本。这样，该系统支持医生和患者之间的对话，就好像他们直接互相说话一样。我们添加了两个功能：首先，在项目1和第二个功能中，一种显示的显示，对于聋人使用基于混乱的检索的创意思维而言，它很容易看到。我们已经使用了有关此系统项目4的可用数据。由于这些改进，与以前的系统相比，我们获得了更好的识别和显示结果。

项目成果

Xue-Bin LIANG: "Absolute Exponential Stability of Neural Networks with Asimmetric Connection Matrices" IEICE Trans.on Fundamentals. E80-A巻8号. 1531-1534 (1997)

梁学斌：“具有不对称连接矩阵的神经网络的绝对指数稳定性”IEICE Trans.on Fundamentals，卷 E80-A，第 8 期。1531-1534 (1997)

佐藤友彦: "階層的知識構造に基づく学習/適応機能を持った知的ロボット" 電気学会論文誌C. 116巻・12号. 1396-1406 (1996)

佐藤智彦：“基于分层知识结构的具有学习/自适应功能的智能机器人”日本电气工程师协会学报 C.第 116 卷，第 12 期。1396-1406 (1996)

T.Nishimoto: "Basic Study on the Interactive Assistive System for Sign Language Learning" Technical Report of IEICE. HCS97-3. (1997)

T.Nishimoto：《手语学习互动辅助系统基础研究》IEICE技术报告。

山下 真希: "日本手話表現の遷移動作特性に関する一考察" 信学技報. HCS97-24. 17-24 (1998)

Maki Yamashita：“日本手语表达的过渡行为特征的研究”IEICE 技术报告 17-24 (1998)。

山西 妙子: "専門用語学習のための手話映像辞書の試作" 映像情報メディア学会誌. 51巻6号. 896-902 (1997)

Taeko Yamanishi：“用于学习技术术语的手语视频词典的原型”图像信息和电视工程师学会杂志，第 51 卷，第 6 期。896-902（1997 年）。