A Study of Interactive Electronic Dictionary System Construction Based on Automatic Synthesis Function of Sign Language Articulators

基于手语发音器自动合成功能的交互式电子词典系统构建研究

基本信息

批准号：
11680399
负责人：
NAGASHIMA Yuji
金额：
$ 2.24万
依托单位：
Kogakuin University
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research (C)
财政年份：
1999
资助国家：
日本
起止时间：
1999 至 2001
项目状态：
已结题

项目摘要

It is for a purpose of this research to construct an electronic dictionary system supporting multi-media. Function of this electronic dictionary is automatic generation of an animated image. An articulator of the animated image attached with mouth shape satisfies syntagmatic structure. In this research, I examined it in each function of sign language conversation corpus part, linguistic analysis part, articulation generation part, image database part on construction of electronic dictionary system by 3D animation through research period.1. In sign language conversation corpus part, I examined proposed in the corpus collection method which removed influence from Japanese. With the data collection method which I proposed, I chose 994 sign words from KOSIGN Ver.2 and had been collection and a video recording of about 3,800 sign language conversation corpus. Furthermore, I constructed support system to analyze segmentation of sign conversation video image. This system is able to easily set … More a tag in various analyses item with frame unit on its sheet.2. In language analysis part, I analyzed a sign language conversation corpus with this analysis support system. The analysis subject matter is extract of distinctive feature and a morpheme of sign language. I proposed of NVGS morpheme descriptive model of sentence level from an analysis result.3. In animated image generation part, I proposed in the method that generated an articulator of an animated image from description. The articulator described language construction by NVGS morpheme model with sIGNDEX for non-manual signals. Furthermore, this system has 15 basic mouth-shaped function to generate to improve recognition accuracy of a sign language animated image.4. In electronic dictionary part, I constructed an interactive sign language electronic dictionary. In this dictionary, there are sign language example sentences database retrieval function and an animated image with the mouth shape generated function. In addition, total vocabulary number of this dictionary is 1,142 sign words.This research purpose and the execution plan were almost achieved as above. In addition, results of research are presented in Journal of IEICE, Transactions of Human Interface Society, International Conference, etc. " Construction of the Mouth Shape Animation System" (HIS2000) of these result got the sciences encouragement prize from Human Interface Society in March 2001.I feel necessity to develop this research. On the basis of result of this research, I continue analysis work from the side of cognitive science through conversation analysis of sign language. Less

这是为了支持多媒体的电子词典，我的动画形象是用口腔射击结构的。图像数据库部分通过3D动画进行了电子词典的研究。符号Ver.2的单词是收集的，并且是大约3,800个手语对话的视频录制。 t。在动画图像生成部分中，我从描述中生成了动画图像的坦诚。提高识别精度的动画图像。4。国际会议等。“嘴巴形状动画系统的限制”（其中2000年的HIS2000在2001年3月获得了LOM人界面协会。这是这项研究的结果，我通过对认知科学的一方进行了整体分析，通过对话分析。手语少