Developping a system for dialog support to the hard of hearing via speech recognition and character display

开发一个通过语音识别和字符显示为听力障碍人士提供对话支持的系统

• 批准号: 18500127
• 负责人: FUNADA Tetsuo
• 金额: $ 0.82万
• 依托单位: Kanazawa University
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (C)
• 财政年份: 2006
• 资助国家: 日本
• 起止时间: 2006 至 2007
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-18500127/
• 关键词: the hard of hearing; dialog support system; speech recognition; noisy environment; reliability

This research is to develop a dialog support system for persons such as age-related hearing loss via speech recognition and character display. For this purpose, the system is expected to be small and light. At the beginning of this research, we intended to design the system with combining custom ISI and micro-displays. However since mobile computers with a built-in microphone recently have come onto the market, we changed to implement the system on a mobile computer.At the beginning in 2006, the system was designed to recognize only the pre-registered words, so it shows inconvenience that unregistered words cannot be recognized. Therefore, we improved the system by making it recognize all Japanese 101 syllables (kana). In this case, dialog partner has to speak syllable by syllable and the system display the recognized syllables one after another. It has also inconvenience that the system can display contents of dining by a sequence of only kana character so difficult to read fir the haul of hearing.In 2007, we improved the system in the following three points. The first is to decrease recognition error by incorporating new algorithm to extract noise-robust speech feature proposed by us. The second is to incorporate the "kana to Chinese character conversion" in the system, the command of which is also ordered by speech The third is to make the system display the ascend candidate of recognition, and can select the second one in case of mis-recognition of the first candidate. This selection command is also acceptable by speech. By making the system be possible to operate only by speech command, it has become convenient to use.Further improvement is desired in recognition speed and recognition error.Parts of these results have been presented at technical committee on speech of Acoustic Society of Japan and the Institute of Electronics, Intimation and Communication Engineers, and International Workshop on Communication and Information Technologies (ICSIT07).

这项研究是为了通过语音识别和角色显示，为与年龄相关的听力损失等人开发对话支持系统。为此，预计该系统将很小且轻巧。在这项研究开始时，我们打算通过将自定义ISI和微型播放组合设计该系统。但是，由于最近具有内置麦克风的移动计算机进入了市场，因此我们更改为在移动计算机上实现系统。在2006年开始，该系统旨在仅识别预注册的单词，因此显示出不便，无法识别未注册的单词。因此，我们通过识别所有日本101个音节（KANA）来改进系统。在这种情况下，对话框合作伙伴必须通过音节讲音节，并且该系统接一个地显示识别的音节。不便之处，系统可以通过一系列仅限的卡纳角色来显示餐饮内容，因此很难读取听力的牵引。在2007年，我们在以下三个点中改进了系统。首先是通过合并新算法来提取我们提出的噪声般的语音特征来减少识别误差。第二个是将“ KANA至中文角色转换”纳入系统，其命令也按语音订购，第三个是使系统显示为识别的上升候选人，并且可以在不认识第一个候选人的情况下选择第二个。该选择命令也可以通过语音接受。通过使系统仅通过语音命令进行操作，它已变得方便使用。在识别速度和识别错误中需要改进这些结果。这些结果的部分已在日本声学学会技术委员会以及电子，观察和通信工程师研究所以及有关通信和信息技术的国际讲习班的技术委员会上提出。

项目成果

A consideration on extracting temporal feature of Spectrum for speech recognition

语音识别中频谱时间特征提取的思考

• 发表时间: 2007
• 作者: Megumi;Umeno
• 通讯作者: Umeno

音声認識のためのスペクトルの時間変化を表す特徴量抽出についての検討

语音识别中表示频谱时间变化的特征提取研究

• 发表时间: 2007
• 作者: 木下浩二;村上研二;Seiichi Uchida;梅野 恵
• 通讯作者: 梅野 恵

短時間パワースペクトルの時間・周波数傾斜の3値化に基づく音声特徴量を用いた音声認識

使用基于短期功率谱的时间和频率斜率三值化的语音特征的语音识别

• 发表时间: 2006
• 期刊: 電子情報通信学会音声研究会技術研究報告 SP2006-31
• 作者: Tohgoroh Matsui;Hayato Ohwada;Kazuyuki Kuchitsu.;池田晃;山崎敦;影山勝彦;冨樫由美子;Shinichiro Omachi;岩村雅一;内田誠一;大町真一郎;Kazuya Negishi;Katsuhiko Kageyama;根岸和也;Koichi Kise;Shinichiro Omachi;Seiichi Uchida;大町真一郎;堀内 真;岩村雅一;古谷嘉男;古谷嘉男;田中一弘;Megumi Sakai;古谷嘉男;岩村雅一;Yoshio Furuya;梅野 恵;Masakazu Iwamura;黒田 弥文;古谷嘉男;梅野 恵
• 通讯作者: 梅野 恵

スペクトル傾斜の3値化に基づく特徴量を用いた雑音下単語認識システム

基于谱斜率三值化特征的噪声词识别系统

• 发表时间: 2007
• 期刊: 日本音響学会研究発表会講演論文集 2007春季(CD-ROM)
• 作者: Tohgoroh Matsui;Hayato Ohwada;Kazuyuki Kuchitsu.;池田晃;山崎敦;影山勝彦;冨樫由美子;Shinichiro Omachi;岩村雅一;内田誠一;大町真一郎;Kazuya Negishi;Katsuhiko Kageyama;根岸和也;Koichi Kise;Shinichiro Omachi;Seiichi Uchida;大町真一郎;堀内 真;岩村雅一;古谷嘉男;古谷嘉男;田中一弘;Megumi Sakai;古谷嘉男;岩村雅一;Yoshio Furuya;梅野 恵
• 通讯作者: 梅野 恵

On noise robustness of feature expressing temporal variation for word speech recognition

词语语音识别中表达时间变化特征的噪声鲁棒性

• 发表时间: 2007
• 作者: Tetsuo;Funada
• 通讯作者: Funada