Research and Development of an Automated, Interactive, and User-Configurable Conversational Agent for Always-Available Personalized Language Tutoring

研究和开发自动化、交互式和用户可配置的对话代理，以实现始终可用的个性化语言辅导

• 批准号: 21K17779
• 负责人: Zhang Xinlei
• 金额: $ 3万
• 依托单位: The University of Tokyo
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Early-Career Scientists
• 财政年份: 2021
• 资助国家: 日本
• 起止时间: 2021-04-01 至 2022-03-31
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-21K17779/
• 关键词: Tutoring Agent; Speech Recognition; Multi-Modal Interface; Language Learning; Device Wakeup

During the six months of conducting this project, I mainly achieved two goals: 1) Developed a prototype system to allow users to generate and customize the agent through simple text editing. The system takes a text file containing the transcript of the template speech and the user's feedback mode, then creates the tutoring agent accordingly for adaptive and personalized tutoring. It is part of a paper published in EICS 2021 now.2) Developed a novel way to allow users to awake the device by changing the prosody when speaking the keyword (e.g., Alexa) for accurate device activations. Evaluation studies show significant advantages of this method compared to Keyword Spotting based method. The results are summarized into a top-conference paper which is under review.

在进行这个项目的六个月中，我主要实现了两个目标：1）开发了一个原型系统，允许用户通过简单的文本编辑来生成和定制代理。系统采用包含模板语音记录和用户反馈模式的文本文件，然后相应地创建辅导代理，以实现自适应和个性化辅导。这是现在在 EICS 2021 上发表的论文的一部分。2) 开发了一种新颖的方法，允许用户通过在说出关键字（例如 Alexa）时更改韵律来唤醒设备，以实现准确的设备激活。评估研究表明，与基于关键词识别的方法相比，该方法具有显着优势。结果被总结成一篇正在接受审查的顶级会议论文。

项目成果

JustSpeak: Automated, User-Configurable, Interactive Agents for Speech Tutoring

JustSpeak：用于语音辅导的自动化、用户可配置的交互式代理

• DOI: 10.1145/3459744
• 发表时间: 2021
• 期刊: Proc. ACM Hum.-Comput. Interact. 5, EICS
• 作者: Xinlei Zhang;Takashi Miyaki;and Jun Rekimoto
• 通讯作者: and Jun Rekimoto