IRES: Avatar-based Adaptive Context System

IRES：基于阿凡达的自适应上下文系统

• 批准号: 1458272
• 负责人: Avelino Gonzalez
• 金额: $ 23.2万
• 依托单位: The University of Central Florida Board of Trustees
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-06-15 至 2020-05-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1458272&HistoricalAwards=false
• 关键词: IRES; Avatar; based; Adaptive; Context

Part 1This interdisciplinary partnership between the University of Central Florida and the Fraunhofer Institute for Digital Media Technology (FIDMT) in Ilmenau, Germany is focused on adaptive conversational avatars, the rapidly emerging field crossing computer engineering, computer science, education, communications, and social science. Immediate applications of this research field include artificial intellegence and national security (including cyber-security), interactive robotics, improvement of quality of life for disbaled, and health and caretaking for children and elderly.This project will place students from the University of Central Florida under the mentorship of the PI (Dr. A. J. Gonzalez) and of Dr. Klaus Jantke, the counterpart at FIDMT in Ilmenau, Germany. Dr. Jantke is the director of the Children's Media Department of FIDMT located in Erfurt, Germany and has a long and illustrious history in research in computing media. The international aspect of innovative and advanced research is essential in modern research hence the PIs will work with three cohorts of students, one during each year of the project's existence. Each cohort will include one graduate student and either two undergraduates (the first year) or four (in each of the subsequent years). The research period for each cohort will be 16 weeks - eight weeks in the US and eight weeks in Germany for each year of the grant period.This research project is motivated by an ancient art of storytelling. In our pursuit of an artificially intelligent computer agent, the IRES project seeks to build a capability to autonomously synthesize possible scenarios for the system development and to modify them dynamically upon listener request. More specifically, the topic of the research in this project is the creation of an avatar-based system that can synthesize and adapt a scenario according to the user's request in real time and without any pre-scripted pathways. Good storytellers were treasured in medieval times, given the lack of other media through which to relate a story to a mostly illiterate population. Therefore, the project seeks to embody the storyteller in a lifelike avatar that resembles an actual person. This avatar will tell the story to the listener in spoken natural language, and interact with her/him when the latter requests changes to the story. Part 2Storytelling media have evolved over time, from oral stories to modern E-books. Since the development of the computer, storytelling systems have become a science of their own, and have evolved from simple systems that can only generate a single short story to systems that respond to the listener's actions by modifying the story dynamically in real time. Digital storytelling has therefore become a growing field within artificial intelligence. The project seeks to take this evolution of storytelling media one step further by doing research to create a virtual storyteller who tells a dynamic story. The story is modifiable through a request by the listener (typically a child, a student, or an elderly person), yet will seek to remain realistic as well as interesting. Every story has a story space. That is, only so many things can happen in a story. We use contextual reasoning to represent the story space. In the real world, courses of action are influenced by the current context, making some conversational avatars very attractive while others unattractive when addressing the current situation within the story space. In a similar manner, the situation faced by the protagonist in the dynamic scenario will limit the choices of actions that he/she would otherwise have, thereby taking the story in various directions, none of which need be specifically pre-scripted. The PIs base the proposed research on the use of formal methods to manipulate the story space within the main theme of the story. By formal methods the PIs mean that one represents the story knowledge formally in terms of strings, interaction sequences such as storyboards and graphs, formulas (for conditions), and the like. Formal methods, therefore, will give the ability to reason with formal methods (string comparison, unification, anti-unification and the like) in the story space. Formal methods have been used in the literature to manipulate contextual information.

第一部分佛罗里达大学与德国Ilmenau的Fraunhofer数字媒体技术研究所（FIDMT）之间的跨学科合作伙伴关系专注于自适应对话化身，即迅速宣传的计算机工程，计算机工程，计算机科学，教育，传播，传播和社会科学。 该研究领域的直接应用包括人工肠道和国家安全（包括网络安全），互动机器人技术，改善灾难性的生活质量以及儿童和老年人的健康和护理。该项目将使佛罗里达大学的学生在PI的指导下，将佛罗里达大学的学生置于PI的指导下（A. J. J. Gonzalez Dr. fifm and fidm a. J. J. Gonzalez）。 德国。 Jantke博士是位于德国Erfurt的FIDMT儿童媒体部主任，在计算媒体方面有悠久而杰出的历史。创新和高级研究的国际方面在现代研究中至关重要，因此，PI将与三个学生一起工作，一个在项目的存在的每一年中。每个队列将包括一名研究生和两名本科生（第一年）或四个（随后的几年）。 每个队列的研究期为16周 - 在美国，在德国的每一年，在德国八周，这项研究项目是出于古老的讲故事的动机。为了追求人工智能的计算机代理，IRES项目旨在建立能力，以自主合成系统开发的可能方案，并根据侦听器请求动态修改它们。更具体地说，该项目中的研究主题是创建基于阿凡达的系统，该系统可以实时且无需任何预先录制的途径，可以根据用户的请求进行综合和调整场景。鉴于缺乏将故事与大多数文盲人口联系起来的其他媒体，好的讲故事的人在中世纪被珍惜。因此，该项目试图在类似于实际人的栩栩如生的头像中体现讲故事的人。这个化身将用口语的听众讲述这个故事，并在后者要求改变故事时与她/他互动。第二部分媒体随着时间的流逝而发展，从口头故事到现代电子书。自从计算机的开发以来，讲故事的系统已成为自己的科学，并且已经从简单的系统中演变而成，这些系统只能通过实时动态地动态地修改故事来响应听众的行为的系统。因此，数字讲故事已成为人工智能中不断增长的领域。该项目试图通过进行研究来创建一个虚拟讲故事的人，讲述一个动态故事，以进一步发展讲故事的媒体。这个故事可以通过听众的要求（通常是一个孩子，学生或老年人）来修改，但会寻求保持现实和有趣。每个故事都有一个故事空间。也就是说，故事中只有这么多事情发生。我们使用上下文推理来表示故事空间。在现实世界中，行动过程受到当前环境的影响，使一些对话化的化身非常吸引人，而在解决故事空间中的当前状况时，其他方案则没有吸引力。以类似的方式，主角在动态场景中所面临的情况将限制他/她原本将要采取的行动的选择，从而将故事朝各个方向上采用，而这些故事都不需要专门标记。 PIS基础是拟议的研究，以使用正式方法来操纵故事主题的故事空间。通过形式方法，PI意味着一个人以字符串，互动序列（例如故事板和图表，公式（适用于条件）等）形式代表故事知识。因此，形式的方法将赋予故事空间中形式的方法（字符串比较，统一，反统一等）的推理能力。文献中已使用形式的方法来操纵上下文信息。