Prior knowledge elicitation and policy explanation for decision-theoretic planning and learning

决策理论规划和学习的先验知识获取和政策解释

• 批准号: 312388-2008
• 负责人: Poupart, Pascal
• 金额: $ 1.82万
• 依托单位: University of Waterloo
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2010
• 资助国家: 加拿大
• 起止时间: 2010-01-01 至 2011-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=457399
• 关键词: Prior; knowledge; elicitation; policy; explanation

Consider spoken-dialogue managers, mobile robot controllers, automated monitoring/prompting systems for seniors with dementia or any other complex system that must accomplish a fairly complicated task. The conception of such systems is particularly challenging due to the noisy nature of the sensors (e.g., noisy speech recognition, noisy sonars) as well as the uncertain and interdependent effects of system actions (e.g., uncertain effect of prompts on seniors, interdependent and noisy motor controls in robotics). As a result, it is generally impossible to design complex robust systems by hand coding control policies. The fields of decision-theoretic planning and learning have made significant advances in the development of automated techniques to generate robust control policies that could revolutionize the next generation of computer systems. Instead of programming a policy directly, an algorithm is used to optimize a policy based on a model or simulator of the system and its environment. However, eliciting the domain knowledge necessary to specify a model or simulator, and validating/explaining the resulting policy are two major bottlenecks ignored by the research community that are holding back the adoption of this disruptive technology. Knowledge elicitation and policy explanation are particularly challenging since non-technical domain experts tend to have partial and imprecise knowledge, and often need high-level explanations of the policy where technical details are abstracted away to better convey the intuition. Hence, the objectives of this research are i) to design general and principled techniques to elicit and encode partial/imprecise domain knowledge about the system, the environment and the desired policy, ii) to develop algorithms that can exploit as much domain knowledge as possible to improve scalability, and iii) to create generic tools to validate and explain the decisions made by a policy at an appropriate level for developers and non-technical experts.

考虑语音对话管理器、移动机器人控制器、针对患有痴呆症的老年人的自动监控/提示系统或任何其他必须完成相当复杂的任务的复杂系统。 由于传感器的噪声性质（例如，噪声语音识别、噪声声纳）以及系统操作的不确定性和相互依赖的影响（例如，提示对老年人的不确定影响、相互依赖和噪声），此类系统的概念特别具有挑战性。机器人技术中的电机控制）。 因此，通常不可能通过手动编码控制策略来设计复杂的鲁棒系统。 决策理论规划和学习领域在自动化技术的开发方面取得了重大进展，以生成可以彻底改变下一代计算机系统的稳健控制策略。 不是直接对策略进行编程，而是使用算法基于系统及其环境的模型或模拟器来优化策略。 然而，获取指定模型或模拟器所需的领域知识以及验证/解释由此产生的策略是研究界忽视的两个主要瓶颈，阻碍了这种颠覆性技术的采用。 知识获取和政策解释尤其具有挑战性，因为非技术领域专家往往拥有片面和不精确的知识，并且通常需要对政策进行高级解释，其中抽象出技术细节以更好地传达直觉。 因此，本研究的目标是 i) 设计通用和原则性的技术来引出和编码有关系统、环境和所需策略的部分/不精确的领域知识，ii) 开发可以利用尽可能多的领域知识的算法提高可扩展性，以及 iii) 创建通用工具，以在适当级别为开发人员和非技术专家验证和解释策略所做的决策。