Adaptive dynamic programming for uncertain nonlinear systems through coupling of nonlinear analysis and data-based learning

通过非线性分析和基于数据的学习的耦合对不确定非线性系统进行自适应动态规划

• 批准号: 1509516
• 负责人: Warren Dixon
• 金额: $ 32.55万
• 依托单位: University of Florida
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-08-01 至 2019-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1509516&HistoricalAwards=false
• 关键词: Adaptive; dynamic; programming; uncertain; nonlinear

Optimal control methods provide a means to associate a user-defined cost with control actions or decisions. These methods have made pervasive impacts in a wide class of application domains. The shift towards autonomy by the automotive industry in examples such as replacing mechanical systems with computer controlled electronic control systems, has resulted in efficiencies in fuel injection, braking, throttling, etc. For electric vehicles, fuel economy, drivability, and emission control are functions of the engine design and the control strategies. For robotic systems, the desire to achieve optimal behavior is essential for efficient task execution. Likewise, aerospace systems have always been a mainstream application domain for optimal control methods because there has always been (and always will be) a tight coupling between performance and energy/fuel costs. As the cost of energy and the awareness of the environmental impacts of producing energy have risen, optimal control may now play a timely role in a broader spectrum of application domains. The Energy Efficiency and Renewable Energy office of the U.S. Department of Energy indicates that as much as 10-20 percent of American energy use could be saved by optimizing industrial systems. It is self-evident that optimal control solutions can have significant impacts in a wide range of industries, but the development of optimal control solutions for real engineering systems is limited by numerous technical barriers. The most fundamental and open-ended problems arise from barriers associated with developing optimal solutions in the presence of uncertainty. The driving question in this project is how to arbitrate between gaining knowledge about a system while simultaneously making the optimal control decision for engineering systems that are uncertain and complex.The technical aims of this project are motivated by the hypothesis and observations from preliminary efforts that nonlinear analysis methods can be exploited to design real-time approximate optimal solutions, while concurrent background processing methods can be used to update the optimal control approximation for improved performance. Intellectual merits in this project are realized through the development of classes of closed-loop controllers with associated stability analysis, and advanced function approximation methods, that ensure sufficient exploration of the system response while learning the approximate optimal control solution. Outcomes of this research would allow for optimal control implementation in a broader class of application domains where the system exhibits nonlinear behaviors and uncertainty. The broad impact of this framework is a merger of methods that bridge the gap between the computational intelligence community and control systems community to enable data-based learning methods to optimize control performance.

最佳控制方法提供了一种将用户定义的成本与控制动作或决策相关联的方法。这些方法在广泛的应用领域产生了普遍的影响。在诸如用计算机控制的电子控制系统替换机械系统之类的示例中，汽车行业向自主权的转变，导致了燃油喷射，制动，防空力等的效率。电动汽车，燃油经济性，驾驶性，驾驶性和排放控制是发动机设计和控制策略的功能。对于机器人系统，实现最佳行为的愿望对于有效的任务执行至关重要。同样，航空航天系统一直是最佳控制方法的主流应用领域，因为在性能和能源/燃料成本之间，一直存在（并且总是会）紧密的耦合。随着能源的成本和产生能源的环境影响的意识上升，最佳控制现在可能在更广泛的应用领域中及时发挥作用。美国能源部的能源效率和可再生能源办公室表明，多达10-20％的美国能源使用可以通过优化工业系统来节省。不言而喻的是，最佳控制解决方案可以在广泛的行业中产生重大影响，但是开发用于实际工程系统的最佳控制解决方案受到许多技术障碍的限制。最根本和开放式的问题是由于在不确定性存在下开发最佳解决方案而产生的障碍。该项目中的驾驶问题是如何在获得系统的知识之间进行仲裁，同时对不确定和复杂的工程系统做出最佳控制决定。该项目的技术目标是由非线性分析方法的假设和观察结果激励的，可以利用非线性分析方法来实现最佳解决方案，同时进行实时的方法，同时进行了实用的改进方法，以更新的方式进行了更新的方法，以更新的方式进行了更新的方法。该项目中的智力优点是通过开发具有相关稳定性分析和高级功能近似方法的闭环控制器类别来实现的，这些方法可以确保在学习近似最佳控制解决方案的同时对系统响应进行足够的探索。这项研究的结果将允许在系统表现出非线性行为和不确定性的更广泛的应用领域中进行最佳的控制实施。该框架的广泛影响是弥合计算智能社区和控制系统社区之间差距的方法的合并，以使基于数据的学习方法优化控制性能。