Collaborative Research: SLES: Foundations of Qualitative and Quantitative Safety Assessment of Learning-enabled Systems

合作研究：SLES：学习型系统定性和定量安全评估的基础

基本信息

批准号：
2331938
负责人：
Weiming Xiang
金额：
$ 27.09万
依托单位：
AUGUSTA UNIVERSITY RESEARCH INSTITUTE, INC.
依托单位国家：
美国
项目类别：
Standard Grant
财政年份：
2023
资助国家：
美国
起止时间：
2023-12-01 至 2026-11-30
项目状态：
未结题

来源：
https://www.nsf.gov/awardsearch/showAward?AWD_ID=2331938&HistoricalAwards=false
关键词：
Collaborative Research SLES Foundations Qualitative

项目摘要

Learning-enabled autonomous systems operating in unfamiliar or unprecedented environments pose new foundational challenges for their safety assessment and subsequent risk management. In this context, the system-level safety means the complicated behaviors created by the interactions between multiple learning components and the physical world satisfy the safety requirements, protecting the system from accidental failures to avoid hazards such as collisions to other vehicles, bicycles and pedestrians. The qualitative and quantitative methodologies envisioned to complement each other by providing both 'yes' or 'no' binary decisions and numerical measures of safety, which allow for a thorough understanding of safety concerns and enable effective safety verification in uncertain environments. This project targets the foundational challenges of developing qualitative and quantitative safety assessment methods capable of capturing uncertainties from environments and providing timely, comprehensive, and accurate safety evaluations at the system level. The outcomes are expected to boost the trustworthiness and adaptability of learning-enabled systems to the unknown world and facilitate their safe integration into various domains, such as autonomous vehicles, robotics, or industrial automation. Educational and outreach activities are well-integrated into the research, including curriculum development, K-12 STEM outreach, and industrial engagement activities. The designed activities are uniquely positioned to promote diversity throughout this project by giving priority consideration, mentoring, and working with students in underrepresented minority groups. The proposed research efforts will be directed toward building the foundations of end-to-end qualitative and quantitative safety assessment of learning-enabled autonomous systems. This project will develop the probabilistic star temporal logic specification language. The new specification language offers a formalism for expressive modeling of learning process uncertainty and complex temporal behaviors, and supports both qualitative and quantitative reasoning. Efficient computation methods and tools will be developed to verify probabilistic star temporal logic specifications for learning-enabled deep neural network components. The verification methods and tools are centered on enhancing their scalability and resource efficiency. This project will develop system-level qualitative and quantitative safety assessment methods and tools that can handle the interplay of various learning-enabled components in a system under different availability of environment information. Learning-enabled F1Tenth testbed, a small-scale system of real autonomous vehicles and its simulator, will be used to create multiple real-world autonomous driving scenarios to validate and evaluate the applicability, scalability and reliability of the proposed methods and tools.This research is supported by a partnership between the National Science Foundation and Open Philanthropy.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

在陌生或前所未有的环境中运行的学习型自主系统对其安全评估和后续风险管理提出了新的基础挑战。在此背景下，系统级安全意味着多个学习组件与物理世界之间交互产生的复杂行为满足安全要求，保护系统免受意外故障的影响，避免与其他车辆、自行车和行人发生碰撞等危险。定性和定量方法预计通过提供“是”或“否”二元决策和安全数字测量来相互补充，从而可以全面了解安全问题并在不确定的环境中实现有效的安全验证。该项目针对开发定性和定量安全评估方法的基本挑战，该方法能够捕获环境中的不确定性，并在系统层面提供及时、全面和准确的安全评估。研究结果预计将提高学习型系统对未知世界的可信度和适应性，并促进其安全集成到自动驾驶汽车、机器人或工业自动化等各个领域。教育和推广活动很好地融入了研究，包括课程开发、K-12 STEM 推广和行业参与活动。设计的活动具有独特的定位，通过优先考虑、指导和与代表性不足的少数群体的学生合作，促进整个项目的多样性。拟议的研究工作将旨在为学习型自主系统的端到端定性和定量安全评估奠定基础。该项目将开发概率星时序逻辑规范语言。新的规范语言为学习过程不确定性和复杂时间行为的表达建模提供了形式主义，并支持定性和定量推理。将开发高效的计算方法和工具来验证支持学习的深度神经网络组件的概率星时序逻辑规范。验证方法和工具的重点是增强其可扩展性和资源效率。该项目将开发系统级定性和定量安全评估方法和工具，这些方法和工具可以在不同的环境信息可用性下处理系统中各种支持学习的组件的相互作用。具有学习功能的 F1Tenth 测试平台是一个由真实自动驾驶车辆及其模拟器组成的小型系统，将用于创建多个真实世界的自动驾驶场景，以验证和评估所提出的方法和工具的适用性、可扩展性和可靠性。该奖项得到了美国国家科学基金会和开放慈善事业之间的合作支持。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。