SHF: Small:Automatically Synthesizing System and Integration Tests

SHF：小型：自动综合系统和集成测试

• 批准号: 1908094
• 负责人: Mark Grechanik
• 金额: $ 37.89万
• 依托单位: University of Illinois at Chicago
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-10-01 至 2023-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1908094&HistoricalAwards=false
• 关键词: SHF; Small; Automatically; Synthesizing; System

System and integration testing is a set of key activities in software development and maintenance to determine if applications and their constituent components behave correctly. System/integration testing is vitally important for ensuring software quality, since many serious software defects occur in interactions among different components. Unfortunately, creating effective system/integration tests requires significant time and effort, since it is not feasible to test the enormous set of all combinations of the components from a nontrivial software application. It is crucial to reduce the cost and increase the quality of software with system/integration testing that is effective in fault finding and efficient in resource consumption and execution time. In sum, there are unique factors in system/integration testing, not previously considered, that if not addressed will continue to limit the quality of software applications. In this project, a novel framework will be created for automatically creating effective system/integration tests that find bugs efficiently. A three-pronged research program will be developed for Automatic Synthesis of System and Integration Software Tests (ASSIST). New algorithms and techniques will be created and evaluated as part of the work on this project for automatically obtaining models that describe interacting components, thus reducing the number of synthesized system and integration tests and increasing their fault-finding power. Also, a novel way will be created in which static and dynamic analyses and machine learning are used to obtain test input data as well as oracles for the synthesized system and integration tests. As a result of the work on this project, system and integration tests will be automatically synthesized using ASSIST that have a comparable bug-finding power with manually created integration tests. A suite of new ASSIST tools that will be developed, evaluated, and applied to different open-source and commercial applications, and made available to the broader community.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

系统和集成测试是软件开发和维护中的一系列关键活动，以确定应用程序及其组成部分是否正确。系统/集成测试对于确保软件质量至关重要，因为许多严重的软件缺陷都发生在不同组件之间的交互中。不幸的是，创建有效的系统/集成测试需要大量的时间和精力，因为从非平凡软件应用程序中测试组件的所有组合的大量组合是不可行的。通过系统/集成测试有效发现并在资源消耗和执行时间上有效地提高系统/集成测试，这对于降低成本和提高软件质量至关重要。 总而言之，在系统/集成测试（以前未考虑）中存在独特的因素，即如果没有解决，将继续限制软件应用程序的质量。在此项目中，将创建一个新颖的框架，以自动创建有效找到错误的有效系统/集成测试。 将开发一个三管齐下的研究计划，以自动合成系统和集成软件测试（Assid）。将创建和评估新的算法和技术作为该项目的工作的一部分，以自动获取描述交互组件的模型，从而减少合成系统和集成测试的数量并增加其故障找到功能。同样，将创建一种新颖的方式，在该方法中，使用静态和动态分析和机器学习来获取测试输入数据以及合成系统和集成测试的序列。由于该项目的工作，系统和集成测试将使用具有与手动创建的集成测试具有可比较的错误发现功能的Assiss自动合成。一套新的辅助工具将被开发，评估和应用于不同的开源和商业应用程序，并提供给更广泛的社区。该奖项反映了NSF的法定任务，并被认为是通过基金会的评估值得一提的智力优点和更广泛的影响审查标准。