CAREER: Advancing Regression Testing: Theory and Practice

职业：推进回归测试：理论与实践

• 批准号: 1652517
• 负责人: Milos Gligoric
• 金额: $ 50.29万
• 依托单位: University of Texas at Austin
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-06-01 至 2023-05-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1652517&HistoricalAwards=false
• 关键词: CAREER; Advancing; Regression; Testing; Theory

Software projects constantly evolve due to endless requirement changes despite the risk of introducing new bugs. Thus, software developers practice regression testing -- running tests at each project revision -- to check that recent project changes do not break any functionality. Although regression testing is important, it is costly due to the large number of revisions and tests, and the cost is reportedly increasing. Several techniques -- test selection, test-case prioritization, test-suite reduction, and parallelization -- can reduce regression testing cost, but their applicability and cost reduction depend on software development processes, i.e., the way developers write code, build the projects, and run tests. These processes are constantly evolving, sometimes making the existing regression-testing techniques inapplicable or ineffective. The PI identified five emerging trends that impact applicability and effectiveness: use of multiple programming languages, use of variousdevelopment tools, use of cloud-based continuous integration services, increase in the number of revisions and tests, and proliferation of non-deterministic code.To significantly reduce the regression testing costs -- execution time, machine resources, and wasted developers' time caused by delays in detecting bugs -- the PI proposes five research activities that include designing and developing: (1) regression-testing techniques for projects written in multiple programming languages, (2) regression-testing techniques that remove unnecessary inefficiency due to behavior-preserving transformations and inadequate code structure, (3) techniques to reduce the cost of testing in the cloud, (4) techniques to reduce the cost of detecting the bug-introducing revision, and (5) techniques to identify, debug, and control non-determinism in tests. This proposal has the potential to substantially reduce the cost of software testing, which will reduce financial losses and casualties due to software bugs. The project will integrate research and education by developing new curriculum based on newly developed ideas, along with the development of a new concept called top-teaching, which inserts Software Engineering materials into other courses, where the subject matter and students are dependent on software development and need to be informed about good software development practices.

尽管有无限的需求变化，但由于引入新错误，软件项目不断发展。 因此，软件开发人员练习回归测试 - 在每个项目修订上运行测试 - 检查最近的项目变化不会破坏任何功能。 尽管回归测试很重要，但由于修订和测试的数量大量，据报道，成本正在增加。 几种技术 - 测试选择，测试案例优先级，降低测试套件和并行化 - 可以降低回归测试成本，但是它们的适用性和成本降低取决于软件开发过程，即开发人员编写代码，构建项目和运行测试的方式。 这些过程正在不断发展，有时使现有的回归测试技术无法应用或无效。 The PI identified five emerging trends that impact applicability and effectiveness: use of multiple programming languages, use of variousdevelopment tools, use of cloud-based continuous integration services, increase in the number of revisions and tests, and proliferation of non-deterministic code.To significantly reduce the regression testing costs -- execution time, machine resources, and wasted developers' time caused by delays in detecting bugs -- the PI proposes five research activities that include designing and developing: (1) regression-testing techniques for projects written in multiple programming languages, (2) regression-testing techniques that remove unnecessary inefficiency due to behavior-preserving transformations and inadequate code structure, (3) techniques to reduce the cost of testing in the cloud, (4) techniques to reduce the cost of detecting the bug-introducing revision, and (5) techniques to identify, debug, and control测试中的非确定性。 该提案有可能大大降低软件测试的成本，这将减少由于软件错误而导致的财务损失和伤亡。该项目将通过开发基于新开发的思想的新课程以及开发新概念的新概念来整合研究和教育，该课程将软件工程材料插入其他课程中，在此课程中，主题和学生依赖于软件开发，并且需要了解良好的软件开发实践。

项目成果

Pattern-Based Peephole Optimizations with Java JIT Tests

• DOI: 10.1145/3597926.3598038
• 发表时间: 2023-07
• 期刊: Proceedings of the 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis
• 作者: Zhiqiang Zang;Aditya Thimmaiah;Miloš Gligorić

Regression test selection for TizenRT

TizenRT 的回归测试选择

• DOI: 10.1145/3236024.3275527
• 发表时间: 2018
• 期刊: Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering
• 作者: Celik, Ahmet;Lee, Young Chul;Gligoric, Milos
• 通讯作者: Gligoric, Milos

Mutation Analysis for Coq

• DOI: 10.1109/ase.2019.00057
• 发表时间: 2019-11
• 期刊: 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE)
• 作者: Ahmet Çelik;Karl Palmskog;Marinela Parovic;E. J. G. Arias;Miloš Gligorić

A Regression Proof Selection Tool For Coq

• DOI: 10.1145/3183440.3183493
• 发表时间: 2018-01-01
• 期刊: PROCEEDINGS 2018 IEEE/ACM 40TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING - COMPANION (ICSE-COMPANION
• 作者: Celik, Ahmet;Palmskog, Karl;Gligoric, Milos
• 通讯作者: Gligoric, Milos

Comparing and combining analysis-based and learning-based regression test selection

比较和结合基于分析和基于学习的回归测试选择

• DOI: 10.1145/3524481.3527230
• 发表时间: 2022
• 期刊: IEEE/ACM International Conference on Automation of Software Test
• 作者: Zhang, Jiyang;Liu, Yu;Gligoric, Milos;Legunsen, Owolabi;Shi, August
• 通讯作者: Shi, August