CRII: SHF: Regression Testing for Projects with Distributed Software Histories

CRII：SHF：具有分布式软件历史记录的项目的回归测试

• 批准号: 1566363
• 负责人: Milos Gligoric
• 金额: $ 17.5万
• 依托单位: University of Texas at Austin
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-05-15 至 2019-04-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1566363&HistoricalAwards=false
• 关键词: CRII; SHF; Regression; Testing; Projects

Developers practice regression testing -- running tests against eachproject commit -- to check that project changes do not break anyfunctionality. While important, regression testing is expensive due tothe number of tests and the number of commits. Regression testselection (RTS) techniques speed up regression testing by skipping torun tests that are not affected by recent changes, and regression testprioritization (RTP) techniques reorder tests to run failing testsfaster. Existing regression techniques analyze only two adjacentcommits, effectively assuming a linear software history. However, therevolution in version-control systems changed the shape of softwarehistories. Distributed software histories are complex graphs ofbranches and merges, which do not match the simplistic view of theexisting techniques. Although existing regression techniques can berun if a distributed software history is linearized, these techniquesunderutilize the data available in the distributed software history.To speed up regression testing, the PI proposes to design techniquesthat utilize the data available in the entire distributed softwarehistory. This project proposes four tasks to improve RTS and RTP: (1)non-adjacent commit reuse - discover likely optimal commit to be usedin each analysis rather than always analyzing adjacent commits; (2)multi-commit analyses - design methods that analyze more than twocommits rather than always analyzing only two commits; (3)command-aware methods - specialize the methods for various commandsthat create each commit rather than be command-unaware; and (4)unified implementation and evaluation - share the implementation andresults among techniques, and evaluate the techniques on open-sourceand industrial projects. The broader impacts of improving RTS and RTPare to increase developers' productivity and reduce the resource usageduring testing phases.

开发人员实践回归测试 - 针对每个项目的运行测试 - 检查项目更改是否打破任何功能。虽然重要，但由于测试数量和提交数量，回归测试昂贵。回归测试选择（RTS）技术通过跳过不受最近更改影响的Torun测试加快回归测试，而回归测试优化（RTP）技术重新排序测试以运行Failter testsfaster。现有的回归技术仅分析了两个相邻通信，实际上假设有线性软件历史记录。但是，版本控制系统中的voltolution改变了软件史的形状。分布式软件历史记录是分支和合并的复杂图，它们与备用技术的简单视图不符。尽管现有的回归技术可以Berun，如果分布式软件历史记录是线性性的，但这些技术在分布式软件历史记录中可用的数据进行了限制。为了加快回归测试，PI建议设计技术使用整个分布式软件历史中可用的数据。该项目提出了四个改善RT和RTP的任务：（1）非贴身提交重用 - 发现可能在每个分析中使用的最佳提交，而不是总是分析相邻的提交； （2）多官能分析 - 设计方法，分析了多个超过两者，而不是总是只分析两个提交； （3）命令感知方法 - 专门为各种命令的方法专门创建每个提交而不是命令 - unaware； （4）统一的实施和评估 - 在技术之间共享实施和重新质量，并评估开放式工业项目的技术。改善RT和RTPARE的更广泛影响，以提高开发人员的生产率并减少资源使用测试阶段。

项目成果

Bounded exhaustive test-input generation on GPUs

GPU 上的有限详尽测试输入生成

• DOI: 10.1145/3133918
• 发表时间: 2017
• 期刊: Proceedings of the ACM on Programming Languages
• 作者: Celik, Ahmet;Pai, Sreepathi;Khurshid, Sarfraz;Gligoric, Milos
• 通讯作者: Gligoric, Milos

piCoq: parallel regression proving for large-scale verification projects

piCoq：大规模验证项目的并行回归证明

• DOI: 10.1145/3213846.3213877
• 发表时间: 2018
• 期刊: International Symposium on Software Testing and Analysis
• 作者: Palmskog, Karl;Celik, Ahmet;Gligoric, Milos
• 通讯作者: Gligoric, Milos

Regression test selection for TizenRT

TizenRT 的回归测试选择

• DOI: 10.1145/3236024.3275527
• 发表时间: 2018
• 期刊: Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering
• 作者: Celik, Ahmet;Lee, Young Chul;Gligoric, Milos
• 通讯作者: Gligoric, Milos

A Regression Proof Selection Tool For Coq

• DOI: 10.1145/3183440.3183493
• 发表时间: 2018-01-01
• 期刊: PROCEEDINGS 2018 IEEE/ACM 40TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING - COMPANION (ICSE-COMPANION
• 作者: Celik, Ahmet;Palmskog, Karl;Gligoric, Milos
• 通讯作者: Gligoric, Milos

ICOQ: Regression Proof Selection for Large-Scale Verification Projects

• DOI: 10.1109/ase.2017.8115630
• 发表时间: 2017-01-01
• 期刊: PROCEEDINGS OF THE 2017 32ND IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMATED SOFTWARE ENGINEERING (ASE'17)
• 作者: Celik, Ahmet;Palmskog, Karl;Gligoric, Milos
• 通讯作者: Gligoric, Milos