CRII: SHF: Regression Testing for Projects with Distributed Software Histories

CRII：SHF：具有分布式软件历史记录的项目的回归测试

基本信息

批准号：
1566363
负责人：
Milos Gligoric
金额：
$ 17.5万
依托单位：
University of Texas at Austin
依托单位国家：
美国
项目类别：
Standard Grant
财政年份：
2016
资助国家：
美国
起止时间：
2016-05-15 至 2019-04-30
项目状态：
已结题

来源：
https://www.nsf.gov/awardsearch/showAward?AWD_ID=1566363&HistoricalAwards=false
关键词：
CRII SHF Regression Testing Projects

项目摘要

Developers practice regression testing -- running tests against eachproject commit -- to check that project changes do not break anyfunctionality. While important, regression testing is expensive due tothe number of tests and the number of commits. Regression testselection (RTS) techniques speed up regression testing by skipping torun tests that are not affected by recent changes, and regression testprioritization (RTP) techniques reorder tests to run failing testsfaster. Existing regression techniques analyze only two adjacentcommits, effectively assuming a linear software history. However, therevolution in version-control systems changed the shape of softwarehistories. Distributed software histories are complex graphs ofbranches and merges, which do not match the simplistic view of theexisting techniques. Although existing regression techniques can berun if a distributed software history is linearized, these techniquesunderutilize the data available in the distributed software history.To speed up regression testing, the PI proposes to design techniquesthat utilize the data available in the entire distributed softwarehistory. This project proposes four tasks to improve RTS and RTP: (1)non-adjacent commit reuse - discover likely optimal commit to be usedin each analysis rather than always analyzing adjacent commits; (2)multi-commit analyses - design methods that analyze more than twocommits rather than always analyzing only two commits; (3)command-aware methods - specialize the methods for various commandsthat create each commit rather than be command-unaware; and (4)unified implementation and evaluation - share the implementation andresults among techniques, and evaluate the techniques on open-sourceand industrial projects. The broader impacts of improving RTS and RTPare to increase developers' productivity and reduce the resource usageduring testing phases.

开发人员练习回归测试——针对每个项目提交运行测试——以检查项目更改不会破坏任何功能。虽然回归测试很重要，但由于测试数量和提交数量，它的成本很高。回归测试选择 (RTS) 技术通过跳过运行不受最近更改影响的测试来加速回归测试，回归测试优先级 (RTP) 技术重新排序测试以更快地运行失败的测试。现有的回归技术仅分析两个相邻的提交，有效地假设线性软件历史记录。然而，版本控制系统的革命改变了软件历史的形态。分布式软件历史是分支和合并的复杂图，这与现有技术的简单化视图不符。尽管如果分布式软件历史记录是线性化的，则可以运行现有的回归技术，但是这些技术未充分利用分布式软件历史记录中的可用数据。为了加速回归测试，PI 建议设计利用整个分布式软件历史记录中的可用数据的技术。该项目提出了四个任务来改进 RTS 和 RTP：（1）非相邻提交重用 - 发现每次分析中可能使用的最佳提交，而不是总是分析相邻提交； (2)多提交分析——设计分析两次以上提交的方法，而不是总是只分析两次提交； (3)命令感知方法 - 专门用于创建每个提交的各种命令的方法，而不是命令不感知的方法； (4)统一实施和评估——共享技术之间的实施和结果，并对开源和工业项目的技术进行评估。改进 RTS 和 RTP 的更广泛影响是提高开发人员的生产力并减少测试阶段的资源使用。