CI-EN: RUI: Collaborative Research: TraceLab Community Infrastructure for Replication, Collaboration, and Innovation

CI-EN：RUI：协作研究：用于复制、协作和创新的 TraceLab 社区基础设施

• 批准号: 1649008
• 负责人: Jane Huang
• 金额: $ 20.23万
• 依托单位: University of Notre Dame
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-07-01 至 2019-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1649008&HistoricalAwards=false
• 关键词: CI; EN; RUI; Collaborative; Research

This is the second phase of the TraceLab project, which was initially funded under an NSF Major Research Instrumentation grant. The goal of this project is to deliver an instrument that facilitates reproducibility of Software Engineering experiments, fosters comparative evaluation, and provides an environment in which components can be easily shared across research groups. The challenge of experimental reproducibility extends across almost every science and engineering discipline. Recently, a widely reported study conducted by the biotech firm "Amgen" revealed that of 53 previously published landmark papers, only six were reproducible. Recent studies have unearthed similar problems across a diverse set of Software Engineering domains, including, but not limited to, software traceability, feature location, and compiler optimization. Reproducibility is often undermined by lack of publicly available datasets, obsolete and unavailable tools, insufficient details about the experiment, and undocumented decisions about the way various metrics are computed. TraceLab provides a plug-and-play experimental environment, as well as libraries of shareable components and seminal experiments. As such, it is designed to address these problems.TraceLab introduces a radically different way of approaching empirical software engineering research and paves the way for greater community collaboration, more rigorous evaluation of results, and an easier entry-way for new researchers. It is expected to lay the foundation for future advances in the field of empirical software engineering, accelerate and shape future research directions, support industrial pilot studies, and significantly reduce the cost and effort that oftentimes discourages new researchers from entering the field. In addition, the project will provide opportunities to a diverse group of undergraduate and graduate students, and will be used for educational purposes across various software engineering courses.

这是 TraceLab 项目的第二阶段，该项目最初由 NSF 主要研究仪器拨款资助。 该项目的目标是提供一种工具，促进软件工程实验的可重复性，促进比较评估，并提供一个可以在研究小组之间轻松共享组件的环境。 实验再现性的挑战几乎遍及所有科学和工程学科。最近，生物技术公司“Amgen”进行的一项广泛报道的研究显示，在之前发表的 53 篇里程碑式论文中，只有 6 篇是可重复的。最近的研究在不同的软件工程领域中发现了类似的问题，包括但不限于软件可追溯性、功能定位和编译器优化。 可重复性常常因缺乏公开可用的数据集、过时和不可用的工具、实验细节不足以及有关各种指标计算方式的未记录的决策而受到损害。 TraceLab 提供了即插即用的实验环境，以及可共享组件和开创性实验的库。 因此，它旨在解决这些问题。TraceLab 引入了一种完全不同的方法来进行实证软件工程研究，并为更大的社区协作、更严格的结果评估以及为新研究人员提供更容易的进入途径铺平了道路。 预计它将为实证软件工程领域的未来发展奠定基础，加速和塑造未来的研究方向，支持工业试点研究，并显着减少经常阻碍新研究人员进入该领域的成本和工作量。 此外，该项目将为不同的本科生和研究生群体提供机会，并将用于各种软件工程课程的教育目的。