CI-ADDO-NEW: OCCAM: Open Curation for Computer Architecture Modeling

CI-ADDO-NEW：OCCAM：计算机架构建模的开放式管理

• 批准号: 1305220
• 负责人: Bruce Childers
• 金额: $ 20万
• 依托单位: University of Pittsburgh
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2013
• 资助国家: 美国
• 起止时间: 2013-09-01 至 2018-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1305220&HistoricalAwards=false
• 关键词: CI; ADDO; NEW; OCCAM; Open

The computer architecture research community has created a rich and diverse collection of simulators, emulators, and benchmarks. Each individual research group has its own preferred tools, perhaps built on top of an existing or custom infrastructure. These artifacts are used in experiments to evaluate design trade-offs and to analyze implications to performance, energy, reliability, and other metrics. Unfortunately, the ways in which these tools are used for evaluation often hinder the application of the scientific method. The barrier to entry for using various artifacts (i.e., simulation tools and benchmarks) is usually high, when these artifacts are made available. Experiments are rarely open, nor easily repeatable by other researchers, leading to inaccurate comparisons. Moreover, it is difficult for a single group to explore all variations due to state-space explosion.To demonstrate that these problems can be addressed to improve computer architecture evaluation, this pilot project takes the first steps to develop an open-access repository that permits sharing artifacts and experimental results among a broad group of stakeholders in computer architecture. The project builds and engages an active community of users, establishes governance and access policies, and determines the requirements for software services of the repository. This initial prototype provides the community an opportunity to supply feedback and suggestions to evolve the prototype and refine its policies.The project shows that significant collective effort can be saved by sharing simulators and experiments for accountable and repeatable experimentation as part of the scientific method. It avoids the burden of re-implementing and re-creating tools, experiments, data sets, benchmarks, etc. This savings in effort and more sound and complete evaluation can then be directed on innovating new architectural techniques for better computer systems.

计算机架构研究社区创造了丰富而多样的模拟器，模拟器和基准。每个研究小组都有自己的首选工具，也许是建立在现有或自定义基础架构之上的。这些工件用于实验中，以评估设计权衡并分析对性能，能源，可靠性和其他指标的影响。不幸的是，这些工具用于评估的方式通常会阻碍科学方法的应用。使用各种工件（即模拟工具和基准测试）的进入障碍通常很高，当这些工件提供时。 实验很少是开放的，也不容易被其他研究人员重复，导致比较不准确。 此外，一个小组很难探索由于州空间爆炸而引起的所有变化。要证明可以解决这些问题以改善计算机架构评估，该试点项目采取了第一步来开发一个开放式存储库，从而允许共享工件和在计算机建筑中较大的利益相关者之间共享工件和实验结果。 该项目建立并参与活跃的用户社区，建立治理和访问政策，并确定存储库软件服务的要求。该最初的原型为社区提供了提供反馈和建议以发展原型并完善其政策的机会。该项目表明，可以通过共享模拟器和实验来节省大量的集体努力，以进行负责任且可重复的实验作为科学方法的一部分。它避免了重新实施和重新创建工具，实验，数据集，基准等的负担。然后可以将这种节省以及更多的声音和完整的评估用于创新，以为更好的计算机系统创新新的建筑技术。