II-NEW: Collaborative Research: COMET: A Web Infrastructure for Research and Experimentation in User Interactive Event Driven Testing

II-新：协作研究：COMET：用于用户交互事件驱动测试研究和实验的 Web 基础设施

• 批准号: 1205472
• 负责人: Myra Cohen
• 金额: $ 33.21万
• 依托单位: University of Nebraska-Lincoln
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2012
• 资助国家: 美国
• 起止时间: 2012-08-01 至 2016-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1205472&HistoricalAwards=false
• 关键词: II; NEW; Collaborative; Research; COMET

User interactive event driven software is pervasive today. End users interact with applications by pointing, clicking or touching the interface, and as this happens, the programs respond. Ensuring the dependability of these systems through software testing is paramount, because insufficient testing techniques currently cost the US economy billions of dollars annually. Yet the flexibility of these systems, which make them appealing to users, also increases the difficulty of testing them. This difficulty has fueled a large body of research on user interactive event driven testing, but the newly developed techniques are often evaluated using isolated case studies and experiments. The user interactive event driven testing community lacks a common set of benchmarks and tools for evaluating their new methods, leading to experimental mismatch; the results of one study are difficult to compare with another. The lack of common benchmarks also means that we cannot easily combine results of multiple studies to build a larger body of knowledge. This project reduces the mismatch and is advancing user interactive event driven testing research by developing a shared research and experimentation web infrastructure called COMET. An initial proof of concept for COMET was developed through earlier support from NSF. Factors that contribute to the mismatch include the development of platform specific test methods, test harnesses that require customizations for each test subject application and each operating system, and models that are incompatible with one another. The research will devise new techniques to control the testing environment, contextualizing factors that may affect experimental outcome and will allow for evolution and change of the artifacts over time. It is building a shared and extensible web infrastructure of benchmarks, tools, models and test artifacts that will enable scientific discovery in the state-of-the-art of user interactive event driven testing. COMET is a public resource that will be available to a broader community. Its impact will extend not only to the user interactive event testing research community, but also to others that work with user interfaces such as those who study usability, and to industry and the software testing community at large. The project work will involve both graduate and undergraduate students. Artifacts from the COMET website will be utilized for educational purposes in the classroom.

用户交互事件驱动软件如今已十分普遍。 最终用户通过指向、单击或触摸界面与应用程序交互，当发生这种情况时，程序会做出响应。 通过软件测试确保这些系统的可靠性至关重要，因为目前测试技术的不足每年给美国经济造成数十亿美元的损失。 然而，这些系统的灵活性对用户有吸引力，但也增加了测试它们的难度。这种困难推动了对用户交互式事件驱动测试的大量研究，但新开发的技术通常是使用孤立的案例研究和实验来评估的。用户交互事件驱动测试社区缺乏一套通用的基准和工具来评估他们的新方法，导致实验不匹配；一项研究的结果很难与另一项研究的结果进行比较。缺乏共同基准还意味着我们无法轻松地将多项研究的结果结合起来以建立更大的知识体系。该项目减少了不匹配，并通过开发名为 COMET 的共享研究和实验网络基础设施来推进用户交互事件驱动的测试研究。 COMET 的初步概念验证是在 NSF 的早期支持下开发的。 导致不匹配的因素包括特定于平台的测试方法的开发、需要针对每个测试主题应用程序和每个操作系统进行定制的测试工具以及彼此不兼容的模型。 该研究将设计新技术来控制测试环境，将可能影响实验结果的因素置于背景中，并允许工件随着时间的推移而演变和变化。 它正在构建一个包含基准、工具、模型和测试工件的共享且可扩展的网络基础设施，这将使用户交互式事件驱动测试的最先进的科学发现成为可能。 COMET 是一种公共资源，可供更广泛的社区使用。 其影响不仅会扩展到用户交互事件测试研究社区，还会扩展到其他使用用户界面的人员，例如研究可用性的人员，以及整个行业和软件测试社区。该项目工作将涉及研究生和本科生。 COMET 网站上的文物将用于课堂教学目的。