Testing a Metric and Evaluation System for Innovation Benefits

测试创新效益的指标和评估系统

• 批准号: 0940686
• 负责人: Jerald Hage
• 金额: --
• 依托单位: University of Maryland, College Park
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2009
• 资助国家: 美国
• 起止时间: 2009-10-01 至 2011-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0940686&HistoricalAwards=false
• 关键词: Testing; Metric; Evaluation; System; Innovation

The traditional measures of scientific productivity have been publications and citations. A major question in the area of science of science and innovation policy is whether it is possible to expand outcome measures beyond such metrics and directly measure the amount of technical advance or actual value generated by a science investment more quickly and descriptively. Another major question is whether it is possible to measure the incremental advances that characterize many projects, in addition to the traditional focus on major findings.This research examines the potential contribution of a metrics system, based on expert coding of current research findings, that is both fine-grained and broad in scope. The general principles used to characterize the metrics are differences by treatment area and by stage in the process, which are the major sources of variations in health research problem. It assesses whether research findings can be measured in real time and be both linked back to specific projects and forward to the "pay-off" for society. The project applies a system of 20 metrics of health outcomes and 16 metrics of economic benefit that has been developed to all research projects funded in 2007 by the National Institutes of Health. It is used to code technical progress in six areas of morbidity as stated in research reports after two years of research. The metrics system is implemented at the project level in order to permit an examination of whether the degree of diversity and the amount of inter-organizational involvement in research teams is either accelerating or decelerating results.Connecting advances in real-time to the composition of the research team can also help inform the management of "team science" and advance understanding of its impact on innovation. The metrics system, if successful, could be used to add to the scientific basis for the evaluation of projects awarded in 2009 by NIH under the American Recovery and Reinvestment Act. The demonstration study also provides a benchmark for what can be reasonably expected in that short time period, given differences by treatment area and by stage in the process. The approach could potentially be applied to other major policy objectives, such as alternative energies. Connecting advances in real-time to the composition of the research team also contributes findings about the management of ?team research? and its impact on innovation.

科学生产力的传统措施是出版物和引用。科学和创新政策科学领域的一个主要问题是，是否可以将结果指标扩大到此类指标之外，并直接更快，描述性地衡量科学投资产生的技术进步或实际价值的数量。另一个主要问题是，除了传统的关注重点外，是否还可以衡量许多项目的增量进步。这项研究还基于当前研究发现的专家编码，既良好且范围广泛又广泛。用于表征指标的一般原则是治疗区域的差异和阶段，这是健康研究问题差异的主要来源。 它评估了研究结果是否可以实时衡量，并既可以与特定的项目链接，又可以与社会的“回报”链接。该项目应用了一个由20个指标的健康结果指标和16个经济利益指标，这些系统已向美国国立卫生研究院于2007年资助的所有研究项目开发。 在研究报告两年后，研究报告中指出，它用于在六个发病率领域进行编码。指标系统是在项目层面上实施的，以便允许检查多样性的程度和组织间参与研究团队是否正在加速或减速结果。实时连接进步，以使研究团队组成的组成也可以帮助“团队科学”的管理以及对其对创新的影响的了解。如果成功的如果成功，则可以使用指标体系添加到科学基础上，以评估NIH根据《美国恢复和再投资法》于2009年授予的项目。 示范研究还为在短时间内可以合理预期的情况提供了一个基准，鉴于治疗区域的差异以及在此过程中的阶段差异。 该方法可能会应用于其他主要政策目标，例如替代能源。将实时的进步与研究团队的组成联系也有助于团队研究的管理？及其对创新的影响。