EAGER Collaborative Proposal: Building a Community of Mentors in Engineering Education Research Through Peer Review Training

EAGER 协作提案：通过同行评审培训建立工程教育研究导师社区

• 批准号: 2318586
• 负责人: Karin Jensen
• 金额: $ 6.95万
• 依托单位: Regents of the University of Michigan - Ann Arbor
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-10-01 至 2023-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2318586&HistoricalAwards=false
• 关键词: EAGER; Collaborative; Proposal; Building; Community

This Early-concept Grant for Exploratory Research (EAGER) project explores mentorship of researchers in reviewing engineering education research (EER) scholarship, leading to the development of training in peer review of journal manuscripts and grant proposals. As a field, EER benefits from diverse perspectives aimed at improving engineering education and challenging existing models of professional formation of engineers, but there is a need to formalize how scholars hone their own research and communication skills through reviewing. We propose the EER Peer Review Training (EER PERT) program, leveraging the knowledge and organizational structure developed in the Journal of Engineering Education (JEE) Mentored Reviewer Program in which triads of mentees and mentors (experienced reviewers) collaboratively write timely, constructive reviews of JEE manuscripts. EER PERT participants include mentees, mentors, and mentor coaches. Diverse participants will be selected through a competitive application process and recruitment through personal and professional networks, including HBCU and MSI networks. Coaches will monitor the quality of the mentoring relationships within mentor/mentee triads through periodic surveys and meetings, and will provide feedback to the project team. In parallel with developing and implementing this training, we will study how reviewers develop mental models of EER. Ongoing studies about the peer review process have identified problems including lack of reviewer training, inconsistent and biased reviews, and dearth of qualified reviewers. Poor quality peer reviews can lead to poor quality scholarship; overly harsh, negative reviews can exclude diverse voices in the community and stifle innovation. We will leverage a training framework developed through the JEE Mentored Reviewer Program, in which participants have described positive outcomes of expanded expertise, a greater understanding of research quality, and shifting the dominant (negative) discourses about peer review to a more positive view of knowledge production and publishing. Taking a sociocultural perspective that recognizes the role of social interaction in co-construction of knowledge and metacognition, we pose these research questions: How do scholars develop schema for quality engineering education research through collaboratively constructing peer reviews? What are the similarities and differences between schema development for manuscript and grant proposal review?The EER PERT program will enhance the quality of EER manuscripts and proposals, and ultimately increase the impact of scholarship in EER. The positive feedback loop created through developing scholarship review skills within the EER community will maximize NSF investments in EER projects.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

这项探索性研究（急切）项目的早期概念赠款探讨了研究人员在审查工程教育研究（EER）奖学金方面的指导，从而在期刊手稿和赠款建议的同行评审中开发了培训。作为一个领域，EER从旨在改善工程教育和挑战工程师专业成立的现有模型的各种观点中受益，但有必要正式地如何通过审查如何磨练自己的研究和沟通技巧。我们提出了EER同行审查培训（EER PERT）计划，利用工程教育杂志（JEE）导师审查员计划中开发的知识和组织结构，该计划在该计划中，受训者和导师的三合会（经验丰富的审稿人）在JEE手稿上进行了及时的及时编写，建设性的评论。 EER PERT参与者包括受训者，导师和导师教练。各种参与者将通过竞争性申请流程和个人和专业网络（包括HBCU和MSI网络）进行招聘。教练将通过定期调查和会议监视导师/导师三合会内指导关系的质量，并将向项目团队提供反馈。与开发和实施此培训的同时，我们将研究审阅者如何发展EER的心理模型。正在进行的有关同行评审过程的研究确定了问题，包括缺乏审阅者培训，不一致和有偏见的审查以及资格审核者的缺乏。质量差的同行评审可能会导致质量差的奖学金；负面评论过于苛刻，可以排除社区中各种各样的声音和扼杀创新。我们将利用通过JEE指导审阅者计划开发的培训框架，参与者在该计划中描述了扩展专业知识的积极成果，对研究质量的更多了解，并将对同行评审的主导（负面）话语转移到对知识生产和出版更积极的看法。采用社会文化的观点，即认识到社会互动在知识和元认知共同建设中的作用，我们提出了这些研究问题：学者如何通过协作构建同行评审来开发质量工程教育研究的架构？手稿的模式开发与赠款提案审查之间有什么相似性和差异？EER PERT计划将提高EER手稿和建议的质量，并最终增加奖学金对EER的影响。通过在EER社区内开发奖学金审查技能创建的积极反馈循环将最大化NSF在EER项目中的投资。该奖项反映了NSF的法定任务，并被认为是值得通过基金会的知识分子优点和更广泛影响的评估评估标准来通过评估来支持的。

项目成果

Board 194: A Community-Driven Process for Developing NSF Review Panelists

Board 194：社区驱动的 NSF 审查小组成员培养流程

• 发表时间: 2023
• 期刊: ASEE Annual Conference proceedings
• 作者: Bates, R.;Benson, L.;Sims, R.;Watts, K.;Jensen, K.;Ko, E.;Lichtenstein, G.
• 通讯作者: Lichtenstein, G.

Peer reviewer training to build capacity in engineering education research

同行评审员培训以建设工程教育研究能力

• DOI: 10.1080/22054952.2023.2214459
• 发表时间: 2023
• 期刊: Australasian Journal of Engineering Education
• 作者: Watts, Kelsey;Sims, Randi;Ko, Evan;Jensen, Karin;Bates, Rebecca;Lichtenstein, Gary;Benson, Lisa
• 通讯作者: Benson, Lisa

Overlooked, Underlying: Understanding tacit criteria of proposal reviewing during a mock panel review

被忽视的，潜在的：了解模拟小组审查期间提案审查的默认标准

• 发表时间: 2023
• 期刊: Proceedings ASEE annual conference
• 作者: Sims, R.;Watts, K.;Ko, E.;Bates, R. A.;Lichtenstein, G.;Jensen, K.;Benson, L.
• 通讯作者: Benson, L.