STEMskiller: Skill Set Map for Mentors of Early Career Researchers
RESEARCH AND SCHOLARSHIP: Perspectives on "open" movements
Open Evaluation: definition, why important, current trends, examples
Definition:
In terms of the evaluation of scholarly outputs (journal articles, proposals), “open evaluation” can refer to the judging of an output not just by a jury of experts (“classic expert evaluation”; for scholarly journals, this often means blind peer review) but rather by a jury of anyone interested in the output. Such evaluation mechanisms are, at the time of writing this entry, controversial and part of evergreen discussions about how scholarly peer review is performed.
Useful resources on Open Evaluation:
Open Science MOOC. (n.d.). Open evalution. https://opensciencemooc.eu/modules/open-evaluation/
Describes rationale behind open evaluation as defined as open peer review. Lists competencies researchers should possess and includes links to helpful tools, research articles and report, and other materials on this topic.
Teixeira da Silva, J.A., & S. Nazarovets. (2022). The Role of Publons in the Context of Open Peer Review. Publishing Research Quarterly. https://doi.org/10.1007/s12109-022-09914-0
Discusses open peer review using the case of Publons and Clarivate in the context of transparency and improving the quality and reputation of published scientific outputs.
Velamuri, V.K., Schneckenberg, D., Haller, J.B.A., & Moeslein, K.M. (2017). Open evaluation of new product concepts at the front end of innovation: Objectives and contingency factors. R&D Management Journal. Preprint for R&D Management Journal. https://www.researchgate.net/profile/Vivek_Velamuri/publication/279777177_Open_evaluation
_of_new_product_concepts_at_the_front_end_of_innovation_Objectives_and_contingency_factors/
links/5dcdf3a392851c382f3dffca/Open-evaluation-of-new-product-concepts-at-the-front-
end-of-innovation-Objectives-and-contingency-factors.pdf
Describes, in detail, the concept of open evaluation and its role in innovation competitions. Helpful definitions and list of more reading.
Tags: IPSCritT; IPS IA; PSR GL; CompS
Peer Review: None
Table of contents:
1.9.2. Open Evaluation: definition, why important, current trends, examples
Author: Stephanie Krueger
Peer Reviewer(s): None
Last Updated: November 4, 2022