Open Evaluation
What is Open Evaluation?
Open Evaluation refers to an assessment process that is conducted in an open, transparent and inclusive manner and is strongly related to Open Science practices. In this respect, Open Evaluation essentially advocates the recognition of a broader range of research quality or research-related activities assessed by scientific communities, research institutions as well as research funding organisations.
Therefore, Open Evaluation focuses on qualitative and comprehensible aspects and research activities, such as open sharing of high-quality research results, science communication, incorporation of open research agenda setting (address societal needs, invite citizen scientists) as well as enabling open peer review and publishing open educational resources or the involvement in academic bodies to improve teaching and research. The current debate on the reform of research assessment criteria is processed in the Coalition for Advancing Research Assessment (CoARA), that is based on an agreement initiated in 2022 by a core group of European research organisations and individual researchers.
What are the benefits for you?
- Fostering qualitative based research and strengthening the robustness of science
- Enabling transparent and open discourse on research
- Fostering the recognition of a wide range of metrics to assess the reputation of researchers
- Increasing trust in quality assurance mechanisms in research and in research results per se
- Minimising publication pressure and fostering alternative research assessment procedures
Requirements
- Strong willingness to improve current joint research practice
- Knowledge of (alternative) assessment criteria of research institutions, funding organisations and journals/publication platforms
- Knowledge of Open Science activities and participation formats inside and outside research institutions
- Willingness to share your experience and train early-career researchers on Open Science activities and raising awareness of the effort involved in participating in research assessment activities
- If you are a supervisor, foster and recognise engagement in several research related and Open Science activities, like (open) peer review, open data publishing, academic teaching or the participation in institutional bodies
Resources
- Open Science Mooc – Open Evaluation
- Open Science Training Handbook – Open Peer Review, Metrics and Evaluation
- FOSTER Online Course – Open Peer Review (Video)
- Open Science Conference 2023: Panel Discussion on Reforming Research Assessment in the Spirit of Open Science (Video)
- Open Economics Guide – The Role of Open Science in the Evaluation of Research Work