A recent pan-EMBL event provided an opportunity to reflect on responsible research assessment in scientific institutions.| EMBL
Guest post by Iratxe Puebla, from Make Data Count. The majority of research activities involve creating, collecting, or using data. While datasets constitute the backbone of research activities, they are currently sidelined as part of research evaluation frameworks which predominantly focus on article publications. This is a missed opportunity in evaluation: Recognition for datasets is… The post Advancing Responsible Research Assessment Through Data Evaluation appeared first on DORA.| DORA
This guest blog is republished from the LSE Impact Blog, first published in December 2024 here. This is the third part of a three-part series written by Noemie Aubert-Bonn, Claire Fraser, Elizabeth Gadd, Haley Hazlett, and Karen Stroobants, on Unanswered questions in research assessment. Reflecting on the diversity of global research assessment reform movements, Karen… The post Unanswered questions in research assessment 3 – Can global reform efforts be diverse and aligned? appeared fir...| DORA
This guest blog is republished from the LSE Impact Blog, first published in December 2024 here. This is the second part of a three-part series written by Noemie Aubert-Bonn, Claire Fraser, Elizabeth Gadd, Haley Hazlett, and Karen Stroobants, on Unanswered questions in research assessment. Noemie Aubert Bonn and Haley Hazlett discuss the importance of applying scholarly… The post Unanswered questions in research assessment 2 – Can we apply the scientific method to research assessment? a...| DORA
This guest blog is republished from the LSE Impact Blog, first published in December 2024. Reflecting on the ongoing reform of research assessment, Claire Fraser and Elizabeth Gadd question some existing approaches. Here they discuss how reform efforts may need to reconsider the usefulness of value-led strategies.| DORA
Journals and peer review are unlikely to change for the better if the companies that operate scientific indexes and citation databases continue to stifle innovation. At eLife we believe that the content of a research article is more important than the name or impact factor of the journal in which it is published. Our approach to scientific publishing – which we adopted in 2023 – combines the immediacy and openness of preprints with the expert evaluation provided by peer review.| DORA
The innovative F1000Research open research publishing model was launched in 2012 and was born out of a desire to start again, thinking about the technology and tools at the time and redesigning how we share and critically review new discoveries and support others to then build on them. The biggest challenge is the way that we typically currently assess and incentivise researchers and the research processes that they use, which together in effect disincentivises the use of these new publishing...| DORA
The post Judging research on its own merits: How MetaROR supports better research assessment appeared first on DORA.| DORA
The post Implementing Responsible Research Assessment in India appeared first on DORA.| DORA
We are pleased to announce that OPERAS has published its own CoARA Action Plan to build a coherent approach to research assessment reform and to further align our practices with the commitments of the...| OPERAS
Over the past few decades, UK universities and other higher education institutions have been subject to an assessment of their research quality through something called the Research Assessment Exercise (RAE) and more recently the Research Excellence Framework (REF). When I got an academic job at the University of Sheffield in 2008, it was probably because my last name is Rae and the year was 2008 and they thought I'd be good for their RAE2008 profile. Anyway, I left my academic job a couple o...| Stats, Maps n Pix
The creation of the Coalition for Advancing Research Assessment (CoARA) has led to a heated debate on the balance between peer review and evaluative metrics in research assessment regimes. Luciana Balboa, Elizabeth Gadd, Eva Mendez, Janne Pölönen, Karen Stroobants, Erzsebet Toth Cithra and the CoARA Steering Board address these arguments and state CoARA’s commitment to finding ways in which peer review and bibliometrics can be used together responsibly.| Social Science Space
(A PDF version of this post is available on HAL.)| Research Practices and Tools
There seems to be a consensus among universities and research funders that research assessment should not be based on crude quantitative metrics, such as: numbers of articles, numbers of citations, journal impact factors, the h-index, etc. The 2012 San Francisco Declaration on Research Assessment (DORA) formulates principles which could greatly improve research assessment if they were applied, although I would argue that the DORA is misguided in its recommendations to authors. The DORA has be...| Research Practices and Tools