Structured peer review: pilot results from 23 Elsevier journals

In this paper, EASE Peer Review Committee Chair Mario Malički and Vice-President Bahar Mehmani analyze the impact of introducing Structured Peer Review on over 250 Elsevier journal reviewer performance.

This work is built on top of earlier experiments where Bahar, Mario and colleagues introduced editors’ and authors’ ratings of the quality of peer review reports, then independently rated each review report’s quality using Review Quality Instrument. The results of those studies found little alignment between editor and author “perception of quality” and the actual quality measured by existing instruments:

The results of this new study indicate that reviewers successfully adapted to the new review format, and that they covered more topics than in their traditional reports. The format of structured reviews is based on Elsevier’s bank of questions, comprised of a list of eight core questions each for research and review articles, and additional optional questions, designed to make it easier for reviewers and editors to convey recommendations for improving articles in a consistent constructive manner.

Reference:

Malički M, Mehmani B. 2024. Structured peer review: pilot results from 23 Elsevier journals. PeerJ 12:e17514 https://doi.org/10.7717/peerj.17514