Guidelines for Reviewers for Registered Reports

The review process for Registered Reports is divided into two stages.

In Stage 1, reviewers assess study proposals before data is collected.

In Stage 2, reviewers consider the full study, including results and interpretation.

 Stage: 1

When reviewing Stage 1 paper, note that no experimental data or results are included. Reviewers only need to assess the method, including, for example:

1. The importance and soundness of the proposed hypotheses;

2. The suitability and feasibility of the experimental and analysis methodology;

3. Whether there are sufficient details given to replicate the proposed experimental procedures and analysis;

4. Whether there are sufficient outcome-neutral tests of the hypotheses, including positive controls and quality checks.

 Stage: 2

Manuscripts that pass Stage 1 peer review may be published immediately or after the successful completion of Stage 2 (at the authors’ discretion). Editorial decisions will not be based on the importance or novelty of the results.

For Stage 2 manuscripts, reviewers will be asked to appraise:

1. Whether the data was adequate to test the proposed hypotheses by satisfying the approved outcome-neutral conditions (such as quality checks, positive controls);

2. Whether the stated hypotheses tested was the same as the approved Stage 1 submission;

3. Whether the authors adhered precisely to the registered experimental procedures or were able to sufficiently justify any changes;

4. Whether any new analyses (not mentioned at Stage 1) are methodologically sound and relevant;

5. Whether the authors’ conclusions are justified.