The Wiley Network

Wiley's Better Peer Review Assessment: 5 Essential Standards

What is Better Peer Review?

The purpose of scientific and scholarly literature is the communication and curation of a definitive report of conducted research. Peer review serves this purpose by providing a qualitative check of the articles reporting that research.

Embracing openness and transparency, our Better Peer Review (BPR) initiative was evolved to ensure that the high standards we work with remain meaningful, accountable and transparent for both editors and researchers alike.

We identified five essential areas that provide a framework for all stakeholders, throughout the publishing process. Read more about our methodology and how we developed the initiative in this article.

INTEGRITY

Peer review establishes that the work is reliable and potentially reproducible. It addresses the integrity of the work under review when it focuses on ensuring that researchers publish an accurate, verifiable, and complete representation of how they did their work and the outcome.

Learn more

ETHICS

Peer review establishes that the work was conducted ethically. It addresses the ethics of the work under review when it establishes that the work was conducted responsibly, treating the participants (people, animals), the environment, and colleagues responsibly, in a way that minimizes harm and meets community expectations (self-regulation) and regulatory requirements.

Learn more

FAIRNESS

Peer review is objective and impartial. It is fair when it considers papers on their own merit, without regard for the identity of the author(s) or the reviewers’ and editors’ own interests. Fairness is also rooted in a straightforward moral philosophy—treat others as you would like to be treated.

Learn more

USEFULNESS

Peer review is constructive and helpful. It is useful when it benefits all stakeholders. It means providing constructive feedback to authors so that they can improve the clarity and accuracy of their research article and report their work in the best possible way. It means providing reviewers with concise and easily accessible guidance on assessing papers.

Learn more

TIMELINESS

Peer review provides timely feedback for authors. It is conducted in a timely manner when an outcome is reached quickly, without compromising the focus on integrity and ethics, or the usefulness and fairness of the review process. Timely publication means research results are published when they are most relevant for further research.

Learn more

What does this mean for editors?

We asked editors questions about their peer review experiences and policies in relation to the topics 'Reviewers,' 'Editorial Policy,' and 'Authors.' After analyzing their responses to the questions, we’ve come up with a set of recommendations for each of the five essential areas. Click each question to see our recommendations for editors.

Reviewers


Integrity

 Explain how reviewer contributions are used to facilitate the editorial decision in the initial contact email, reviewer report form and follow-up emails. Editorials can also be helpful in emphasising the importance of reviewer contributions.

The importance of a constructive report can be emphasised in the initial invitation email, reviewer report form and reviewer guidelines. Providing this information in presentations, editorials, and newsletters can also be helpful.

Add specific questions on the reviewer report form to focus attention on the methodology used in the manuscript, ensuring it is sufficiently detailed to allow for replication.

 A combination of approaches is helpful to ensure appropriate peer reviewers are invited, including individual knowledge, reviewer selection tools, and searches on specialty/areas of expertise.


Ethics

Provide reviewers with contact information for the editorial office in the invitation email, reviewer report form and follow-up emails. Encourage reviewers to contact the editorial office with any questions they may have.


Fairness

Ask reviewers about any potential conflicts of interest in the invitiation email. Peer review guidelines should include examples of potential conflicts of interest. Give reviewers the option to decline due to potential conflicts of interest.

Check that reviewers who have been recently associated with the author (e.g. recent collaboration or located at the same institution) or who may have any other potential conflicts of interest are not invited to peer review. Editor support and training is helpful to discuss what could constitute a potential conflict of interest.

Encourage diversity when selecting reviewers, including but not limited to gender, race/ethnicity, sexuality, nationality and location. Journals should take a proactive attitude to diversity by encouraging inclusivity and providing training for journal teams.

Discourage reviewers from raising unreasonable additional issues at re-review by giving reviewers clear guidance about what is expected at each stage. Emphasise that the purpose of the re-review is to ensure requested changes have been made.

Editors should seek to invite a diverse range of reviewers and should be aware of trends relating to diversity and bias within their journal and commuity. Editoral teams should receive implicit bias training and discuss implicit bias issues in peer review guidelines.


Usefulness

Inform reviewers of editorial decisions of manuscripts under review, including the reasons for such a decision.

Editors should also provide comments and guidance to the author in addition to those of the reviewers.

Reviewers should be recognised for the contribution they make, for example via Publons, certificates, awards, etc.

Reviewers should be encouraged to give feedback to the journal on how they found the peer review process.


Timeliness

The reviewer invitation email should ask reviewers to respond, even if they are unavailable to review. The invitation email could include a request for alternative reviewer recommendations, if the invited reviewer is unable to assist. Reviewers should also have a means to alert the editorial office if they believe that their review will be delayed. The editorial team should follow up if a reviewer is unresponsive or overdue.


Editorial Policy


Integrity

Readers should be encouraged to raise any concerns with information on how to do this provided on the journal website. All concerns raised should be fully investigated within COPE guidelines and all feedback should be followed up on.

Editorial criteria for consistent decision making should be discussed regularly. New editors should be given appropriate guidance and/or mentoring on their decision making with additional support from the Editor-in-Chief where necessary. The accept/reject rates of editors could be monitored and discussed regularly to ensure consistency of editorial decisions.


Ethics

Journals should have a transparent policy on their approach to what types of image manipulation are appropriate and acceptable. Where possible, checks on images are advisable.

Plagiarizing the work of others is inappropriate and unethical. Journals will follow COPE guidelines in handling cases of suspected plagiarism.


Fairness

 All members of the editorial team should be given guidance on how to handle potential conflicts of interest. If there is a potential conflict of interest for a handling editor, and other member of the editorial team should handle the manuscript. Potential conflicts of interest should be referred to the Editorial office and editors should be prepared to recuse themselves if conflicts of interest arise.


Usefulness

The manuscript evaluation process should be explained in author submission guidelines and reviewer invitation emails. Editors should be made aware of the process in training. Editorials detailing the process can help to explain the process to readers, authors and reviewers and can be linked to from author guidelines.

 Encourage editors to offer feedback on the editorial process. In regular meetings ask for feedback on editorial processes and editor experiences. Inform editors of changes to practice before implementing any changes. Annual editor surveys are helpfu to review practice.


Timeliness

It can be helpful to use screening tools for manuscript checks - such as those that highlight overlapping text or potential figure manipulation. Tools that can assist with finding potential reviewers are helpful too.

It can be helpful to use screening tools for manuscript checks - such as those that highlight overlapping text or potential figure manipulation. Tools that can assist with finding potential reviewers are helpful too.

Regular reporting and review of workflows and metrics are helpful. Monthly team meetings and broader annual meetings can help to make immediate and long-term workflow improvements.


Authors


Integrity

  •  Ask authors to declare funding sources at submission and ensure this information is included in the article.
  •  Ask authors to declare potential conflicts of interest at submission and ensure this information is included in the article.
  •  Ask authors to declare potential conflicts of interest at submission and ensure this information is included in the article.

Ethics

Ask authors to provide details of any ethical approvals, including information of the ethics committee and reference number where appropriate. Ensure that this information is included in the article.


Fairness

All journals should have a policy on authorship explained in the author guidelines that allows for transparency around who contributed to the work, and in what capacity, in accordance with COPE guidelines.

All authors should be copied into emails so that they are aware of the submission and subsequent decisions.

 Information on how authors can appeal against editorial decisions should be included in the decision email, on the journal website and in the author guidelines.


Usefulness

Journals should seek feedback from authors about their experience of the editorial process via decision emails or surveys, and where appropriate, act on it.

As well as including checklists for authors in the author guidelines it can be helpful for editorial teams to check that relevant information is provided. Tips on how to write a manuscript suitable for consideration in the journal can be helpful to share.


What does this mean for researchers?

We value researchers and want to give you insight into our peer review initiative by looking at the editor questions and recommendations from your perspective. The topics cover 'Reviewers,' 'Editorial Policy,' and 'Authors,' and their responses have been categorized into the five essential areas. Click each question to see our recommendations for researchers.

Reviewers


Integrity

 Journals will use peer reviewers who are experts in the relevant subject area to review the manuscript and their comments will inform the editorial decision.

 Reviewer comments should be constructive and sufficiently detailed to provide researchers with helpful feedback.

Researchers should provide a full account of the methods used in their manuscript, which is sufficiently detailed to allow for replication.

Reviewers with relevant subject expertise should be invited to peer review the manuscript. Researchers may suggest potential reviewers based on subject expertise, if they wish, either in the submission website or in their covering letter.


Ethics

Researchers should be aware that if reviewers have any concerns or questions about the research presented they can raise these with the editorial office.


Fairness

Researchers should be aware that if reviewers have any concerns or questions about the research presented they can raise these with the editorial office.

If there is an opportunity to suggest potential peer reviewers do not suggest researchers who may have a potential conflict of interest (e.g. recent collaboration or work at the same institution).

If there is an opportunity to suggest potential peer reviewers, encourage diversity by including a broad array of potential reviewers including those in underrepresented groups (e.g. gender, race/ethnicity, sexuality, nationality and location).

Reviewers should not raise unreasonable additional issues at re-review. If you are unclear about any suggestions made seek advice from the editorial office.

Reviewers should not include other individuals to assist them with peer review without first checking with the journal. The journal should be aware of other individuals who have contributed to the review process.

If there is an opportunity to suggest potential peer reviewers, encourage diversity by including a broad array of potential reviewers including those in underrepresented groups (e.g. gender, race/ethnicity, sexuality, nationality and location).

Usefulness

Details about the decision on your manuscript will be shared with all reviewers, to help them understand the reasons for the decision.

In addition to peer reviewers comments expect to receive editorial guidance on how to improve your manuscript.

Researchers may wish to openly acknowledge the contribution that peer reviewers made in the Acknowledgements section of the manuscript if appropriate to do so.

All parties involved in the review process can give feedback to the journal on their experience.


Timeliness

Researchers can expect reviewers to be responsible in anticipating delays to the review process.


Editorial Policy


Integrity

Researchers can be assured that journals followed COPE guidelines to investigate any potential issues raised by readers.

Editorial criteria for consistent decision making should be discussed regularly. New editors should be given appropriate guidance and/or mentoring on their decision making with additional support from the Editor-in-Chief where necessary. The accept/reject rates of editors could be monitored and discussed regularly to ensure consistency of editorial decisions.


Ethics

Journals should have a transparent policy on their approach to what types of image manipulation are appropriate and acceptable. Where possible, checks on images are advisable.

Journals should have clear policy and procedures for investigating potential research integrity and publishing ethics issues in accordance with COPE. The policy should be explained to new editors and be included in author and reviewer guidelines.

Researchers can be assured that journals followed COPE guidelines to investigate any issues raised by readers.


Fairness

Researchers can be confident that editors will recuse themselves if they have a conflict of interest.


Usefulness

Researchers should have a clear understanding of how a journal evaluates the submissions it receives via the information shared on the journal's website.

All parties involved in the review process can give feedback to the journal on their experience.


Timeliness

Researchers should be aware that journals use tools for manuscript checks and should share this information on the journal website.

Researchers can expect journals to information on average anticipated decision times on the journal website or in email communications or updates.

Researchers can expect journals to regularly review their own processes and take action to alleviate any delays.


Authors


Integrity

Researchers should declare sources of funding and include a statement about this in the manuscript.

Researchers should provide details of any potential conflicts of interest in their manuscript.


Ethics

Researchers should provide details of any ethical approvals in their manuscript, including information of the ethics committee and reference number where appropriate.


Fairness

The journal's policy on authorship should be explained in the information on the journal's website and allow for transparency around who contributed to the work, and in what capacity.

All authors are copied into communication from a journal so that individual's are aware of the submission and subsequent decisions.

Authors have a right to be able to appeal against editorial decisions and information on how to do this should be provided on the journal website.


Usefulness

Feedback from researchers about their experience with the peer review process is always welcome.

It is possible to seek help from a journal on how to prepare your manuscript in the most useful manner, either via advice on relevant information or more formal copyediting.


Timeliness

Journals should share information on the various stages of peer review process or communicate this in an email confirming the submission of your manuscript.

Journals may share information on average times to initial decision and their acceptance rates on the journal website.

Researchers should expect journals to alert them to any potential delays in the peer review process.