The unique academic, peer-review process (where, within the editorial structure of a biomedical or scientific journal, academic peers formally evaluate and comment on a manuscript) has been much discussed and debated. Despite the comments of critics and polemicists, the peer review process is central to our familiar system of academic publication, and an essential component of producing quality published research.
A journal's reviewers have the dual responsibility of being advisors to both editor and author. The reviewer's careful, skillful assessment helps authors to develop and refine their manuscript, and also assists editors to identify research worthy of dissemination. The system continuously improves the standard of evidence available to those who work in the scientific and medical (including nursing and allied health) communities.
It is breathtaking to consider the scope of this cooperative, international system where the altruistic efforts of many result in enormous collective benefit.
Since 2001, reviewers have been using the Rural and Remote Health (RRH) online system to review rural health manuscripts. The Journal's database of reviewers is now a substantial repository of international rural health expertise and knowledge.
Most material in the journal is peer reviewed, with the exception of some letters to the editor, invited articles, editorials and comment-and-reply exchanges.
Articles are generally assessed by three reviewers – two from within the world region of the manuscript content, and one international. Occasionally there will only be two reviews, and sometimes a fourth review is required (eg to clarify polarisation of the reviewers).
Most RRH authors are highly appreciative of reviewer guidance, with author surveys consistently showing a high level of author satisfaction with reviewer comments.
Reviewers are carefully selected and invited to join our reviewer panel to review individual manuscripts. Our criteria are generally that reviewers hold a PhD or equivalent award, or are specialist clinicians – and of course they will usually have an academic or vocational association with rural health.
The exceptions to this are reviewers with specific knowledge required for a specialised manuscript, or those from under-represented groups or world regions. And occasionally a particular manuscript will require the assessment of a reviewer with a specific occupational qualification.
The origin of RRH reviewer invitees includes:
Potential reviewers are initially approached by a Regional Editor, the Journal Manager or Senior Editor by email. On accepting the invitation to join the RRH panel, reviewers are asked to provide a brief description of their main areas of academic and/or clinical interest in order to match them with the most appropriate manuscripts for review.
Those not already journal users are asked to register with the journal. This is important because the review process is completed online at the journal site.
Once the reviewer is registered and an article allocated for review, the journal system issues an alert to the reviewer's registered email address. On receipt of an alert email, reviewers can accesses a PDF of the manuscript for review by logging in to the journal and opening their own status page. Because reviewers and authors are anonymous (double blinded process), the reviewer PDF will not contain any identifying features. Specific editor's comments for the reviewers will also be available on the status page at this time.
As well as a list of articles reviewed and for review on the status page, reviewers use this status page to submit their assessment, evaluation and comments. There is provision here for confidential comments to the editor, as well as the specific comments for the authors.
Reviewers can decline an allocated manuscript and also give a reason for this if they wish.
Please be aware that the reviewer comments page on the RRH site is meant for uploading comments, rather than word processing. So when it comes to uploading review comments for a manuscript, please retain the text as a Word document in case of time-out or other disruption leading to data loss.
Reviews are usually requested within 2 weeks of the advice email. During that time, any general queries or reports of difficulty with the process should be directed to the Journal Manager, or sent via the 'Contact us' link on the home page. Advice of a delay in submitting the review is always appreciated and avoids unnecessary reminders from journal staff.
Peer review occurs within a cooperative system involving Regional Editor, reviewer and journal staff. To avoid misunderstanding, it is important that the expectations of both reviewers and those who represent the journal are clear, realistic and reasonable.
What reviewers can expect from RRH
RRH acknowledges the many demands on those in the rural academic and healthcare community. We understand that your time is valuable and so are highly appreciative of your efforts on behalf of the Journal's authors. Because of this:
Reviewers can expect courteous treatment and are assured that their opinions will be valued and given serious consideration. Their contribution will be publicly acknowledged in an annual acknowledgement of journal reviewers. However, if you would prefer your name not to be published in this list, please let our editorial office know.
Access to the RRH database of reviewers is limited strictly to journal staff and Regional Editors, as is the identity of the three reviewers of any individual manuscript.
What RRH asks of its reviewers
It is disheartening for authors to have to wait for long periods for a decision about revision, and sometimes the momentum of the work can be difficult to regain. Therefore, the Journal's expectations of reviewers also begin with time considerations. Please:
In addition, as an extension of your usual ethical conduct, please:
In terms of the content of your assessment and evaluation, please:
Occasionally reviewers are asked to provide the Regional Editor with a second opinion after an author's revision and resubmission.
If an article is assessed as requiring rapid review, a personal request may be made to the reviewer to perform the review in less than the usual 2 weeks. It is understood that not all reviewers are able to offer this. However, if this is something you are prepared to do, please advise our editorial office.
While the Journal's review process is anonymous, reviewers are welcome to 'sign' their comments for transmission to authors. Please advise the journal staff if you wish your identity to generally be revealed to the authors, or note it at the end of a specific review.
It is expected that reviewers will not make use of any of the work in the manuscript until after publication. This includes an expectation that reviewers will not reveal the content of a review manuscript to others.
When reviewers lodge conflicting opinions about a manuscript it is the Regional Editor's difficult task to make the final decision. Therefore, from time to time a particular reviewer's evaluation or parts of the evaluation will be considered but not passed on to the authors. Likewise, if the editor believes certain reviewer comments to be unhelpful or overly critical, these may be withheld from the authors.
The reviewer list is reviewed annually to ensure adequate representation and effectiveness. Because the review process is so central to journal function, reviewers who are inactive will be retired with thanks at this time.
Recommendations for new reviewers who meet journal criteria are welcome at any time and should be directed to our editorial office. Inexperience in reviewing is not a barrier to inclusion.
Reviewers are best placed to identify impediments to optimum performance of the Journal's system of review. Comments and suggestions to editors or staff about potential improvements are always welcomed and given serious consideration.
Finally, in common with most journals and as a not-for-profit journal, RRH does not pay for reviews. However, many reviewers report they are rewarded for their efforts by a sharpening of their own critical thinking, and heightened academic writing skills. We hope this is so for you.
Everyone has to start somewhere. RRH is pleased to include reviewers who meet the journal criteria but have not previously participated in the academic review of manuscripts.
For those new to reviewing, RRH asks that you take time to become familiar with the content of the journal in order to understand the scope of material you may be asked to review.
Information about peer review is available on internet search and many new reviewers have found the following articles helpful:
While the process of review is new, it may be tempting to discuss the content of a manuscript with colleagues. We do, however, ask you to bear in mind that although the manuscript has been submitted for publication, at the time of review the content of all manuscripts is confidential.
It will be of assistance to you and will enhance the quality and usefulness of your reviews if you are able to develop a methodical system for assessing manuscripts. Some (but by no means all) aspects to consider are the:
If you have any concerns or questions please contact the journal manager in the first instance, and she will do her best to respond appropriately and in a timely fashion, or to refer the question on if necessary.
The World Association of Medical Editors (WAME) Editorial Policy Committee's statement, Definition of a Peer Reviewed Journal.
The International Committee of Medical Journal Editors (ICMJE). Recommendations for the conduct, reporting, editing, and publication of scholarly work in medical journals.
Last modified September 2016