## The Unwritten Rules of Constructive Peer Review So, you’ve received your first invitation to peer review a manuscript. Congratulations. This is a significant milestone in an academic career, a sign that you are recognized as an expert in your field. But after the initial excitement, a sense of dread might set in. What are you supposed to do now? How do you provide feedback that is both critical and helpful? Peer review is the bedrock of scholarly publishing, yet it's a skill rarely taught in graduate school. We learn by receiving reviews—some helpful, many not—and are left to figure out the rest. This guide breaks down the process into a clear, actionable workflow, helping you move from a nervous first-timer to a confident and sought-after reviewer. Being a good reviewer doesn't just improve the literature; it makes you a better writer and a more critical thinker. ## Step 1: The Triage – To Review or Not to Review? Before you even open the manuscript PDF, you need to answer three questions honestly. A quick, decisive "no" is always better than a delayed, poor-quality review. ### Do I have the right expertise? The editor thinks you do, but you are the final judge. Read the abstract carefully. Do you understand the core concepts, the methods used, and the context of the work? If the paper uses a statistical method you’ve never heard of or a lab technique far outside your specialty, you might not be the right person. It's okay to tell the editor, "I can comment on the theoretical framework but not the specific quantitative analysis." ### Do I have a conflict of interest? Conflicts of interest can compromise the objectivity of your review. According to COPE (Committee on Publication Ethics), you should decline to review if: * You have recently collaborated or co-authored with one of the authors. * You are in direct competition with the authors. * You work at the same institution. * You have a financial stake in the outcome of the research. If you are unsure, it's always best to contact the editor and disclose the potential conflict. Transparency is key. ### Do I have the time? Journals typically give reviewers a deadline of two to four weeks. Look at your calendar. If you have a grant deadline, a major conference, or a personal commitment looming, be realistic. Rushing a review helps no one. Declining promptly allows the editor to find an alternative reviewer without delaying the process for the authors. ## Step 2: The First Pass – Reading for the Big Picture Once you’ve accepted the invitation, it’s time for the first read-through. The goal here is not to find typos or critique figure legends. The goal is to understand the paper’s central argument and assess its overall quality. During this first pass, try to answer these "big picture" questions: 1. **What is the core research question?** Can you summarize the paper's main goal in a single sentence? If not, the authors may have a clarity problem. 2. **Is the question interesting and important?** Does this research address a meaningful gap in the literature? Why should anyone care about these findings? 3. **What is the authors' main claim or conclusion?** What is the key takeaway message they want you to remember? 4. **Do the results plausibly support the conclusion?** On this first read, you're doing a gut check. Do the claims seem consistent with the evidence presented? We'll scrutinize this in the next step. 5. **Who is the intended audience?** Is the work a good fit for the scope and readership of this particular journal? After this initial read, you should have a general feeling about the paper: "This is a strong study with minor issues," "Interesting idea, but the execution is flawed," or "This paper is fundamentally unsound." This initial impression will guide your more detailed analysis. ## Step 3: The Deep Dive – A Section-by-Section Analysis Now, it’s time to put on your detective hat. Read the paper again, this time with a critical eye, taking detailed notes as you go. A good strategy is to have a separate document open to jot down your thoughts, organized by manuscript section. ### Introduction * **Motivation:** Does the introduction create a compelling case for why this research is needed? Is the "gap" in the literature clearly defined? * **Literature Review:** Is the review of prior work fair and comprehensive, or does it ignore conflicting findings? Does it position the current study effectively? For a helpful framework, check out our guide on [how to write a literature review that proves novelty](/blog/how-to-write-a-literature-review-that-proves-novelty/). * **Hypotheses/Aims:** Are the research questions or hypotheses clearly stated and well-justified? ### Methods This is often the most critical part of the review. Flawed methods lead to invalid conclusions. * **Clarity and Reproducibility:** Is there enough detail for another researcher to replicate the study? Vague descriptions are a major red flag. * **Appropriateness:** Are the chosen methods, materials, and participants suitable for answering the research question? * **Analysis:** Is the statistical analysis appropriate for the study design and data type? If this is outside your expertise, state that clearly in your review. ### Results * **Clarity:** Are the results presented in a logical and understandable way? Do the text, tables, and figures align? * **Presentation:** Are the figures and tables clear, well-labeled, and necessary? Do they accurately represent the data? A poorly designed figure can obscure an important finding. If the authors need help, you might direct them to our guide on [creating publication-quality figures](/blog/a-researchers-guide-to-creating-publication-quality-figures/). * **Objectivity:** Do the authors present the results objectively, or do they mix interpretation with their findings? The raw results should be stated first, with interpretation saved for the Discussion. ### Discussion & Conclusion * **Interpretation:** Do the authors interpret their results correctly? Do their conclusions logically follow from the data presented? * **Context:** Do they place their findings back into the context of the broader literature mentioned in the introduction? * **Limitations:** Do the authors acknowledge the limitations of their study? A lack of a limitations section can suggest overconfidence or a lack of critical self-reflection. * **Contribution:** Do the conclusions match the scale of the evidence? Be wary of authors who claim to "revolutionize the field" based on a small or preliminary study. ## Step 4: Writing the Review – The Art of Constructive Criticism Your notes are complete. Now you need to structure them into a formal report. A good review is a service to both the editor and the authors. It should be clear, organized, and professional. ### Structure of a Good Review Most editors appreciate a review structured in the following way: 1. **Summary Paragraph:** Start with a brief paragraph summarizing the paper's research question, methods, and main findings. This shows the editor and authors that you have understood the work. Conclude this paragraph with your overall assessment of the paper's strengths and weaknesses. 2. **Major Concerns:** This is the most important section. In a numbered list, detail the 2-4 most significant issues that must be addressed. These are potential "fatal flaws" related to methodology, unsupported conclusions, or a lack of novelty. Be specific. Instead of saying "the analysis is weak," say "The use of a t-test is inappropriate for this non-normally distributed data; a Mann-Whitney U test would be more suitable." 3. **Minor Concerns:** In a separate numbered list, outline smaller issues. This could include suggestions for clarifying a paragraph, requests for additional citations, mislabeled figures, or significant typos. This section shows you've read the paper carefully and are trying to help the authors improve the final product. ### The Golden Rule: Be Kind and Constructive Remember there is a human on the receiving end of your review. The goal is to improve the paper, not to tear down the author. * **Do:** Focus your critique on the manuscript, not the authors. Say "The manuscript does not clearly state..." instead of "The authors failed to state..." * **Don't:** Be sarcastic, condescending, or hostile. Inflammatory comments are unprofessional and unhelpful. * **Do:** Frame feedback as suggestions. For example, "The argument could be strengthened by considering the alternative hypothesis that..." * **Don't:** Demand experiments that would take another year to complete, unless they are absolutely essential to support the central claim. Suggesting them as "future directions" is more appropriate. * **Do:** Acknowledge the strengths of the paper. Starting the review with a positive comment about what you liked can make the constructive criticism easier to hear. Peer review is a reciprocal endeavor. The next manuscript under review could be yours. Write the kind of thoughtful, rigorous, and helpful review you would want to receive. By doing so, you not only fulfill your responsibility to the community but also sharpen the skills that are essential for your own success as a researcher.