Common Mistakes That Get Systematic Reviews Rejected
On this page
- Flow diagram numbers that do not reconcile
- Search strategy reported for only one database
- Registered protocol and reported methods that do not match
- Risk-of-bias tool mismatched to study design
- Meta-analysis model choice unsupported by reported heterogeneity
- Publication bias assessment skipped or done superficially
- GRADE ratings applied inconsistently or without justification
- Discussion that does not engage with the review's own limitations
- Title and abstract that do not identify the review type
- A practical pre-submission habit
- Authorship and contribution gaps
A striking number of rejected systematic reviews are not rejected because the underlying methodology was weak. They are rejected because of a specific, recurring set of reporting gaps and internal inconsistencies that a careful pre-submission read-through would have caught. Knowing this list in advance is one of the highest-leverage things a reviewer can do before submission.
Flow diagram numbers that do not reconcile
The single most commonly cited issue is a PRISMA flow diagram whose numbers do not add up cleanly, or do not match numbers stated elsewhere in the manuscript text. If your flow diagram shows 1,802 records screened but your results section states a different number, or if the excluded-at-full-text count does not match the sum of your stated exclusion reasons, this is often the very first thing a methods reviewer checks, and a mismatch here undermines confidence in every other number in the manuscript, regardless of how sound the underlying work actually was.
Search strategy reported for only one database
When multiple databases were searched but the full search strategy is provided for only one of them, often with a vague statement that "similar strategies were used" for the others, reviewers cannot assess whether your search was actually comprehensive and reproducible across all sources. PRISMA 2020 expects at minimum one complete, reproducible search string, and ideally all of them, in a supplementary appendix if not the main text.
Registered protocol and reported methods that do not match
A PROSPERO registration number in your manuscript invites a direct comparison between what you registered and what you actually did. Undisclosed deviations -- a changed primary outcome, a different risk-of-bias tool than originally specified, altered eligibility criteria -- are a serious credibility issue when discovered by a reviewer rather than disclosed by the authors. Minor, justified amendments are normal and expected; the problem is specifically the failure to disclose and explain them.
Risk-of-bias tool mismatched to study design
Applying RoB 2 to non-randomized studies, or failing to apply any named, validated risk-of-bias tool at all, is flagged immediately by any reviewer familiar with evidence synthesis methodology. This is one of the more mechanical, rule-based errors on this list, and also one of the easiest to catch in a pre-submission review specifically checking that each included study's design matches the appraisal tool applied to it.
Meta-analysis model choice unsupported by reported heterogeneity
Reporting substantial heterogeneity -- a high I-squared, a significant Q test -- and then presenting a fixed-effect pooled estimate without justification is a frequently cited statistical objection. Reviewers expect your model choice to be consistent with your own reported heterogeneity statistics, or to see an explicit justification when it is not.
Publication bias assessment skipped or done superficially
A meta-analysis with a meaningful number of included studies that omits any funnel plot or asymmetry test, or includes a funnel plot without any accompanying discussion of what it shows, misses an expected PRISMA reporting element. With fewer than ten studies, acknowledging that formal testing was underpowered is the correct move, rather than omitting the topic or running an unreliable test without caveat.
GRADE ratings applied inconsistently or without justification
A single GRADE certainty rating applied uniformly to the entire review, rather than separately by outcome, or downgrades stated without specifying which studies and which specific concern drove each one, both draw scrutiny from reviewers familiar with how GRADE is meant to be applied and documented.
Discussion that does not engage with the review's own limitations
A limitations section that lists generic, boilerplate limitations -- "some included studies had small sample sizes" -- without specifically connecting those limitations to how they affect confidence in this particular review's conclusions reads as a formality rather than genuine methodological reflection. Reviewers can tell the difference, and a substantive, specific limitations discussion -- naming which included studies drove uncertainty, and how that uncertainty should temper the review's headline conclusion -- is one of the more effective ways to demonstrate methodological maturity in a manuscript, often more persuasive to an experienced reviewer than a longer results section, since it signals the authors genuinely understand where their own evidence is strong, where it is genuinely thin, and precisely how that specific balance of strengths and gaps should shape a careful, informed reader's overall confidence in the review's stated conclusions.
Title and abstract that do not identify the review type
PRISMA expects your title to explicitly identify the work as a systematic review, and your abstract to include a structured summary covering objectives, eligibility criteria, information sources, risk-of-bias methods, synthesis methods, and main results. Abstracts trimmed for word count often lose this structure first, and it is one of the most mechanically simple items on the entire PRISMA checklist to get right, which makes it a particularly avoidable place to lose points with a reviewer.
A practical pre-submission habit
Before submitting, work through the full PRISMA 2020 checklist item by item against your actual manuscript, treating it as a drafting tool rather than something to consult only after a rejection.
Authorship and contribution gaps
A less methodological but still common rejection trigger is an incomplete or missing author contribution statement, particularly relevant given how many systematic reviews now involve methodology consultants, statisticians, or information specialists contributing to specific stages of the work. ICMJE authorship guidance expects contributions to be disclosed by role -- who developed the search strategy, who conducted screening, who ran the statistical analysis -- and journals increasingly check this explicitly rather than accepting a generic author list. Addressing this clearly in your submission, alongside the methodological items above, closes out one of the more avoidable non-methodological reasons a manuscript gets sent back before it even reaches full peer review.
Cross-check every number in your flow diagram against every number stated in your text. Confirm your registered protocol and your reported methods match, or that every deviation is disclosed and justified. This single habit catches the majority of the issues on this list, and it costs far less time than a full revise-and-resubmit cycle.