Risk of Bias Assessment: RoB 2 vs. ROBINS-I
On this page
One of the most common -- and most avoidable -- errors in a submitted systematic review is applying the wrong risk-of-bias tool to the included studies. It happens more than it should, usually because a review includes a mix of randomized and non-randomized studies and the same tool gets applied to both.
Why the tool has to match the study design
Risk-of-bias tools are built around the specific ways bias can enter a particular study design. Randomized controlled trials and non-randomized studies fail in structurally different ways -- randomization itself controls for a category of confounding that observational studies simply don't have.
RoB 2: for randomized trials
RoB 2 (the Cochrane Risk of Bias tool, second version) is built specifically for randomized controlled trials. It assesses bias across five domains: the randomization process itself, deviations from intended interventions, missing outcome data, measurement of the outcome, and selection of the reported result.
ROBINS-I: for non-randomized studies
ROBINS-I exists because observational studies need a tool that accounts for confounding and selection bias in ways RCTs generally don't. It assesses seven domains, including confounding and selection of participants into the study.
The practical decision
The choice is determined by study design, not by preference. Randomized controlled trials, including cluster-randomized and crossover trials, use RoB 2. Cohort studies, case-control studies, and other non-randomized designs use ROBINS-I. A systematic review that includes both types needs to apply both tools, matched correctly, and present the results separately.
What this affects downstream
Risk-of-bias judgments feed directly into GRADE certainty ratings, which in turn shape how confidently a review's conclusions can be stated. Getting this step wrong doesn't just risk a reviewer comment -- it can understate or overstate the actual reliability of the evidence base the review is built on.