coreSR.AI
Learn

ROBUST-RCT

Risk of Bias instrument for Use in Systematic reviews — for RCTs

CoreSR implements the ROBUST-RCT tool with GLASS structured assessment. The model evaluates each item using a two-step approach — study-level then outcome-level — flag disagreements, and provide transparent rationale for every judgement.

AI Assessment Is a Starting Point

AI-generated assessments should always be reviewed and verified by a human assessor with domain expertise. The structured AI assessment highlights the evidence used, but the final judgement is yours. For published systematic reviews, all RoB assessments should be conducted by at least two independent human reviewers.

How It Works

Five steps from PDF upload to a complete two-step risk of bias assessment for randomized controlled trials.

1UploadPDFsFull-text papersSupplements2StudyDetailsTitle & authorsIntervention3Dual AIReviewAI Reviewer 1AI Reviewer 24Two-StepJudgementsStudy-levelOutcome-level5Review &OverrideUser overridesExport

Step-by-Step Guide

Each step builds on the previous one. AI assessment runs automatically after you provide the study details.

Step 1

Upload Study PDFs

Upload one or more full-text PDF files for the randomized controlled trial you want to assess. The AI extracts text from the PDFs to inform its judgements at both the study and outcome levels.

You can upload multiple PDFs per study (e.g., main paper + protocol + supplementary appendix) for more complete assessment.
Step 2

Enter Study Details

Provide the study title, authors, publication year, experimental intervention, and comparator. Specify the outcome(s) you want to assess at the outcome level.

The two-step approach means some items are assessed once per study while others are assessed per outcome.
Step 3

Run AI Assessment

Click "Evaluate with AI" to run the GLASS structured assessment. GLASS evaluates each item at both the study level and outcome level.

Assessment typically takes 30-60 seconds per study depending on PDF length and number of outcomes.
Step 4

Review and Override

Review each item's AI justifications and judgements at both levels. You can override any judgement. Pay attention to study-level items (randomization, allocation, blinding) as these apply across all outcomes.

Focus extra attention on low-confidence answers and sparse evidence.

Two-Step Assessment

ROBUST-RCT separates assessment into study-level items (assessed once) and outcome-level items (assessed per outcome).

Step 1

Study-Level Items

These items are assessed once per study and apply to all outcomes. They address the fundamental design characteristics of the trial.

S1

Randomization

Was the allocation sequence adequately generated? Was a random component used in the sequence generation process? Was the method of randomization appropriate for the study design?

S2

Allocation concealment

Was the allocation adequately concealed? Were steps taken to ensure that the allocation sequence was not known to those enrolling participants prior to assignment?

S3

Blinding

Were participants, personnel, and outcome assessors blinded to the intervention? If blinding was not possible, were adequate steps taken to reduce the impact of knowledge of allocation?

Step 2

Outcome-Level Items

These items are assessed separately for each outcome. Risk of bias can differ across outcomes within the same study.

O1

Incomplete outcome data

Were incomplete outcome data adequately addressed? Was attrition or exclusion from analysis reported and were reasons provided? Were methods used to handle missing data appropriate?

O2

Selective reporting

Was the study free of selective outcome reporting? Were all pre-specified outcomes reported? Were there discrepancies between the protocol and the published results?

O3

Other bias

Was the study apparently free of other problems that could put it at risk of bias? This includes baseline imbalances, early stopping, funding bias, or other methodological concerns.

Dual AI Review Process

GLASS assesses each item with structured step 1 and step 2 prompts.

When Reviewers Agree

If the AI output supports a clear item judgement, the suggested judgement is shown directly. A green "AI Agreed" badge is shown. The combined rationale is displayed for transparency.

When Reviewers Disagree

If the reviewers reach different judgements, the more conservative (higher risk) judgement is applied as a default. An orange "Disagreed" badge flags the item. Expanding the item shows each reviewer's individual judgement and a resolution rationale explaining why they differed.

Human Override

You can override any item judgement at both the study and outcome levels. Your decision always takes precedence over the AI. Overrides are tracked and clearly marked in exports for audit trails.

Judgement Scale

Low risk of bias

The study is judged to be at low risk of bias for this item.

Unclear risk of bias

Insufficient information to determine whether the item is at low or high risk of bias.

High risk of bias

The study is judged to be at high risk of bias for this item.

Frequently Asked Questions

Common questions about ROBUST-RCT assessments in CoreSR.

What is ROBUST-RCT?
ROBUST-RCT (Risk of Bias instrument for Use in Systematic reviews — for RCTs) is a tool for assessing risk of bias in randomized controlled trials. It uses a two-step approach: Step 1 evaluates study-level items (randomization, allocation concealment, blinding) and Step 2 evaluates outcome-level items (incomplete outcome data, selective reporting, other bias).
How does ROBUST-RCT differ from RoB 2.0?
While RoB 2.0 uses five domains with detailed signaling questions leading to domain-level judgements, ROBUST-RCT uses a simpler two-step structure that separates study-level concerns from outcome-level concerns. ROBUST-RCT uses a three-point scale (Low, Unclear, High) compared to RoB 2.0's three-point scale (Low, Some concerns, High). The two-step approach can be more efficient for reviews with many outcomes per study.
What is the two-step approach?
Step 1 assesses study-level items that apply to the entire trial regardless of outcome: randomization, allocation concealment, and blinding. These are assessed once per study. Step 2 assesses outcome-level items that may differ across outcomes: incomplete outcome data, selective reporting, and other bias. These are assessed separately for each outcome of interest.
When should I use ROBUST-RCT vs RoB 2.0?
RoB 2.0 is the current Cochrane-recommended tool for RCTs and is preferred for Cochrane reviews. ROBUST-RCT may be suitable when a simpler assessment framework is desired, when assessing many outcomes per study (the two-step approach avoids repeating study-level assessments), or when the review protocol specifies ROBUST-RCT.
How does the "Unclear" judgement work?
An "Unclear" judgement means there is insufficient information to determine whether the item is at low or high risk of bias. This differs from RoB 2.0's "Some concerns", which indicates a positive assessment of moderate risk. "Unclear" signals a reporting gap rather than a substantive concern, though it should be treated cautiously in sensitivity analyses.
How does the AI review work?
GLASS evaluates each ROBUST-RCT item with structured step 1 and step 2 answers, rationale, and evidence text. The app stores those suggestions for human review.
How is the overall risk of bias determined?
The overall risk of bias for a given outcome combines the study-level judgements (Step 1) with the outcome-level judgements (Step 2). If any item is judged "High", the overall risk is typically "High". If no items are "High" but some are "Unclear", the overall risk is typically "Unclear". The overall risk is "Low" only when all items are judged "Low".
Can I export the results?
Yes. You can export individual study assessments or the full project summary as CSV. The export includes all item judgements at both study and outcome levels, AI justifications, and any user overrides.

Ready to assess?

Upload a study PDF and let AI provide a first-pass ROBUST-RCT risk of bias assessment.

Go to ROBUST-RCT

References

1. Wang Y, Keitz S, Briel M, et al. Development of ROBUST-RCT: Risk Of Bias instrument for Use in SysTematic reviews — for Randomised Controlled Trials. BMJ. 2025;388:e081199. doi:10.1136/bmj-2024-081199

2. Wang Y, Parpia S, Couban R, et al. Compelling evidence from meta-epidemiological studies demonstrates overestimation of effects in randomized trials that fail to optimize randomization and blind patients and outcome assessors. J Clin Epidemiol. 2024;165:111211. doi:10.1016/j.jclinepi.2023.11.001

3. Guyatt GH, Oxman AD, Vist G, et al. GRADE guidelines: 4. Rating the quality of evidence — study limitations (risk of bias). J Clin Epidemiol. 2011;64(4):407-415. doi:10.1016/j.jclinepi.2010.07.017

CoreSR · Evidence Synthesis Platform