Sensitivity analyses assessing the impact of early stopping on systematic reviews: recommendations for interpreting guidelines

Ian C. Marschner*, Lisa M. Askie, I. Manjula Schou

*Corresponding author for this work

    Research output: Contribution to journalArticlepeer-review

    Abstract

    The CONSORT Statement says that data-driven early stopping of a clinical trial is likely to weaken the inferences that can be drawn from the trial. The GRADE guidelines go further, saying that early stopping is a study limitation that carries the risk of bias, and recommending sensitivity analyses in which trials stopped early are omitted from evidence synthesis. Despite extensive debate in the literature over these issues, the existence of clear recommendations in high profile guidelines makes it inevitable that systematic reviewers will consider sensitivity analyses investigating the impact of early stopping. The purpose of this article is to assess methodologies for conducting such sensitivity analyses, and to make recommendations about how the guidelines should be interpreted. We begin with a clarifying overview of the impacts of early stopping on treatment effect estimation in single studies and meta-analyses. We then warn against naive approaches for conducting sensitivity analyses, including simply omitting trials stopped early from meta-analyses. This approach underestimates treatment effects, which may have serious implications if cost-effectiveness analyses determine whether treatments are made widely available. Instead, we discuss two unbiased approaches to sensitivity analysis, one of which is straightforward but statistically inefficient, and the other of which achieves greater statistical efficiency by making use of recent methodological developments in the analysis of clinical trials. We end with recommendations for interpreting: (a) the CONSORT Statement on reporting of reasons for early stopping, and (b) the GRADE guidelines on sensitivity analyses assessing the impact of early stopping.

    Original languageEnglish
    Pages (from-to)287-300
    Number of pages14
    JournalResearch Synthesis Methods
    Volume11
    Issue number2
    DOIs
    Publication statusPublished - Mar 2020

    Keywords

    • early stopping
    • interim analysis
    • meta-analysis
    • randomized controlled trial
    • sensitivity analysis

    Fingerprint

    Dive into the research topics of 'Sensitivity analyses assessing the impact of early stopping on systematic reviews: recommendations for interpreting guidelines'. Together they form a unique fingerprint.

    Cite this