When to keep it simple – adaptive designs are not always useful

Type: Article

Publication Date: 2019-08-02

Citations: 62

DOI: https://doi.org/10.1186/s12916-019-1391-9

Abstract

Adaptive designs are a wide class of methods focused on improving the power, efficiency and participant benefit of clinical trials. They do this through allowing information gathered during the trial to be used to make changes in a statistically robust manner – the changes could include which treatment arms patients are enrolled to (e.g. dropping non-promising treatment arms), the allocation ratios, the target sample size or the enrolment criteria of the trial. Generally, we are enthusiastic about adaptive designs and advocate their use in many clinical situations. However, they are not always advantageous. In some situations, they provide little efficiency advantage or are even detrimental to the quality of information provided by the trial. In our experience, factors that reduce the efficiency of adaptive designs are routinely downplayed or ignored in methodological papers, which may lead researchers into believing they are more beneficial than they actually are. In this paper, we discuss situations where adaptive designs may not be as useful, including situations when the outcomes take a long time to observe, when dropping arms early may cause issues and when increased practical complexity eliminates theoretical efficiency gains. Adaptive designs often provide notable efficiency benefits. However, it is important for investigators to be aware that they do not always provide an advantage. There should always be careful consideration of the potential benefits and disadvantages of an adaptive design.

Locations

  • BMC Medicine - View - PDF
  • PubMed Central - View
  • DOAJ (DOAJ: Directory of Open Access Journals) - View
  • PubMed - View

Similar Works

Action Title Year Authors
+ PDF Chat Adaptive trial designs: a review of barriers and opportunities 2012 John A. Kairalla
Christopher S. Coffey
Mitchell A Thomann
Keith E. Muller
+ PDF Chat Adaptive designs in clinical trials: why use them, and how to run and report them 2018 Philip Pallmann
Alun Bedding
Babak Choodari‐Oskooei
Munyaradzi Dimairo
Laura Flight
Lisa V. Hampson
Jane Holmes
Adrian Mander
Lang’o Odondi
Matthew R. Sydes
+ The advantages and disadvantages of adaptive designs for clinical trials 2004 Péter Bauer
Werner Brannath
+ Data Challenges in Adaptive Trials 2014 C Garutti
+ Common Types of Adaptive Trial Designs 2023 Jay Park
J. Kyle Wathen
Edward J. Mills
+ PDF Chat Key design considerations for adaptive clinical trials: a primer for clinicians 2018 Kristian Thorlund
Jonas Häggström
Jay Park
Edward J. Mills
+ Adding flexibility to clinical trial designs: an example-based guide to the practical use of adaptive designs 2020 Thomas Burnett
Pavel Mozgunov
Philip Pallmann
Sofía S. Villar
Graham Wheeler
Thomas Jaki
+ Adding flexibility to clinical trial designs: an example-based guide to the practical use of adaptive designs 2020 Thomas Burnett
Pavel Mozgunov
Philip Pallmann
Sofía S. Villar
Graham Wheeler
Thomas Jaki
+ On Flexibility of Adaptive Designs and Criteria for Choosing A Good One—A Discussion of FDA Draft Guidance 2010 Bin Cheng
Shein‐Chung Chow
+ An overview of methodological considerations regarding adaptive stopping, arm dropping, and randomization in clinical trials 2022 Anders Granholm
Benjamin Skov Kaas‐Hansen
Theis Lange
Olav L. Schjørring
Lars W. Andersen
Anders Perner
Aksel Karl Georg Jensen
Morten Hylander Møller
+ PDF Chat Adding flexibility to clinical trial designs: an example-based guide to the practical use of adaptive designs 2020 Thomas Burnett
Pavel Mozgunov
Philip Pallmann
Sofía S. Villar
Graham Wheeler
Thomas Jaki
+ PDF Chat Designing and evaluating advanced adaptive randomised clinical trials: a practical guide 2025 Anders Granholm
Aksel Karl Georg Jensen
Theis Lange
Anders Perner
Morten Hylander Møller
Benjamin Skov Kaas‐Hansen
+ Limitations of Adaptive Clinical Trials 2012 Marc Buyse
+ Adaptive Methods: Telling “The Rest of the Story” 2010 Scott S. Emerson
Thomas R. Fleming
+ How to wisely use adaptive designs in clinical trials 2013 敏彦 森川
+ Adaptive designs undertaken in clinical research: a review of registered clinical trials 2016 Isabella Hatfield
Annabel Allison
Laura Flight
Steven A. Julious
Munyaradzi Dimairo
+ Adaptive Designs in Clinical Trials 2010 Donald Berry
+ Adaptive Designs in Clinical Trials 2022
+ Adaptive Designs 2021 Christy Chuang‐Stein
Simon Kirby
+ PDF Chat Designing and conducting adaptive trials to evaluate interventions in health services and implementation research: practical considerations 2022 Julie C. Lauffenburger
Niteesh K. Choudhry
Massimiliano Russo
Robert J. Glynn
Steffen Ventz
Lorenzo Trippa

Works That Cite This (53)

Action Title Year Authors
+ PDF Chat The Bayesian Design of Adaptive Clinical Trials 2021 Alessandra Giovagnoli
+ PDF Chat Bayesian adaptive designs for multi-arm trials: an orthopaedic case study 2020 Elizabeth Ryan
Sarah E Lamb
Esther Williamson
Simon Gates
+ PDF Chat Adaptive designs in critical care trials: a simulation study 2023 Wei Li
Victoria Cornelius
Simon Finfer
Balasubramanian Venkatesh
Laurent Billot
+ PDF Chat Improving clinical trials using Bayesian adaptive designs: a breast cancer example 2022 Wei Hong
Sue‐Anne McLachlan
Melissa M. Moore
Robert K. Mahar
+ A stochastically curtailed single‐arm phase II trial design for binary outcomes 2022 Martin Law
Michael J. Grayling
Adrian Mander
+ PDF Chat Practical guidance for planning resources required to support publicly-funded adaptive clinical trials 2022 James Wason
Munyaradzi Dimairo
Katie Biggs
S. Bowden
Julia Brown
Laura Flight
Jamie Hall
Thomas Jaki
Rachel Lowe
Philip Pallmann
+ PDF Chat Randomised trials at the level of the individual 2021 Jay Park
Nathan Ford
Denis Xavier
Per Ashorn
Rebecca F. Grais
Zulfiqar A Bhutta
Herman Goossens
Kristian Thorlund
M. Eugenia Socías
Edward J. Mills
+ PDF Chat Improving the efficiency of clinical trials in multiple sclerosis 2023 Ruth Ann Marrie
Maria Pia Sormani
Sean Apap Mangion
Francesca Bovis
Winson Y. Cheung
Gary Cutter
Peter Feys
Michael D. Hill
Marcus Koch
Morgan McCreary
+ PDF Chat Development and Evaluation of a Simulation-Based Algorithm to Optimize the Planning of Interim Analyses for Clinical Trials in ALS 2023 Jordi W.J. van Unnik
Stavros Nikolakopoulos
Marinus J.C. Eijkemans
Jésus Gonzalez‐Bermejo
Gaëlle Bruneteau
Capucine Morélot-Panzini
Leonard H. van den Berg
Merit Cudkowicz
Christopher McDermott
Thomas Similowski
+ Adaptive design clinical trials: current status by disease and trial phase in various perspectives 2023 H. Lee
Sejung Hwang
In‐Jin Jang
Jae‐Yong Chung
Jaeseong Oh

Works Cited by This (14)

Action Title Year Authors
+ Early stopping of randomized clinical trials for overt efficacy is problematic 2008 Dirk Bassler
Víctor M. Montori
Matthias Briel
Paul Glasziou
Gordon Guyatt
+ Bayesian Two-Stage Biomarker-Based Adaptive Design for Targeted Therapy Development 2014 Xuemin Gu
Nan Chen
Caimiao Wei
Suyu Liu
Vassiliki A. Papadimitrakopoulou
Roy S. Herbst
J. Jack Lee
+ PDF Chat Outcome-Adaptive Randomization: Is It Useful? 2010 Edward L. Korn
Boris Freidlin
+ PDF Chat Group sequential designs for developing and testing biomarker-guided personalized therapies in comparative effectiveness research 2013 Tze Leung Lai
Olivia Yueh-Wen Liao
Dong Woo Kim
+ Surrogate End Points in Clinical Trials: Are We Being Misled? 1996 Thomas R. Fleming
+ PDF Chat Flexible trial design in practice - stopping arms for lack-of-benefit and adding research arms mid-trial in STAMPEDE: a multi-arm multi-stage randomized controlled trial 2012 Matthew R. Sydes
Mahesh Parmar
Malcolm D. Mason
Noel W. Clarke
Claire Amos
John Anderson
Johann S. de Bono
David P. Dearnaley
John Dwyer
Charlene Green
+ PDF Chat Clinical trialist perspectives on the ethics of adaptive clinical trials: a mixed-methods analysis 2015 Laurie J. Legocki
William J. Meurer
Shirley Frederiksen
Roger Lewis
Valerie Durkalski
Donald A. Berry
William G. Barsan
Michael D. Fetters
+ PDF Chat Are outcome-adaptive allocation trials ethical? 2015 Spencer Phillips Hey
Jonathan Kimmelman
+ PDF Chat Missing steps in a staircase: a qualitative study of the perspectives of key stakeholders on the use of adaptive designs in confirmatory trials 2015 Munyaradzi Dimairo
Jonathan Boote
Steven A. Julious
J P Nicholl
Susan Todd
+ PDF Chat A generalized Dunnett test for multi-arm multi-stage clinical studies with treatment selection 2012 Dominic Magirr
Thomas Jaki
John Whitehead