Methods for Accommodating Nonproportional Hazards in Clinical Trials: Ready for the Primary Analysis?

Type: Article

Publication Date: 2019-10-24

Citations: 78

DOI: https://doi.org/10.1200/jco.19.01681

View Chat PDF

Abstract

Evaluation of new anticancer therapies in randomized clinical trials (RCTs) is typically based on comparing a new treatment with a standard one, using a time-to-event end point such as overall survival or progression-free survival (PFS). Although the statistical framework underlying the design of these RCTs is centered on formal testing of a treatment effect, methods for estimation (quantification) of the treatment benefit are also specified. Currently, log-rank statistical tests and/or proportional hazards models are commonly used for the trial design and primary analysis. These methods are optimized for treatment effects that do not change substantially over time (the proportional hazard assumption). Introduction of immunotherapeutic agents with potentially delayed treatment effects has renewed interest in statistical methods that can better accommodate general departures from proportional hazards and, particularly, a delayed treatment effect. This has led to considerable attention in, and some controversy about, appropriate statistical methodology for comparing survival curves, as demonstrated by the comments and replies on trial reports1-24 and at a Duke–US Food and Drug Administration workshop25 that offered alternatives to the standard log-rank/hazard-ratio methodology. While these new methods could be useful, as outlined in comprehensive reviews,26-30 we offer a caution about some of these methods’ limitations in translating statistical evidence into clinical evidence, both for formal treatment-effect hypothesis testing and for estimation (when used for the primary analysis).

Locations

  • Journal of Clinical Oncology - View - PDF
  • PubMed Central - View
  • Europe PMC (PubMed Central) - View - PDF
  • PubMed - View

Similar Works

Action Title Year Authors
+ PDF Chat Deviation from the Proportional Hazards Assumption in Randomized Phase 3 Clinical Trials in Oncology: Prevalence, Associated Factors, and Implications 2019 Rifaquat Rahman
Geoffrey Fell
Steffen Ventz
Andrea Arfé
Alyssa M. Vanderbeek
Lorenzo Trippa
Brian M. Alexander
+ Data from Deviation from the Proportional Hazards Assumption in Randomized Phase 3 Clinical Trials in Oncology: Prevalence, Associated Factors, and Implications 2023 Rifaquat Rahman
Geoffrey Fell
Steffen Ventz
Andrea Arfè
Alyssa M. Vanderbeek
Lorenzo Trippa
Brian M. Alexander
+ Data from Deviation from the Proportional Hazards Assumption in Randomized Phase 3 Clinical Trials in Oncology: Prevalence, Associated Factors, and Implications 2023 Rifaquat Rahman
Geoffrey Fell
Steffen Ventz
Andrea Arfè
Alyssa M. Vanderbeek
Lorenzo Trippa
Brian M. Alexander
+ PDF Chat Quantifying treatment differences in confirmatory trials under non-proportional hazards 2020 José L. Jiménez
+ PDF Chat Alternative Analysis Methods for Time to Event Endpoints Under Nonproportional Hazards: A Comparative Analysis 2019 Ray Lin
Ji Lin
Satrajit Roychoudhury
Keaven M. Anderson
Tianle Hu
Bo Huang
Larry Leon
Jason J. Z. Liao
Rong Liu
Xiaodong Luo
+ Non-proportional hazards in immuno-oncology: is an old perspective needed? 2020 Dominic Magirr
+ Non-proportional hazards in immuno-oncology: is an old perspective needed? 2020 Dominic Magirr
+ Methods for non-proportional hazards in clinical trials: A systematic review 2023 Maximilian Bardo
Cynthia Huber
Norbert Benda
Jonas Brugger
Tobias Fellinger
Vaidotas Galaunė
Judith Heinz
Harald Heinzl
Andrew C. Hooker
Florian Klinglmüller
+ PDF Chat Methods for non-proportional hazards in clinical trials: A systematic review 2024 Maximilian Bardo
Cynthia Huber
Norbert Benda
Jonas Brugger
Tobias Fellinger
Vaidotas Galaunė
Judith Heinz
Harald Heinzl
Andrew C. Hooker
Florian Klinglmüller
+ A novel design for randomized immuno-oncology clinical trials with potentially delayed treatment effects 2015 Pei He
Zheng Su
+ PDF Chat A two-step approach for analyzing time to event data under non-proportional hazards 2024 Jonas Brugger
Tim Friede
Florian Klinglmüller
Martin Posch
Robin Ristl
Franz König
+ A neutral comparison of statistical methods for time-to-event analyses under non-proportional hazards 2023 Florian Klinglmüller
Tobias Fellinger
Franz König
Tim Friede
Andrew C. Hooker
Harald Heinzl
Martina Mittlböck
Jonas Brugger
Maximilian Bardo
Cynthia Huber
+ Optimality of testing procedures for survival data in the nonproportional hazards setting 2020 Andrea Arfé
Brian M. Alexander
Lorenzo Trippa
+ Violations of the proportional hazards assumption in randomized phase III oncology clinical trials. 2018 Rifaquat Rahman
Geoffrey Fell
Lorenzo Trippa
Brian M. Alexander
+ Comparative Analysis of Methods for Analyzing Clinical Results of Immuno-Oncology Therapy with Delayed Treatment Effects 2023 Gianni Amato
Mythili Koneru
Ruth Antoine
Zhiyin Liang
Tzu‐Min Yeh
Jiajun Xu
Tito Roccia
Nikoletta Lendvai
Diana Chen
+ Design and Analysis of group-sequential clinical trials based on a modestly-weighted log-rank test in anticipation of a delayed separation of survival curves: A practical guidance 2021 Dominic Magirr
José L. Jiménez
+ PDF Chat Challenges, Complexities, and Considerations in the Design and Interpretation of Late-Phase Oncology Trials 2023 Timothy A. Lin
Alexander D. Sherry
Ethan B. Ludmir
+ Sample size and power for the weighted log‐rank test and Kaplan‐Meier based tests with allowance for nonproportional hazards 2019 Godwin Yung
Yi Liu
+ PDF Chat Non‐proportional hazards in immuno‐oncology: Is an old perspective needed? 2020 Dominic Magirr
+ Comparison of survival distributions in clinical trials: A practical guidance 2020 Xiaotian Chen
Xin Wang
Kun Chen
Yeya Zheng
Richard J. Chappell
Jyotirmoy Dey

Cited by (56)

Action Title Year Authors
+ Empirical power comparison of statistical tests in contemporary phase III randomized controlled trials with time-to-event outcomes in oncology 2020 Miki Horiguchi
Michael J. Hassett
Hajime Uno
+ PDF Chat Clinical Versus Statistical Significance in Studies of Thoracic Malignancies 2020 Suzanne E. Dahlberg
Edward L. Korn
Jennifer Le‐Rademacher
Sumithra J. Mandrekar
+ Clinical effectiveness reporting of novel cancer drugs in the context of non-proportional hazards: a review of nice single technology appraisals 2023 David Salmon
G. J. Meléndez‐Torres
+ Critical reappraisal of phase III trials with immune checkpoint inhibitors in non-proportional hazards settings 2020 Eduardo Castañón
Álvaro Sánchez-Arráez
Felipe Alvarez-Manceñido
Paula Jiménez‐Fonseca
Alberto Carmona‐Bayonas
+ Dealing With Nonproportional Hazards in Coronary Revascularisation Studies 2023 Lucas C. Godoy
Dennis T. Ko
Michael E. Farkouh
Baiju R. Shah
Peter C. Austin
+ Are restricted mean survival time methods especially useful for noninferiority trials? 2021 Boris Freidlin
Chen Hu
Edward L. Korn
+ PDF Chat Assessment of Treatment Effects and Long-term Benefits in Immune Checkpoint Inhibitor Trials Using the Flexible Parametric Cure Model 2021 Thomas Filleron
Marine Bachelier
Julien Mazières
M. Pérol
Nicolás Meyer
E. Martin
Fanny Mathevet
Jean‐Yves Dauxois
Raphaël Porcher
Jean‐Pierre Delord
+ PDF Chat A simulation study comparing the power of nine tests of the treatment effect in randomized controlled trials with a time-to-event outcome 2020 Patrick Royston
Mahesh Parmar
+ PDF Chat The Predictive Individual Effect for Survival Data 2022 Beat Neuenschwander
Satrajit Roychoudhury
Simon Wandel
Kannan Natarajan
Emmanuel Zuber
+ Testing for Differences in Survival When Treatment Effects Are Persistent, Decaying, or Delayed 2022 John O’Quigley
+ Scaling and interpreting treatment effects in clinical trials using restricted mean survival time 2024 Theodore Karrison
Chen Hu
James J. Dignam
+ PDF Chat Stratified modestly weighted log‐rank tests in settings with an anticipated delayed separation of survival curves 2023 Dominic Magirr
José L. Jiménez
+ PDF Chat Challenges, Complexities, and Considerations in the Design and Interpretation of Late-Phase Oncology Trials 2023 Timothy A. Lin
Alexander D. Sherry
Ethan B. Ludmir
+ PDF Chat Robust Design and Analysis of Clinical Trials With Nonproportional Hazards: A Straw Man Guidance From a Cross-Pharma Working Group 2021 Satrajit Roychoudhury
Keaven M. Anderson
Jiabu Ye
Pralay Mukhopadhyay
+ PDF Chat On assessing survival benefit of immunotherapy using long‐term restricted mean survival time 2023 Miki Horiguchi
Lü Tian
Hajime Uno
+ PDF Chat Comparison between asymptotic and re-randomisation tests under non-proportional hazards in a randomised controlled trial using the minimisation method 2024 Ryusei Kimura
Shogo Nomura
Kengo Nagashima
Yasunori Sato
+ Statistical noise in PD-(L)1 inhibitor trials: Unravelling the durable-responder effect 2024 Michael Coory
Susan J. Jordan
+ PDF Chat Simultaneous inference procedures for the comparison of multiple characteristics of two survival functions 2024 Robin Ristl
Heiko Götte
Armin Schüler
Martin Posch
Franz König
+ PDF Chat Visualizing hypothesis tests in survival analysis under anticipated delayed effects 2024 José L. Jiménez
Isobel Barrott
Francesca Gasperoni
Dominic Magirr
+ Generalized fiducial inference for the restricted mean survival time 2023 Ionut Bebu
Guoqing Diao
Toshimitsu Hamasaki
+ Robust Design and Analysis of Clinical Trials With Non-proportional Hazards: A Straw Man Guidance from a Cross-pharma Working Group 2021 Satrajit Roychoudhury
Keaven M. Anderson
Jiabu Ye
Pralay Mukhopadhyay
+ PDF Chat Quantifying treatment differences in confirmatory trials under non-proportional hazards 2020 José L. Jiménez
+ PDF Chat Design and analysis of group-sequential clinical trials based on a modestly weighted log-rank test in anticipation of a delayed separation of survival curves: A practical guidance 2022 Dominic Magirr
José L. Jiménez
+ Comparison of survival distributions in clinical trials: A practical guidance 2020 Xiaotian Chen
Xin Wang
Kun Chen
Yeya Zheng
Richard J. Chappell
Jyotirmoy Dey
+ PDF Chat Log-Rank Test vs MaxCombo and Difference in Restricted Mean Survival Time Tests for Comparing Survival Under Nonproportional Hazards in Immuno-oncology Trials 2022 Pralay Mukhopadhyay
Jiabu Ye
Keaven M. Anderson
Satrajit Roychoudhury
Eric H. Rubin
Susan Halabi
Richard J. Chappell
+ Imputation methods for informative censoring in survival analysis with time dependent covariates 2023 Man Jin
+ Designing superiority trials with window mean survival time as a primary endpoint 2023 Mitchell Paukner
Richard J. Chappell
+ PDF Chat Non‐proportional hazards in immuno‐oncology: Is an old perspective needed? 2020 Dominic Magirr
+ Survival analysis for AdVerse events with VarYing follow-up times (SAVVY) -- comparison of adverse event risks in randomized controlled trials 2020 Kaspar Rufibach
Regina Stegherr
Claudia Schmoor
Valentine Jehl
Arthur Allignol
Annette Boeckenhoff
Cornelia Dunger‐Baldauf
Lewin Eisele
Thomas Künzel
Katrin Kupas
+ Assessing the Impact of COVID-19 on the Objective and Analysis of Oncology Clinical Trials -- Application of the Estimand Framework 2020 Evgeny Degtyarev
Kaspar Rufibach
Yue Shentu
Godwin Yung
Michelle Casey
Stefan Englert
Feng Liu
Liu Y
Oliver Sailer
Jonathan Siegel
+ <scp>Two‐sample</scp> inference procedures under nonproportional hazards 2023 Y.T. Tai
Weijing Wang
Martin T. Wells
+ PDF Chat Pitfall in the Design and Analysis of Comparative Oncology Trials With a Time-to-Event Endpoint and Recommendations 2022 Zachary R. McCaw
Dae Hyun Kim
L. J. Wei
+ Comment on “Non-Proportional Hazards – an Evaluation of the MaxCombo Test in Cancer Clinical Trials” by the Cross-Pharma Non-Proportional Hazards Working Group 2023 Ray Lin
Pralay Mukhopadhyay
Satrajit Roychoudhury
Keaven M. Anderson
Tianle Hu
Bo Huang
Larry Leon
Jason J. Z. Liao
Ji Lin
Rong Liu
+ Proportional Hazards Violations in Phase 3 Cancer Clinical Trials: A Potential Source of Trial Misinterpretation 2024 Timothy A. Lin
Zachary R. McCaw
Alex Koong
Christine Lin
Joseph Abi Jaoude
Roshal R. Patel
Ramez Kouzy
Molly B. El Alam
Alexander D. Sherry
Sonal S. Noticewala
+ PDF Chat Clinical Benefit Scales and Trial Design: Some Statistical Issues 2022 Edward L. Korn
Carmen J. Allegra
Boris Freidlin
+ Rejoinder to Comments on “Non-Proportional Hazards – An Evaluation of the MaxCombo Test in Cancer Clinical Trials” 2023 Yuan-Li Shen
Sirisha L. Mushti
Flora Mulkey
Thomas Gwise
Xin Wang
Jiaxi Zhou
Xin Gao
Shenghui Tang
Marc R. Theoret
Richard Pazdur
+ Treatment effect measures under nonproportional hazards 2022 Steven Snapinn
Qi Jiang
Chunlei Ke
+ Exploratory subgroup identification in the heterogeneous Cox model: A relatively simple procedure 2024 Larry Leon
Thomas Jemielita
Zifang Guo
Rachel Marceau West
Keaven M. Anderson
+ Window mean survival time 2021 Mitchell Paukner
Richard J. Chappell
+ Group sequential design for randomized trials using “first hitting time” model 2022 Yiming Chen
John Lawrence
Mei‐Ling Ting Lee

Citing (26)

Action Title Year Authors
+ PDF Chat Enhanced secondary analysis of survival data: reconstructing the data from published Kaplan-Meier survival curves 2012 Patricia Guyot
A. E. Ades
Mario JNM Ouwens
Nicky J. Welton
+ Linear rank tests with right censored data 1978 Ross L. Prentice
+ PDF Chat Statistical issues and challenges in immuno-oncology 2013 Tai‐Tsang Chen
+ A generalized two-sample Wilcoxon test for doubly censored data 1965 E. A. Gehan
+ PDF Chat Moving Beyond the Hazard Ratio in Quantifying the Between-Group Difference in Survival Analysis 2014 Hajime Uno
Brian Claggett
Lü Tian
Eisuke Inoue
Paul Gallo
Toshio Miyata
Deborah Schrag
Masahiro Takeuchi
Yoshiaki Uyama
Lihui Zhao
+ Cure model analysis in cancer: an application to data from the Children's Cancer Group 2001 Richard Sposto
+ Restricted Mean Life with Adjustment for Covariates 1987 Theodore Karrison
+ PDF Chat Counting Processes and Survival Analysis. 1992 Dorota M. Dabrowska
Thomas R. Fleming
David P. Harrington
+ On the Distribution of the Maximum of the Logrank Statistic and the Modified Wilcoxon Statistic 1981 Robert E. Tarone
+ Sample size determination for the weighted log‐rank test with the Fleming–Harrington class of weights in cancer vaccine studies 2014 Takahiro Hasegawa
+ Statistical design of the women's health trial 1988 Steven G. Self
Ross Prentice
Donald C. Iverson
Maureen Henderson
Donovan J. Thompson
David P. Byar
William Insull
Sherwood L. Gorbach
Carolyn K. Clifford
Susan Goldman
+ PDF Chat Three-component cure rate model for nonproportional hazards alternative in the design of randomized clinical trials 2012 Haesook Teresa Kim
Robert J. Gray
+ The use of restricted mean survival time to estimate the treatment effect in randomized clinical trials when the proportional hazards assumption is in doubt 2011 Patrick Royston
Mahesh Parmar
+ Consequences of Delayed Treatment Effects on Analysis of Time-to-Event Endpoints 2007 Gil D. Fine
+ PDF Chat Breast Cancer Adjuvant Therapy: Time to Consider Its Time-Dependent Effects 2011 Ismail Jatoi
William F. Anderson
Jong‐Hyeon Jeong
Carol Redmond
+ PDF Chat Augmenting the logrank test in the design of clinical trials in which non-proportional hazards of the treatment effect may be anticipated 2016 Patrick Royston
Mahesh Parmar
+ Comparison of Treatment Effects Measured by the Hazard Ratio and by the Ratio of Restricted Mean Survival Times in Oncology Randomized Controlled Trials 2016 Ludovic Trinquart
Justine Jacot
Sarah C. Conner
Raphaël Porcher
+ PDF Chat Weighted Kaplan-Meier Statistics: A Class of Distance Tests for Censored Survival Data 1989 Margaret S. Pepe
Thomas R. Fleming
+ Some Versatile Tests Based on the Simultaneous Use of Weighted Log-Rank Statistics 1996 Jae Won Lee
+ PDF Chat Versatile Tests for Comparing Survival Curves Based on Weighted Log-rank Statistics 2016 Theodore Karrison
+ Restricted Mean Survival Time: An Obligatory End Point for Time-to-Event Analysis in Cancer Trials? 2016 Roger A’Hern
+ PDF Chat Understanding and Communicating Measures of Treatment Effect on Survival: Can We Do Better? 2017 Everardo D. Saad
John Zalcberg
Julien Péron
Elisabeth Coart
Tomasz Burzykowski
Marc Buyse
+ Evaluating Noninferiority With Clinically Interpretable Statistics for the PROSELICA Study to Assess Treatment Efficacy of a Reduced Dose of Cabazitaxel for Treating Metastatic Prostate Cancer 2018 Miki Horiguchi
Hajime Uno
L. J. Wei
+ A flexible and coherent test/estimation procedure based on restricted mean survival times for censored time‐to‐event data in randomized clinical trials 2018 Miki Horiguchi
Angel M. Cronin
Masahiro Takeuchi
Hajime Uno
+ PDF Chat Interim Futility Monitoring Assessing Immune Therapies With a Potentially Delayed Treatment Effect 2018 Edward L. Korn
Boris Freidlin
+ There is still a place for significance testing in clinical trials 2019 Jonathan Cook
Dean Fergusson
Ian Ford
Mithat Gönen
Jonathan Kimmelman
Edward L. Korn
Colin B. Begg