Article Text

Download PDFPDF
Clinical trial design and treatment effects: a meta-analysis of randomised controlled and single-arm trials supporting 437 FDA approvals of cancer drugs and indications
  1. Daniel Tobias Michaeli1,
  2. Thomas Michaeli2,3,4,
  3. Sebastian Albers5,
  4. Julia Caroline Michaeli6
  1. 1 Department of Medical Oncology, National Center for Tumor Diseases, Heidelberg University Hospital, Heidelberg, Germany
  2. 2 Department of Personalized Oncology, University Hospital Mannheim, Heidelberg University, Mannheim, Germany
  3. 3 German Cancer Research Center–Hector Cancer Institute, University Medical Center Mannheim, Mannheim, Germany
  4. 4 Division of Personalized Medical Oncology, German Cancer Research Center, Heidelberg, Germany
  5. 5 Department of Trauma Surgery, Klinikum Rechts Der Isar, Technical University of Munich, Munich, Germany
  6. 6 Department of Obstetrics and Gynaecology, LMU University Hospital, LMU Munich, Munich, Germany
  1. Correspondence to Daniel Tobias Michaeli; danielmichaeli{at}yahoo.com

Abstract

Objectives This study aims to analyse the association between clinical trial design and treatment effects for cancer drugs with US Food and Drug Administration (FDA) approval.

Design Cross-sectional study and meta-analysis.

Setting Data from Drugs@FDA, FDA labels, ClincialTrials.gov and the Global Burden of Disease study.

Participants Pivotal trials for 170 drugs with FDA approval across 437 cancer indications between 2000 and 2022.

Main outcome measures Treatment effects were measured in HRs for overall survival (OS) and progression-free survival (PFS), and in relative risk for tumour response. Random-effects meta-analyses and meta-regressions explored the association between treatment effect estimates and clinical trial design for randomised controlled trials (RCTs) and single-arm trials.

Results Across RCTs, greater effect estimates were observed in smaller trials for OS (ß=0.06, p<0.001), PFS (ß=0.15, p<0.001) and tumour response (ß=−3.61, p<0.001). Effect estimates were larger in shorter trials for OS (ß=0.08, p<0.001) and PFS (ß=0.09, p=0.002). OS (ß=0.04, p=0.006), PFS (ß=0.10, p<0.001) and tumour response (ß=−2.91, p=0.004) outcomes were greater in trials with fewer centres. HRs for PFS (0.54 vs 0.62, p=0.011) were lower in trials testing the new drug to an inactive (placebo/no treatment) rather than an active comparator. The analysed efficacy population (intention-to-treat, per-protocol, or as-treated) was not consistently associated with treatment effects. Results were consistent for single-arm trials and in multivariable analyses.

Conclusions Pivotal trial design is significantly associated with measured treatment effects. Particularly small, short, single-centre trials testing a new drug compared with an inactive rather than an active comparator could overstate treatment outcomes. Future studies should verify results in unsuccessful trials, adjust for further confounders and examine other therapeutic areas. The FDA, manufacturers and trialists must strive to conduct robust clinical trials with a low risk of bias.

  • Medical Oncology
  • Drug Development
  • Policy
  • Methods
  • Neoplasms

Data availability statement

All data relevant to the study are included in the article or uploaded as online supplemental information. All data used in this study were in the public domain. All data relevant to the study are included in the article or uploaded as online supplemental information.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Data availability statement

All data relevant to the study are included in the article or uploaded as online supplemental information. All data used in this study were in the public domain. All data relevant to the study are included in the article or uploaded as online supplemental information.

View Full Text

Footnotes

  • X @DTMichaeli

  • Contributors DTM and TM had full access to all the data in the study and took responsibility for the integrity of the data and the accuracy of the data analyses. Concept and design: all authors. Acquisition, analysis or interpretation of data: all authors. Drafting of the manuscript: DTM Critical revision of the manuscript for important intellectual content: all authors. Statistical analysis: DTM. Administrative, technical or material support: all authors. Study supervision: all authors. DTM is the guarantor. The corresponding author attests that all listed authors meet authorship criteria and that no others meeting the criteria have been omitted.

  • Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

  • Competing interests None declared.

  • Patient and public involvement Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.