Article Text

Download PDFPDF
167 Dealing with retrieval bias for an evidence-informed individual patient data network meta-analysis
  1. Areti Angeliki Veroniki1,2,
  2. Huda Ashoor3,
  3. Patricia Rios3,
  4. George Seitidis2,
  5. Dimitris Mavridis2,
  6. Sharon Straus1,
  7. Andrea Tricco1
  1. 1Knowledge Translation Program, Li Ka Shing Knowledge Institute, St. Michael’s Hospital, Toronto, Canada
  2. 2Department of Primary Education, School of Education, University of Ioannina, Ioannina, Greece
  3. 3Knowledge Translation Program, Li Ka Shing Knowledge Institute, St. Michael’s Hospital,, Toronto, Canada


Objectives The synthesis of individual patient data (IPD) from randomised clinical trials (RCTs) can strengthen evidence used for decision-making. Network meta-analyses (NMA) modelling IPD usually include non-sponsored or publicly sponsored RCTs. Evidence suggests that IPD sharing may depend on study characteristics, such as funding type, RCT size, RCT risk of bias, and treatment effect. However, retrieval bias in IPD-NMA of sponsored RCTs has not been assessed before. The objective of this study is to explore retrieval bias in IPD-NMAs of sponsored RCTs and address challenges and barriers.

Method We contacted authors and sponsors of RCTs eligible for 2 IPD-NMAs to obtain IPD. If a study had multiple sponsors, we contacted all of them. To facilitate IPD retrieval, we contacted data sharing platforms. All IPD were checked for consistency with results from published RCTs. We explored whether IPD studies suggested different findings with those of studies not sharing IPD and outlined the IPD availability from sponsors. We noted all barriers and resource requirements associated with the IPD acquisition during the author and sponsor contact processes.

Results We included 137 RCTs and received IPD for 29 (21%) RCTs (1058 total waiting days). None of the authors shared their IPD. Instead, 17 sponsors for 107 studies were contacted and 7 sponsors shared their data through their platforms. The 7 sponsors held data for 94 RCTs and we obtained data from 31% (29/94) of these RCTs. Of the 29 RCTs, we were able to include 23 RCTs in our NMA due to incompleteness of provided data. For example, a study included only IPD for the placebo arm and thus was excluded from the NMA. A big challenge in the IPD was the high dropout rate (up to 72%) from the RCTs, for which many original authors applied inappropriate imputation methods. Our findings differed from published RCT results. We encountered outcome reporting bias; specifically, some outcomes were missing from the publications but were available as IPD.

Conclusions Retrieval bias can severely impact NMA findings and decision-making. Our study highlighted challenges encountered during an IPD-NMA of sponsored RCTs.

Statistics from

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.