Objectives Our objectives were to examine the magnitude of the proportion attributable to contextual effects (PCE), which shows what proportion of the treatment arm response can be achieved by the placebo arm across various interventions, and to examine PCE variability by outcome type and condition.
Design We conducted a meta-epidemiological study.
Setting We searched the Cochrane Database of Systematic Reviews with the keyword ‘placebo’ in titles, abstracts and keywords on 1 January 2020.
Participants We included reviews that showed statistically significant beneficial effects of the intervention over placebo for the first primary outcome.
Main outcome measures We performed a random-effects meta-analysis to calculate PCEs based on the pooled result of each included review, grouped by outcome type and condition. The PCE quantifies how much of the observed treatment response can be achieved by the contextual effects.
Public and patient involvement statement No patient or member of the public was involved in conducting this research.
Results We included 328 out of 3175 Cochrane systematic reviews. The results of meta-analyses showed that PCEs varied greatly depending on outcome type (I2=98%) or condition (I2=98%), but mostly lie between 0.40 and 0.95. Overall, the PCEs were 0.65 (95% CI 0.59 to 0.72) on average. Subjective outcomes were 0.50 (95% CI 0.41 to 0.59), which was significantly smaller than those of semiobjective (PCE 0.78; 95% CI 0.72 to 0.85) or objective outcomes (PCE 0.94; 95% CI 0.91 to 0.97).
Conclusions The results suggest that much of the observed benefit is not just due to the specific effect of the interventions. The specific effects of interventions may be larger for subjective outcomes than for objective or semiobjective outcomes. However, PCEs were exceptionally variable. When we evaluate the magnitude of PCEs, we should consider each PCE individually, for each condition, intervention and outcome in its context, to assess the importance of an intervention for each specific clinical setting.
Data availability statement
All data relevant to the study are included in the article or uploaded as online supplemental information.
Statistics from Altmetric.com
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.
Contributors YTsut, YTsuj, AT and TAF developed the conception and design of the research. YTsut and TAF are fully responsible for writing the protocol. YTsut, YTsuj, AT, KO, TF, AO, YK, MK, ES, EGO extracted the data. YTsut analysed the data. HN supervised the statistical analyses. TAF supervised the research. All authors contributed to draft the manuscript and gave final approval of the manuscript before submission. TAF is the guarantor of the study.
Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.
Competing interests None declared.
Patient and public involvement Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.
Provenance and peer review Not commissioned; externally peer reviewed.
Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.