Clinicians and lay people tend to overestimate the effectiveness of a treatment when only the relative effect is presented, particularly if the relative effect is large, but the absolute effect is small. In recognition of this problem, item 17b of The Consolidated Standards of Reporting Trials (CONSORT) 2010 statement stipulates authors present both absolute and relative effects for binary outcomes in randomised controlled trials (RCTs). Adherence to item 17b and the effect of differing levels of CONSORT endorsement by journals on adherence is not well known. We assessed the extent to which item 17b is adhered to in 258 RCTs published in five leading medical journals (Annals of Internal Medicine, BMJ, JAMA, The Lancet and The New England Journal of Medicine) between January and December 2019 that all endorsed the CONSORT statement to varying degrees. Only 53 of 258 (20.5%; 95% CI 15.8% to 26.0%) included studies adhered fully to item 17b. Proportional adherence was higher in journals that endorsed the statement more strictly (BMJ and JAMA, 47.4% [34.0% to 61.0%]) compared with journals less strict in their endorsement (NEJM and Ann Intern Med, 12.2% [7.0% to 19.3%]; The Lancet, 14.1% [7.3% to 23.8%]). Journals that only recommend author adherence to CONSORT had a greater proportion of studies reporting only relative effects in the main results section (62.6%) and abstract (64.2%) compared with journals that require authors to submit a completed checklist (24.6% and 29.8%, respectively). The majority of RCTs (79.5%) with binary primary outcomes published in five leading medical journals during 2019 do not report both absolute and relative effect estimates as per item 17b of the CONSORT guideline despite its universal endorsement. Differences in adherence were observed between journals that endorsed the CONSORT statement to differing extents.
- evidence-based practice
Statistics from Altmetric.com
Twitter @dnunan79, @carlheneghan
Contributors DN conceived and designed the study. IW, FAK and SH collected data and completed adherence assessments. CH independently verified a random sample of 20% of collected data. DN independently verified all collected data including adherence assessments, undertook the primary analysis and drafted the manuscript. All authors contributed to subsequent iterations. All authors provided critical input on the manuscript and approved the final version for publication. DN is guarantor.
Funding DN has received expenses and fees for his media work and teaching workshops on Evidence-based Medicine for the CEBM, and he has held grant funding from NIHR, the NIHR School of Primary Care Research and the Royal College of General Practitioners. CH has received expenses and fees for his media work, and he holds grant funding from the NIHR, the NIHR School of Primary Care Research and The NIHR Oxford BRC. CH is Editor in Chief of BMJ Evidence-Based Medicine, an NHS urgent care GP and Director of CEBM, which jointly runs the EBM-Live Conference with the BMJ and the Overdiagnosis Conference with international partners based on a non-profit model.
Competing interests None declared.
Patient consent for publication Not required.
Data availability statement Data are available upon request
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.