Statistics from Altmetric.com
The antiparasitic ivermectin has received particular attention as a potential treatment option for COVID-19. Understandably, there is high interest in repurposing an approved inexpensive drug, readily available as an oral formulation. However, Garegnani et al 1 recently pointed out the proportion of misleading information on ivermectin for COVID-19 published in journals, on preprint servers and websites.
A relevant number of systematic reviews report the use of methodological tools such as assessing bias at study level with the Cochrane Risk of Bias tool or grading the certainty of the evidence following the Grading of Recommendations, Assessment, Development and Evaluation (GRADE) approach, thus suggesting a putative high credibility. Indeed, some published findings seem impressive. A recent meta-analysis by Bryant et al found that ivermectin reduces the risk of death by an average of 62% (RR 0.38, 95% CI 0.19 to 0.73) compared with no ivermectin in hospitalised patients.2
In our Cochrane Review,3 we assessed the identical set of trials. However, only 4 of the 15 trials included in Bryant’s meta-analysis on mortality met our predefined eligibility criteria, and our conclusion, incorporating careful grading of the certainty of evidence, reveals a less rosy picture. The bottom line demonstrates an important uncertainty whether ivermectin compared with placebo or standard of care reduces or increases mortality in moderately ill hospitalised patients (RR 0.60, 95% CI 0.14 to 2.51; two studies) and mildly ill outpatients (RR 0.33, 95% CI 0.01 to 8.05; two studies), due to serious risk of bias and imprecision. How do the different assessments come about? The answer lies partly in the baseline data of included studies. Bryant et al pooled heterogeneous patient populations, interventions, comparators and outcomes. In other words, they compare apples and oranges, serving a large bowl of a colourful fruit salad. Usually, pooling of heterogeneous studies increases imprecision of effects in meta-analyses. Why does this not apply to ivermectin? Its alleged effect is driven by studies where the effect size is extremely positive, which has influenced the conclusions in other reviews. One of these studies with a huge effect has now been retracted over ethical concern.4
Evidence syntheses must be pieces of the highest trustworthiness. However, reliability is at risk when researchers publish problematic trials or misuse established evidence assessment tools as a guise for quality of evidence synthesis in general, but especially during a pandemic, by trying to create pseudotrustworthiness for substances that cannot be considered effective and safe treatment options nor game changers, at this stage.
Patient consent for publication
Contributors All authors contributed equally to the article. MP and SW wrote the first draft of the article. PK, PM, M-IM, NS and MSS revised the first draft of the article.
Funding The authors received funding for the Cochrane Review on ivermectin from the Federal Ministry of Education and Research, Germany NaFoUniMedCovid19 (funding number: 01K×2021); part of the project “CEOsys”, which was paid to the institutions.
Competing interests The authors authored the Cochrane Review on ivermectin for preventing and treating COVID‐19.
Provenance and peer review Not commissioned; internally peer reviewed.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.