The Cochrane Collaboration withdraws a review on methylphenidate for adults with attention deficit hyperactivity disorder
=========================================================================================================================

* Kim Boesen
* Luis Carlos Saiz
* Juan Erviti
* Ole Jakob Storebø
* Christian Gluud
* Peter C Gøtzsche
* Karsten Juhl Jørgensen

## Abstract

A Cochrane systematic review on immediate-release methylphenidate for adults with attention deficit hyperactivity disorder (ADHD) was withdrawn from the Cochrane Library on 26 May 2016 after substantial criticism of its methods and flawed conclusions. Retraction of scientific papers on this basis is unusual but can be necessary. We provide a summary of the criticism that led to the withdrawal. We detail the methodological flaws of the withdrawn Cochrane systematic review and general issues of bias and shortcomings of the included ADHD trials: cross-over designs compared with parallel-group designs, exclusion of participants with psychiatric comorbidity, absence of ‘functional outcomes’ and use of clinical outcomes with limited relevance, short trial duration and small trial populations, broken blinding caused by easily recognisable side effects, combining outcome assessments by trial investigators and participants, outcome reporting bias, poor evaluation of cardiovascular and psychiatric harms and conflicts of interest of trialists and systematic reviewers. The withdrawal of the Cochrane systematic review signals recognition of previous unreliable clinical ADHD research. We conclude that clinical trials of immediate-release methylphenidate in adults with ADHD are of very low quality. We urgently need well-conducted long-term trials free of bias to assess the benefits and harms of central stimulant treatment in adult ADHD.

*   Adult Psychiatry
*   Clinical Trials
*   Impulse Control Disorders
*   Adverse Events

## Background

Attention deficit hyperactivity disorder (ADHD) in adults is one of the most controversial diagnoses in medicine,1 2 and the use of methylphenidate is sharply rising.3 The Cochrane review by Epstein and colleagues about immediate-release methylphenidate for adults with ADHD from September 20144 was therefore long awaited, also because it took 9 years to appear after the protocol was published. However, four research groups independently submitted extensive criticisms of the review during the period October 2014 to November 2015. Three of the four groups coauthored the present paper and were in frequent correspondence with the editors and eventually Cochrane's editor-in-chief until the Cochrane editorial group decided to withdraw the review in May 2016.5 They issued a note outlining the reasons for their retraction.

*"The Editorial Base of the DPLPG (Developmental, Psychosocial, and Learning Problems Group) appreciate the feedback received from the contributors named below, and their patience with our endeavours to secure a response from the author team. These endeavours have been persistent, but we were, until recently, unable to secure a response from the author team, by which time we had received guidance from Cochrane's Funding Arbiter as to how to manage their conflict of interest. Subsequently, one of the authors has expressed a wish to have his name removed from the review, and we have still to hear from a second author. The third author wishes to remain an author but given these, and subsequent criticisms, together with an unsatisfactory response to those criticisms from the author team, we have decided to withdraw this review. To make public comments for the benefits of readers, we will delay withdrawing the review until 26 May 2016".* 4 

The criticisms focused mainly on the review's flaws and misleading conclusions that gave a false sense of certainty of the benefits and the absence of harms, when in fact this could not be concluded. Fundamental methodological problems in the included trials that were not addressed in the review were also highlighted in the criticisms.4 The withdrawn Cochrane review reflects in many ways a general inadequacy of clinical ADHD research,6–8 but the review authors failed to point out important flaws in the included trials. We provide here a summary of the criticism and discuss the consequences of the withdrawal.

## The confidence in the evidence

Using the Grades of Recommendation Assessment Development and Evaluation (GRADE) approach,9 the review authors expressed ‘high’ confidence in the evidence for most outcomes, despite the fact that most domains in Cochrane's Risk of Bias assessment for the included trials were labelled as ‘unclear’. Furthermore, there was very high heterogeneity between results from the individual trials for ADHD symptoms (between 76% and 88%; the maximum is 100%), and the estimates were very imprecise. The confidence in the evidence should therefore have been ‘very low’. The authors did not explore the reasons for the heterogeneity, except for a subgroup analysis that compared low versus high dosage methylphenidate, arguing that they had too few studies for meta-regression. However, reasons for substantial heterogeneity should always be explored.

## Cross-over studies

Nine of the included 11 trials had a cross-over design. The cross-over design is questionable to use in trials of central stimulants (such as methylphenidate or amphetamine) due to the risk of carry-over effects.10 It also increases the risk of unblinding and is therefore more susceptible to expectancy effects (see also Lack of blinding). According to the *Cochrane Handbook,* 11 cross-over studies may be used for ‘stable’ conditions where ‘long-term follow-up is not required’, neither of which is the case for ADHD treatment. A previous meta-analysis that included trials of stimulants for adults with ADHD showed larger effects in cross-over studies than in parallel-group trials.12 The failures to consider such fundamental elements of the trial design and explore its importance in sensitivity analyses raise major concern.

## Psychiatric comorbidity

Most adults with ADHD suffer from psychiatric comorbidity, primarily anxiety and depression,13 and the exclusion of such participants from the trials greatly impairs their external validity.14 Only 2 of the 11 trials explicitly did not exclude participants with psychiatric comorbidity; 5 trials excluded them, and it was unclear in 4 trials. The review paid no attention to this, which should have led to a downgrading for ‘indirectness’ according to GRADE.9 Downgrading for indirectness should be applied when the trial conditions (population, intervention, outcome measures) differ considerably from clinical practice.

## ‘**Functional’ outcomes**

The authors acknowledged the negative impact of ADHD on ‘functional outcomes’, such as frequency of job change, work performance, traffic accidents, marital status and academic achievements. Yet, the treatment effect on functional outcomes was not quantified in the review, although these outcomes are arguably the most important ones. None of the included trials reported data on these outcomes specifically, but this should have been highlighted in the review as an important limitation.

## Trial duration

The trials lasted only 1–7 weeks, and the long-term beneficial and harmful effects of methylphenidate are therefore unknown. Most adults with ADHD receive methylphenidate for substantially longer periods,15 and the beneficial effects may furthermore diminish over time. This was observed in the large Multimodal Treatment of Attention Deficit Hyperactivity Disorder Study in children.7 16–18 The short trial duration should therefore have led to additional downgrading for indirectness according to GRADE.9 

## Small trials

The total sample size in the review was only 474 participants, and the trial median was only 30. Small trials are underpowered to detect clinically relevant effects, and their results are generally misleading,19 particularly when they are biased, as is the case here. Furthermore, small trials cannot detect rare harms of drugs, a very important issue that was not mentioned in the review.4 

## Lack of blinding

Maintaining blinding in trials of central stimulant drugs with characteristic detectable (and for some people) pleasurable effects and also characteristic adverse effects is very unlikely without the use of an active placebo. This important issue was not considered in the review. Furthermore, 9 of the 11 studies used a titration scheme to achieve the highest tolerated dose, which virtually excludes the possibility that blinding was effective. Still, the trials were described as ‘double-blind’, and this was accepted by the review authors, the peer reviewers and the editors. The included trials did not formally assess whether the blinding was effective, but one trial20 reported that all eight participants were able to guess their allocation. The inherent problem of maintaining blinded conditions in trials of central stimulants for ADHD was highlighted in the Cochrane reviews of methylphenidate for children with ADHD7 and of amphetamines for adults with ADHD.6 

## Pooling investigator-rated and self-rated ADHD symptom scores

The review reported the combined effect size for self-rated and investigator-rated ADHD symptom scores, where the latter was preferred when both were reported in the same study. However, previous meta-analyses have demonstrated substantial differences, with investigators estimating higher effects.12 21 Obviously, the participants’ perception of the effect is more important than that of the investigator. It has been argued that the investigator is more ‘useful’ to detect changes in ADHD behaviour,12 but investigators may simply be more biased than participants in trials that have not been adequately blinded even though the detectable effects of central stimulants may bias the participants’ assessments. It is essential that both participant and investigator ratings are analysed and reported separately.

## Outcome reporting bias

The authors of the retracted review wrote that prestated outcomes were reported in most studies and therefore judged the risk of outcome reporting bias as ‘low’.4 However, in direct contradiction to this, they wrote in the abstract that “We were unable to determine whether adverse effects were not discussed by study authors because none occurred or because no data on adverse effects were collected”.4 They also noted that this prevented them from conducting meta-analyses of adverse events and concluded that “Trial data suggest that adverse effects from immediate-release methylphenidate for adults with ADHD are not of serious clinical significance, although this conclusion may be limited, certainly in the case of weight loss, by the short duration of published studies”.4 It is misleading to conclude that trial data suggest that adverse effects are not of ‘serious clinical significance’ when important data are not available and follow-up is very short. The risk of outcome reporting bias in the included trials, most evident for the adverse events data, should have been stated clearly in the review.

Outcome reporting bias is not limited to old trials of immediate-release methylphenidate. We have pointed out22 that the most recent trial of extended-release methylphenidate from 201523  failed to report and specify crucial outcomes such as adverse events and quality of life.22 In addition, ‘absence from work’ and long-term outcomes after 2.5 years were omitted from the publication.

## Cardiovascular and psychiatric harms

The cardiovascular harms of stimulants have long been in focus.24 The review authors narratively described the cardiovascular effects in five studies, but they did not conduct meta-analyses for pulse or blood pressure changes, which are the only meaningful cardiovascular surrogate outcomes in small, short-term trials. Three of those five trials reported data for such an analysis. Stimulants increase blood pressure and pulse in adults25 and may increase the risk of ischaemic heart disease beyond the short follow-up period of the trials, particularly in adults, where many have additional risk factors for cardiovascular disease. In children and adolescents with ADHD, there is an increased risk of arrhythmias and myocardial infarction during the initial phase of methylphenidate treatment,26 and the risk of cardiovascular events with different levels of severity is doubled in stimulant users compared with non-users.27 The risk of developing psychiatric adverse events such as psychosis, mania and aggression was not mentioned in the review,4 although a large Canadian population-based study28 and an FDA review29 30 found that ADHD drug use, including methylphenidate, was associated with such events in children and adolescents.

## Comparison with other research

The review authors compared their results with those of three meta-analyses but not with three newer systematic reviews,12 31 32 nor with a comprehensive drug class review.33 These omissions are problematic as these reviews reported different effect sizes, considered several of the methodological limitations that we have outlined above and conducted subgroup and meta-regression analyses that Epstein and colleagues did not.4 The drug class review33 even abstained from doing meta-analyses as the authors considered the trials to be too unreliable.

## Conflicts of interests

We believe that the trialists’ conflicts of interests should have been discussed in the review. Only 2 of the 11 trials were explicitly funded by the drug industry, whereas 2 were unclear about this. Yet, two trials34 35 (one publicly funded35 and one with no declaration of funding34) were authored by three psychiatrists, which were investigated by US Senator Grassley in 2008 for financial ties to the pharmaceutical industry.36 The investigation revealed that each researcher had received millions of dollars from the drug industry without disclosing it.36 Two of the three authors of the Cochrane review declared financial conflicts of interests.4 It is very likely that authors of systematic reviews with conflicts of interests are influenced in the same way as trialists are.11 We believe that the Cochrane Collaboration should introduce a policy that does not allow any financial conflicts of interest for review authors.

## Discussion

The withdrawal sends a strong message to the field of clinical ADHD research and about the trustworthiness of the Cochrane Library. The decision to withdraw the review also provides indirect support to the Cochrane review on methylphenidate for children with ADHD, whose authors emphasised the ‘very low’ confidence they had in the evidence.7 This main conclusion has been criticised by the European Network for Hyperkinetic Disorders (EUNETHYDIS), a group of ADHD researchers. EUNETHYDIS has worked hard to discredit the Cochrane review of children37–43 by publishing virtually the same criticisms in several papers in their own journals,37 38 41 43 despite the fact that their criticisms have been refuted repeatedly by the Cochrane review authors.7 44–49 EUNETHYDIS seems to defend a certain opinion rather than to consider the many flaws and low quality of the data outlined here and in the review of children.7 A systematic review on atomoxetine for adults with ADHD50 concluded that the harms of treatment probably outweighed the benefits, but it was criticised in a similar manner by, among others, employees of Eli Lilly, the manufacturer of atomoxetine.51 52 

Scientific papers are rarely retracted, even when they are seriously flawed. Outright fraud is a reason for retraction, but even then it can take many years before retraction,53 if it ever occurs. A policy of retracting papers that mislead readers importantly, with serious consequences for patients' and public health, should be introduced. Such initiatives could be taken by organisations like the World Association of Medical Editors or the International Committee of Medical Journal Editors. Appropriate measures should be taken, however, to avoid such policy being misused to get critical papers retracted.

The Cochrane editors should be praised that they made the difficult choice to retract the misleading Cochrane review, although we also note that it took 19 months from the first critical comments were submitted in October 2014 until these were published4 alongside the withdrawal in May 2016.5 During this time, the review was cited in influential publications such as the Canadian Agency for Drugs and Technologies in Health's review of high-dose stimulants for ADHD;54 it was summarised in a ‘Cochrane for Clinicians’ article in the *American Family Physician;* 55 and a recent *JAMA* editorial referred to the now withdrawn review in support of the view that methylphenidate trials are of high quality.56 We urge Cochrane editors to speed up communications with readers and to introduce functions similar to the *rapid responses* in the *BMJ* or the response function in PubMed Commons as soon as it is technically possible.

## Conclusions

The withdrawal of the Cochrane review on immediate-release methylphenidate for adults with ADHD was an important decision that underlines the fact that ADHD drug trials are unreliable. It is time to start doing them right, and we hope that the criticism we have listed above may serve as a checklist for future trials and also for systematic reviews of trials of central stimulants.

## Acknowledgments

None

## Footnotes

*   Contributors Three author teams jointly coined this manuscript based on their independently submitted comments on the now withdrawn Cochrane review. KB, PCG and KJJ currently work on a Cochrane review of extended-release methylphenidate for adults with ADHD. KB wrote the first draft of this manuscript. LCS and JE work on projects about the cardiac effects of methylphenidate and long-term academic achievement in ADHD drug users. OJS and CG authored the Cochrane review of methylphenidate for children and adolescents, and they currently work on a review assessing the harms in children and adolescents.

*   Competing interests None declared.

*   Provenance and peer review Not commissioned; externally peer reviewed.

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: [http://creativecommons.org/licenses/by-nc/4.0/](http://creativecommons.org/licenses/by-nc/4.0/) 

## References

1.  1. Asherson P , Adamou M , Bolea B , et al . Is ADHD a valid diagnosis in adults? Yes. BMJ 2010;340:c549.[doi:10.1136/bmj.c549](http://dx.doi.org/10.1136/bmj.c549) 
    
    [FREE Full Text](http://ebm.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE2OiIzNDAvbWFyMjZfMS9jNTQ5IjtzOjQ6ImF0b20iO3M6MjA6Ii9lYm1lZC8yMi80LzE0My5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

2.  2. Moncrieff J , Timimi S . Is ADHD a valid diagnosis in adults? No. BMJ 2010;340:c547.[doi:10.1136/bmj.c547](http://dx.doi.org/10.1136/bmj.c547) 
    
    [FREE Full Text](http://ebm.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE2OiIzNDAvbWFyMjZfMS9jNTQ3IjtzOjQ6ImF0b20iO3M6MjA6Ii9lYm1lZC8yMi80LzE0My5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

3.  3. Renoux C , Shin JY , Dell'Aniello S , et al . Prescribing trends of attention-deficit hyperactivity disorder (ADHD) medications in UK primary care, 1995-2015. Br J Clin Pharmacol 2016;82:858–68.[doi:10.1111/bcp.13000](http://dx.doi.org/10.1111/bcp.13000) 
    
    

4.  4. Epstein T , Patsopoulos NA , Weiser M . Immediate-release methylphenidate for attention deficit hyperactivity disorder (ADHD) in adults (Review). Cochrane Database Syst Rev 2014;9:CD005041.
    
    [PubMed](http://ebm.bmj.com/lookup/external-ref?access_num=25230710&link_type=MED&atom=%2Febmed%2F22%2F4%2F143.atom) 

5.  5. Epstein T , Patsopoulos NA , Weiser M . WITHDRAWN: Immediate-release methylphenidate for attention deficit hyperactivity disorder (ADHD) in adults (Review). Cochrane Database Syst Rev 2016;5:CD005041.
    
    

6.  6. Castells X , Ramos-Quiroga JA , Bosch R , et al . Amphetamines for attention deficit hyperactivity disorder (ADHD) in adults (Review). Cochrane Database Syst Rev 2011;6:CD007813.
    
    [PubMed](http://ebm.bmj.com/lookup/external-ref?access_num=21678370&link_type=MED&atom=%2Febmed%2F22%2F4%2F143.atom) 

7.  7. Storebø OJ , Ramstad E , Krogh HB , et al . Methylphenidate for children and adolescents with attention deficit hyperactivity disorder (ADHD) (Review). Cochrane Database Syst Rev 2015;11:CD009885.
    
    

8.  8. Punja S , Shamseer L , Hartling L , et al . Amphetamines for attention deficit hyperactivity disorder (ADHD) in children and adolescents. Cochrane Database Syst Rev 2016;2:CD009996.[doi:10.1002/14651858.CD009996.pub2](http://dx.doi.org/10.1002/14651858.CD009996.pub2) 
    
    

9.  9.1.  
    2.   Schünemann H , 
    3.   Brożek J , 
    4.   Guyatt G  
    
    , eds. GRADE handbook for grading quality of evidence and strength of recommendations. Updated October 2013. 2013: The GRADE Working Group. [http://www.guidelinedevelopment.org/handbook](http://www.guidelinedevelopment.org/handbook).
    
    

10. 10. Cox DJ , Moore M , Burket R , et al . Rebound effects with long-acting amphetamine or methylphenidate stimulant medication preparations among adolescent male drivers with attention-deficit/hyperactivity disorder. J Child Adolesc Psychopharmacol 2008;18:1–10.[doi:10.1089/cap.2006.0141](http://dx.doi.org/10.1089/cap.2006.0141) 
    
    [CrossRef](http://ebm.bmj.com/lookup/external-ref?access_num=10.1089/cap.2006.0141&link_type=DOI) 
    
    [PubMed](http://ebm.bmj.com/lookup/external-ref?access_num=18294083&link_type=MED&atom=%2Febmed%2F22%2F4%2F143.atom) 

11. 11.1.  
    2.   Higgins JPT , 
    3.   Green S  
    
    , eds. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 (updated March 2011). 2011: The Cochrane Collaboration. [http://www.cochrane-handbook.org](http://www.cochrane-handbook.org) 
    
    

12. 12. Faraone SV , Glatt SJ . A comparison of the efficacy of medications for adult attention-deficit/hyperactivity disorder using meta-analysis of effect sizes. J Clin Psychiatry 2010;71:754–63.[doi:10.4088/JCP.08m04902pur](http://dx.doi.org/10.4088/JCP.08m04902pur) 
    
    [CrossRef](http://ebm.bmj.com/lookup/external-ref?access_num=10.4088/JCP.08m04902pur&link_type=DOI) 
    
    [PubMed](http://ebm.bmj.com/lookup/external-ref?access_num=20051220&link_type=MED&atom=%2Febmed%2F22%2F4%2F143.atom) 
    
    [Web of Science](http://ebm.bmj.com/lookup/external-ref?access_num=000278877100011&link_type=ISI) 

13. 13. Sobanski E . Psychiatric comorbidity in adults with attention-deficit/hyperactivity disorder (ADHD). Eur Arch Psychiatry Clin Neurosci 2006;256(S1):i26–31.[doi:10.1007/s00406-006-1004-4](http://dx.doi.org/10.1007/s00406-006-1004-4) 
    
    [CrossRef](http://ebm.bmj.com/lookup/external-ref?access_num=10.1007/s00406-006-1004-4&link_type=DOI) 
    
    [PubMed](http://ebm.bmj.com/lookup/external-ref?access_num=16977548&link_type=MED&atom=%2Febmed%2F22%2F4%2F143.atom) 

14. 14. Surman CB , Monuteaux MC , Petty CR , et al . Representativeness of participants in a clinical trial for attention-deficit/hyperactivity disorder? Comparison with adults from a large observational study. J Clin Psychiatry 2010;71:1612–6.[doi:10.4088/JCP.09m05344pur](http://dx.doi.org/10.4088/JCP.09m05344pur) 
    
    [CrossRef](http://ebm.bmj.com/lookup/external-ref?access_num=10.4088/JCP.09m05344pur&link_type=DOI) 
    
    [PubMed](http://ebm.bmj.com/lookup/external-ref?access_num=20816030&link_type=MED&atom=%2Febmed%2F22%2F4%2F143.atom) 
    
    [Web of Science](http://ebm.bmj.com/lookup/external-ref?access_num=000286296100007&link_type=ISI) 

15. 15. Karlstad Ø , Zoëga H , Furu K , et al . Use of drugs for ADHD among adults – a multinational study among 15.8 millions adults in the nordic countries. Eur J Pharmacol 2016;72:1507–14.
    
    

16. 16. Molina BS , Hinshaw SP , Swanson JM , et al . The MTA at 8 years: prospective follow-up of children treated for combined-type ADHD in a multisite study. J Am Acad Child Adolesc Psychiatry 2009;48:484–500.[doi:10.1097/CHI.0b013e31819c23d0](http://dx.doi.org/10.1097/CHI.0b013e31819c23d0) 
    
    [CrossRef](http://ebm.bmj.com/lookup/external-ref?access_num=10.1097/CHI.0b013e31819c23d0&link_type=DOI) 
    
    [PubMed](http://ebm.bmj.com/lookup/external-ref?access_num=19318991&link_type=MED&atom=%2Febmed%2F22%2F4%2F143.atom) 
    
    [Web of Science](http://ebm.bmj.com/lookup/external-ref?access_num=000265461000006&link_type=ISI) 

17. 17. Jensen PS , Arnold LE , Swanson JM , et al . 3-year follow-up of the NIMH MTA study. J Am Acad Child Adolesc Psychiatry 2007;46:989–1002.[doi:10.1097/CHI.0b013e3180686d48](http://dx.doi.org/10.1097/CHI.0b013e3180686d48) 
    
    [CrossRef](http://ebm.bmj.com/lookup/external-ref?access_num=10.1097/CHI.0b013e3180686d48&link_type=DOI) 
    
    [PubMed](http://ebm.bmj.com/lookup/external-ref?access_num=17667478&link_type=MED&atom=%2Febmed%2F22%2F4%2F143.atom) 
    
    [Web of Science](http://ebm.bmj.com/lookup/external-ref?access_num=000248339600010&link_type=ISI) 

18. 18. Swanson JM , Arnold LE , Molina BSG , et al . Young adult outcomes in the follow-up of the multimodal treatment study of attention-deficit/hyperactivity disorder: symptom persistence, source discrepancy, and height suppression. J Child Psychol Psychiatry 2017;58:663–78.[doi:10.1111/jcpp.12684](http://dx.doi.org/10.1111/jcpp.12684) 
    
    

19. 19. Ioannidis JP . Why most published research findings are false. PLoS Med 2005;2:e124.[doi:10.1371/journal.pmed.0020124](http://dx.doi.org/10.1371/journal.pmed.0020124) 
    
    [CrossRef](http://ebm.bmj.com/lookup/external-ref?access_num=10.1371/journal.pmed.0020124&link_type=DOI) 
    
    [PubMed](http://ebm.bmj.com/lookup/external-ref?access_num=16060722&link_type=MED&atom=%2Febmed%2F22%2F4%2F143.atom) 

20. 20. Gualtieri CT , Ondrusek MG , Finley C . Attention deficit disorders in adults. Clin Neuropharmacol 1985;8:343–56.[doi:10.1097/00002826-198512000-00005](http://dx.doi.org/10.1097/00002826-198512000-00005) 
    
    [CrossRef](http://ebm.bmj.com/lookup/external-ref?access_num=10.1097/00002826-198512000-00005&link_type=DOI) 
    
    [PubMed](http://ebm.bmj.com/lookup/external-ref?access_num=4075304&link_type=MED&atom=%2Febmed%2F22%2F4%2F143.atom) 
    
    [Web of Science](http://ebm.bmj.com/lookup/external-ref?access_num=A1985AVU4400005&link_type=ISI) 

21. 21. Faraone SV , Spencer T , Aleardi M , et al . Meta-analysis of the efficacy of methylphenidate for treating adult attention-deficit/hyperactivity disorder. J Clin Psychopharmacol 2004;24:24–9.[doi:10.1097/01.jcp.0000108984.11879.95](http://dx.doi.org/10.1097/01.jcp.0000108984.11879.95) 
    
    [CrossRef](http://ebm.bmj.com/lookup/external-ref?access_num=10.1097/01.jcp.0000108984.11879.95&link_type=DOI) 
    
    [PubMed](http://ebm.bmj.com/lookup/external-ref?access_num=14709943&link_type=MED&atom=%2Febmed%2F22%2F4%2F143.atom) 
    
    [Web of Science](http://ebm.bmj.com/lookup/external-ref?access_num=000188093400005&link_type=ISI) 

22. 22. Boesen K , Gøtzsche PC . Quality of Life of Adult Patients With Attention-Deficit/Hyperactivity Disorder Taking Methylphenidate. JAMA Psychiatry 2016;73:533–4.[doi:10.1001/jamapsychiatry.2016.0049](http://dx.doi.org/10.1001/jamapsychiatry.2016.0049) 
    
    

23. 23. Philipsen A , Jans T , Graf E , et al . Effects of Group Psychotherapy, Individual Counseling, Methylphenidate, and Placebo in the Treatment of Adult Attention-Deficit/Hyperactivity Disorder: a Randomized Clinical Trial. JAMA Psychiatry 2015;72:1199–210.[doi:10.1001/jamapsychiatry.2015.2146](http://dx.doi.org/10.1001/jamapsychiatry.2015.2146) 
    
    

24. 24. Nissen SE . ADHD Drugs and Cardiovascular Risk. N Engl J Med 2006;354:1445–8.[doi:10.1056/NEJMp068049](http://dx.doi.org/10.1056/NEJMp068049) 
    
    [CrossRef](http://ebm.bmj.com/lookup/external-ref?access_num=10.1056/NEJMp068049&link_type=DOI) 
    
    [PubMed](http://ebm.bmj.com/lookup/external-ref?access_num=16549404&link_type=MED&atom=%2Febmed%2F22%2F4%2F143.atom) 
    
    [Web of Science](http://ebm.bmj.com/lookup/external-ref?access_num=000236539000001&link_type=ISI) 

25. 25. Mick E , McManus DD , Goldberg RJ . Meta-analysis of increased heart rate and blood pressure associated with CNS stimulant treatment of ADHD in adults. Eur Neuropsychopharmacol 2013;23:534–41.[doi:10.1016/j.euroneuro.2012.06.011](http://dx.doi.org/10.1016/j.euroneuro.2012.06.011) 
    
    [CrossRef](http://ebm.bmj.com/lookup/external-ref?access_num=10.1016/j.euroneuro.2012.06.011&link_type=DOI) 
    
    [PubMed](http://ebm.bmj.com/lookup/external-ref?access_num=22796229&link_type=MED&atom=%2Febmed%2F22%2F4%2F143.atom) 

26. 26. Shin JY , Roughead EE , Park BJ , et al . Cardiovascular safety of methylphenidate among children and young people with attention-deficit/hyperactivity disorder (ADHD): Nationwide self controlled case series study. BMJ 2016;353:i2550.[doi:10.1136/bmj.i2550](http://dx.doi.org/10.1136/bmj.i2550) 
    
    [Abstract/FREE Full Text](http://ebm.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE3OiIzNTMvbWF5MzFfOC9pMjU1MCI7czo0OiJhdG9tIjtzOjIwOiIvZWJtZWQvMjIvNC8xNDMuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

27. 27. Dalsgaard S , Kvist AP , Leckman JF , et al . Cardiovascular safety of stimulants in children with attention-deficit/hyperactivity disorder: a nationwide prospective cohort study. J Child Adolesc Psychopharmacol 2014;24:302–10.[doi:10.1089/cap.2014.0020](http://dx.doi.org/10.1089/cap.2014.0020) 
    
    

28. 28. Cressman AM , Macdonald EM , Huang A , et al . Prescription stimulant use and hospitalization for psychosis or mania. J Clin Psychopharmacol 2015;35:667–71.[doi:10.1097/JCP.0000000000000406](http://dx.doi.org/10.1097/JCP.0000000000000406) 
    
    

29. 29. Gelperin K , Phelan K . Psychiatric adverse events associated with drug treatment of ADHD: review of postmarketing safety data. The DDRE ADHD Psychiatry Review Team, Division of Drug Risk Evaluation, Office of Drug Safety 2006 [http://www.fda.gov/ohrms/dockets/ac/06/briefing/2006-4210b\_11\_01\_AdverseEvents.pdf](http://www.fda.gov/ohrms/dockets/ac/06/briefing/2006-4210b_11_01_AdverseEvents.pdf) 
    
    

30. 30. Mosholder AD , Gelperin K , Hammad TA , et al . Hallucinations and other psychotic symptoms associated with the use of attention-deficit/hyperactivity disorder drugs in children. Pediatrics 2009;123:611–6.[doi:10.1542/peds.2008-0185](http://dx.doi.org/10.1542/peds.2008-0185) 
    
    [Abstract/FREE Full Text](http://ebm.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MTA6InBlZGlhdHJpY3MiO3M6NToicmVzaWQiO3M6OToiMTIzLzIvNjExIjtzOjQ6ImF0b20iO3M6MjA6Ii9lYm1lZC8yMi80LzE0My5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

31. 31. Koesters M , Becker T , Kilian R , et al . Limits of meta-analysis: methylphenidate in the treatment of adult attention-deficit hyperactivity disorder. J Psychopharmacol 2009;23:733–44.[doi:10.1177/0269881108092338](http://dx.doi.org/10.1177/0269881108092338) 
    
    [CrossRef](http://ebm.bmj.com/lookup/external-ref?access_num=10.1177/0269881108092338&link_type=DOI) 
    
    [PubMed](http://ebm.bmj.com/lookup/external-ref?access_num=18562416&link_type=MED&atom=%2Febmed%2F22%2F4%2F143.atom) 
    
    [Web of Science](http://ebm.bmj.com/lookup/external-ref?access_num=000269027100001&link_type=ISI) 

32. 32. Castells X , Ramos-Quiroga JA , Rigau D , et al . Efficacy of methylphenidate for adults with attention-deficit hyperactivity disorder: a meta-regression analysis. CNS Drugs 2011;25:157–69.[doi:10.2165/11539440-000000000-00000](http://dx.doi.org/10.2165/11539440-000000000-00000) 
    
    [CrossRef](http://ebm.bmj.com/lookup/external-ref?access_num=10.2165/11539440-000000000-00000&link_type=DOI) 
    
    [PubMed](http://ebm.bmj.com/lookup/external-ref?access_num=21254791&link_type=MED&atom=%2Febmed%2F22%2F4%2F143.atom) 
    
    [Web of Science](http://ebm.bmj.com/lookup/external-ref?access_num=000287556900005&link_type=ISI) 

33. 33. McDonagh MS , Peterson K , Thakurta S , et al . Drug Class Review: Pharmacologic treatments for attention deficit hyperactivity disorder: Final Update 4 Report. Portland (OR): Oregon Health & Science University, 2011.
    
    

34. 34. Spencer T , Wilens T , Biederman J , et al . A double-blind, crossover comparison of methylphenidate and placebo in adults with childhood-onset attention-deficit hyperactivity disorder. Arch Gen Psychiatry 1995;52:434–43.[doi:10.1001/archpsyc.1995.03950180020004](http://dx.doi.org/10.1001/archpsyc.1995.03950180020004) 
    
    [CrossRef](http://ebm.bmj.com/lookup/external-ref?access_num=10.1001/archpsyc.1995.03950180020004&link_type=DOI) 
    
    [PubMed](http://ebm.bmj.com/lookup/external-ref?access_num=7771913&link_type=MED&atom=%2Febmed%2F22%2F4%2F143.atom) 
    
    [Web of Science](http://ebm.bmj.com/lookup/external-ref?access_num=A1995RC02500002&link_type=ISI) 

35. 35. Spencer T , Biederman J , Wilens T , et al . A large, double-blind, randomized clinical trial of methylphenidate in the treatment of adults with attention-deficit/hyperactivity disorder. Biol Psychiatry 2005;57:456–63.[doi:10.1016/j.biopsych.2004.11.043](http://dx.doi.org/10.1016/j.biopsych.2004.11.043) 
    
    [CrossRef](http://ebm.bmj.com/lookup/external-ref?access_num=10.1016/j.biopsych.2004.11.043&link_type=DOI) 
    
    [PubMed](http://ebm.bmj.com/lookup/external-ref?access_num=15737659&link_type=MED&atom=%2Febmed%2F22%2F4%2F143.atom) 
    
    [Web of Science](http://ebm.bmj.com/lookup/external-ref?access_num=000227415400003&link_type=ISI) 

36. 36. Lenzer J . Review launched after Harvard psychiatrist failed to disclose industry funding. BMJ 2008;336:1327.[doi:10.1136/bmj.39609.364688.DB](http://dx.doi.org/10.1136/bmj.39609.364688.DB) 
    
    [FREE Full Text](http://ebm.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE1OiIzMzYvNzY1Ny8xMzI3LWEiO3M6NDoiYXRvbSI7czoyMDoiL2VibWVkLzIyLzQvMTQzLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

37. 37. Hoekstra PJ , Buitelaar JK . Is the evidence base of methylphenidate for children and adolescents with attention-deficit/hyperactivity disorder flawed? Eur Child Adolesc Psychiatry 2016;25:339–40.[doi:10.1007/s00787-016-0845-2](http://dx.doi.org/10.1007/s00787-016-0845-2) 
    
    

38. 38. Banaschewski T , Gerlach M , Becker K , et al . Trust, but verify. The errors and misinterpretations in the Cochrane analysis by O. J. Storebo and colleagues on the efficacy and safety of methylphenidate for the treatment of children and adolescents with ADHD. Z Kinder Jugendpsychiatr Psychother 2016;44:307–14.[doi:10.1024/1422-4917/a000433](http://dx.doi.org/10.1024/1422-4917/a000433) 
    
    [CrossRef](http://ebm.bmj.com/lookup/external-ref?access_num=10.1024/1422-4917/a000433&link_type=DOI) 
    
    [PubMed](http://ebm.bmj.com/lookup/external-ref?access_num=27270192&link_type=MED&atom=%2Febmed%2F22%2F4%2F143.atom) 

39. 39. Romanos M , Reif A , Banaschewski T . Methylphenidate for Attention-Deficit/Hyperactivity disorder. JAMA 2016;316:994–5.[doi:10.1001/jama.2016.10279](http://dx.doi.org/10.1001/jama.2016.10279) 
    
    

40. 40. Simonoff E , Banaschewski T , Buitelaar J , et al . Are methylphenidate effects in children with ADHD really uncertain? [Rapid response article]. BMJ 2016 [http://www.bmj.com/content/351/bmj.h5203/rapid-responses (accessed June 2017)](http://www.bmj.com/content/351/bmj.h5203/rapid-responses (accessed June 2017)).
    
    

41. 41. Romanos M , Coghill D , Gerlach M , et al . Check and double check - the Cochrane review by Storebo et al. (2015) is indeed flawed. Z Kinder Jugendpsychiatr Psychother 2016;44:336–7.[doi:10.1024/1422-4917/a000473](http://dx.doi.org/10.1024/1422-4917/a000473) 
    
    

42. 42. Banaschewski T , Buitelaar J , Chui CSL , et al . Methylphenidate for ADHD in children and adolescents: throwing the baby out with the bathwater. Evid Based Ment Health 2016;19:97–9.
    
    [Abstract/FREE Full Text](http://ebm.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiZWJtZW50YWwiO3M6NToicmVzaWQiO3M6NzoiMTkvNC85NyI7czo0OiJhdG9tIjtzOjIwOiIvZWJtZWQvMjIvNC8xNDMuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

43. 43. Gerlach M , Banaschewski T , Coghill D , et al . What are the benefits of methylphenidate as a treatment for children and adolescents with attention-deficit/hyperactivity disorder? Atten Defic Hyperact Disord 2017;9:1–3.[doi:10.1007/s12402-017-0220-2](http://dx.doi.org/10.1007/s12402-017-0220-2) 
    
    

44. 44. Storebø OJ , Simonsen E , Gluud C . The evidence base of methylphenidate for children and adolescents with attention-deficit hyperactivity disorder is in fact flawed. Eur Child Adolesc Psychiatry 2016;25:1037–8.[doi:10.1007/s00787-016-0855-0](http://dx.doi.org/10.1007/s00787-016-0855-0) 
    
    

45. 45. Storebø  OJ , Zwi M , Moreira-Maia CR , et al . Response to “Trust, but verify” by Banaschewski *et al* . Z Kinder Jugendpsychiatr Psychother 2016;44:334–5.[doi:10.1024/1422-4917/a000472](http://dx.doi.org/10.1024/1422-4917/a000472) 
    
    

46. 46. Storebø  OJ , Simonsen E , Gluud C . Methylphenidate for Attention-Deficit/Hyperactivity Disorder? Reply. JAMA 2016;316:995.[doi:10.1001/jama.2016.10300](http://dx.doi.org/10.1001/jama.2016.10300) 
    
    

47. 47. Storebø OJ , Zwi M , Gluud C . Re: Methylphenidate for attention-deficit/hyperactivity disorder in children and adolescents: cochrane systematic review with meta-analyses and trial sequential analyses of randomised clinical trials. [Rapid response article]. BMJ  2016 [http://www.bmj.com/content/351/bmj.h5203/rapid-responses (accessed June 2017)](http://www.bmj.com/content/351/bmj.h5203/rapid-responses (accessed June 2017)).
    
    

48. 48. Storebø OJ , Zwi M , Krogh HB , et al . Evidence on methylphenidate in children and adolescents with ADHD is in fact of 'very low quality'. Evid Based Ment Health 2016;19:100–2.[doi:10.1136/eb-2016-102499](http://dx.doi.org/10.1136/eb-2016-102499) 
    
    [Abstract/FREE Full Text](http://ebm.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiZWJtZW50YWwiO3M6NToicmVzaWQiO3M6ODoiMTkvNC8xMDAiO3M6NDoiYXRvbSI7czoyMDoiL2VibWVkLzIyLzQvMTQzLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

49. 49. Storebø OJ , Zwi M , Krogh HB , et al . Pubmed Commons RE: what are the benefits of methylphenidate as a treatment for children and adolescents with attention-deficit/hyperactivity disorder? [https://www.ncbi.nlm.nih.gov/pubmed/28168407#cm28168407\_65254](https://www.ncbi.nlm.nih.gov/pubmed/28168407#cm28168407_65254).
    
    

50. 50. Cunill R , Castells X , Tobias A , et al . Atomoxetine for attention deficit hyperactivity disorder in the adulthood: a meta-analysis and meta-regression. Pharmacoepidemiol Drug Saf 2013;22:961–9.[doi:10.1002/pds.3473](http://dx.doi.org/10.1002/pds.3473) 
    
    [PubMed](http://ebm.bmj.com/lookup/external-ref?access_num=23813665&link_type=MED&atom=%2Febmed%2F22%2F4%2F143.atom) 

51. 51. Ramos-Quiroga JA , Lopez-Romero P , Bushe C . Response to Cunill *et al* . Pharmacoepidemiol Drug Saf 2014;23:435–6.[doi:10.1002/pds.3572](http://dx.doi.org/10.1002/pds.3572) 
    
    [CrossRef](http://ebm.bmj.com/lookup/external-ref?access_num=10.1002/pds.3572&link_type=DOI) 
    
    [PubMed](http://ebm.bmj.com/lookup/external-ref?access_num=24706417&link_type=MED&atom=%2Febmed%2F22%2F4%2F143.atom) 

52. 52. Cunill R , Castells X , Tobias A , et al .Reply to the letter to the editor by Ramos-Quiroga et al. Pharmacoepidemiol Drug Saf 2014;23:437–8.[doi:10.1002/pds.3570](http://dx.doi.org/10.1002/pds.3570) 
    
    

53. 53. Godlee F , Smith J , Marcovitch H . Wakefield's article linking MMR vaccine and autism was fraudulent. BMJ 2011;342:c7452.[doi:10.1136/bmj.c7452](http://dx.doi.org/10.1136/bmj.c7452) 
    
    [FREE Full Text](http://ebm.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE3OiIzNDIvamFuMDVfMS9jNzQ1MiI7czo0OiJhdG9tIjtzOjIwOiIvZWJtZWQvMjIvNC8xNDMuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

54. 54.CADTH Rapid Response Reports. High-dose stimulants for attention-deficit/hyperactivity disorder: A review of the clinical effectiveness, safety and guidelines. Ottawa (ON): Canadian Agency for Drugs and Technologies in Health, 2016.
    
    

55. 55. Kocher J , Adams P . Immediate-release methylphenidate for the treatment of ADHD in adults. Am Fam Physician 2015;91:445–6.
    
    

56. 56. Shaw P . Quantifying the benefits and risks of methylphenidate as treatment for childhood attention-deficit/hyperactivity disorder. JAMA 2016;315:1953–5.[doi:10.1001/jama.2016.3427](http://dx.doi.org/10.1001/jama.2016.3427)