EBM apps that help you search for answers to your clinical questions ==================================================================== * Donna Windish ## Introduction Having the ability to search for clinically relevant evidence at your fingertips is now a reality. The frequent use of smartphones and tablets opens up the possibility that clinicians can find the answers to clinical questions in real time at the bedside, provided the right tools are available. This article reviews smartphone and tablet applications (apps) that can help a clinician search for evidence to support the practice of EBM. While many of the apps discussed are free, some apps have free access as part of a professsional society membership benefit, and some apps have an initial cost or in-app costs. Table 1 provides a summary view of these apps including the platform that supports the app. Of note, there are many apps available and this review provides examples of the breadth of available apps; it is not meant to be comprehensive and does not provide app ratings. View this table: [Table 1](http://ebm.bmj.com/content/19/3/85/T1) Table 1 Summary of medical apps based on the area or level of *EBM* it addresses* ### Apps to help search for the best evidence DiCenso *et al*1 published a hierarchy of preappraised evidence called the 6S model. This model denotes the six levels of clinical evidence available to help in medical decision-making. It starts with the largest resource available, original published studies. It then moves upwards through synopses of studies, syntheses of studies, synopses of syntheses, summaries and ends with the most specific form of evidence at the apex, with the ‘systems’ layer. This section will review apps using the first five levels of evidence. For more information about clinical websites and the 6S model see Windish.2 #### Apps to identify original published studies These apps allow you to review the primary literature using PubMed or Medscape searches. Some allow you to search using the Patient, Intervention, Comparison, Outcome (PICO) format. Many allow you to save and/or email your search results. Sample apps in this category include PubMed for Handhelds, Medscape and EBSCOhost. #### Apps to identify synopses of studies These apps allow you to review resources that summarise the results of single published studies. Many have customised alerts that deliver the latest evidence from recently published articles and provide expert classified summaries of the evidence. Sample apps include ACP JournalWise, Journal Watch and InfoPOEMS. Most of these apps have a cost associated with them; others however, are included (free access) as part of professional society membership benefits (eg, members of the American College of Physicians have free access to the ACP JournalWise app). #### Apps to identify syntheses of studies Syntheses provide resources that integrate clinical information of multiple single studies through systematic reviews and/or meta-analyses. The apps that provide these syntheses often are the same apps that provide access to single studies. As with other apps aforementioned, the content of medical journals and databases are often monitored for the latest evidence. Some apps provide summary recommendations and/or practice guidelines from organisations such as the US Preventive Services Task Force (USPSTF). #### Apps to identify synopses of syntheses These apps provide an overview of the results of systematic reviews and meta-analyses with expert summaries of them. The apps in this category are the same apps that provide syntheses and synopses of studies. #### Apps to identify summaries These apps provide clinical practice guidelines. Many provide guidelines by organisation, profession, specialty and categories from worldwide medical associations. #### Apps to identify *EBM* tools and clinical calculators There are many *EBM* tools and clinical calculator apps. Some apps focus only on *EBM* tools, like calculating likelihood ratios and post-test probabilities or prediction rules. Two dedicated *EBM* apps are called *EBM* tools and MedCalc 3000 EBM. Other apps have clinical calculators that can provide medical formulas and other calculations such as determining clinical risks. ### Cautions about medical apps Recent studies have demonstrated that 65–86% of medical apps had no medical expert involvement during their development.3 ,4 In addition, questions have arisen regarding the reliability and accuracy of the medical content in apps and the potential consequences for patient safety.3 ,5 ,6 Given the high stakes nature of medical apps, the US Food and Drug Administration intends to regulate apps including those that: (1) control a medical device or display, store, analyse or transmit patient-specific medical device data (eg, ECG), (2) provide patient-specific results with help from formulae or algorithms and (3) transform the mobile platform into a regulated medical device by using attachments or sensors. Another issue to consider with using medical applications is their use of consensus abstracts that were developed by the National Library of Medicine. Consensus abstracts allow a search of MEDLINE/PubMed using PICO or free text formatting. These searches provide links to individual citations and a statement indicating the final summary. These summaries, or bottom lines, can be the conclusion of the article abstract, if one is provided, or derived from an algorithm and the last two sentences of the abstract.7 A potential problem with this approach is that no evaluation has been conducted to determine if consensus abstracts reach the same conclusions as systematic reviews or meta-analyses or how clinicians interpret consensus abstract results.7 Thus, those who use apps with consensus abstracts should be aware of this potential limitation. ### Choosing medical apps Trying to choose apps for your medical practice may be difficult given the lack of regulation. While individual apps themselves may have ratings based on current/past users, there is no standard by which to choose an app and no way to guarantee their validity or utility. Given this, one approach to finding apps can include using apps from medical organisations which are more likely to have medical professionals involved with their creation. Table 1 includes several such applications. Another approach can include trying apps with little or no cost to see if they meet your needs. ## Footnotes * Competing interests None. ## References 1. DiCenso A, Bayley L, Haynes RB. Accessing pre-appraised evidence: fine-tuning the 5S model into a 6S model. Evid Based Nurs 2009;12:99–101. [FREE Full Text](http://ebm.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6NjoiZWJudXJzIjtzOjU6InJlc2lkIjtzOjk6IjEyLzQvOTktYiI7czo0OiJhdG9tIjtzOjE5OiIvZWJtZWQvMTkvMy84NS5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 2. Windish D. Searching for the right evidence: how to answer your clinical questions using the 6S hierarchy. Evid Based Med 2013;18:93–7. [FREE Full Text](http://ebm.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6NToiZWJtZWQiO3M6NToicmVzaWQiO3M6NzoiMTgvMy85MyI7czo0OiJhdG9tIjtzOjE5OiIvZWJtZWQvMTkvMy84NS5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 3. Hamilton AD, Brady RR. Medial professional involvement in smartphone ‘apps’ in dermatology. Br J Dermatol 2012;167: 220–1. [CrossRef](http://ebm.bmj.com/lookup/external-ref?access_num=10.1111/j.1365-2133.2012.10844.x&link_type=DOI) [PubMed](http://ebm.bmj.com/lookup/external-ref?access_num=22283748&link_type=MED&atom=%2Febmed%2F19%2F3%2F85.atom) 4. Rosser BA, Eccleston C. Smartphone applications for pain management. J Telemed Telecare 2011;17:308–12. [Abstract/FREE Full Text](http://ebm.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToic3BqdHQiO3M6NToicmVzaWQiO3M6ODoiMTcvNi8zMDgiO3M6NDoiYXRvbSI7czoxOToiL2VibWVkLzE5LzMvODUuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 5. Buijink AW, Visser BJ, Marshall L. Medical apps for smartphones: lack of evidence undermines quality and safety. Evid Based Med 2013;18:90–2. [Abstract/FREE Full Text](http://ebm.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToiZWJtZWQiO3M6NToicmVzaWQiO3M6NzoiMTgvMy85MCI7czo0OiJhdG9tIjtzOjE5OiIvZWJtZWQvMTkvMy84NS5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 6. Visvanathan A, Hamilton A, Brady RR. Smartphone apps in microbiology-is better regulation required? Clin Microbiol Infect 2012;18:E218–20. [CrossRef](http://ebm.bmj.com/lookup/external-ref?access_num=10.1111/j.1469-0691.2012.03892.x&link_type=DOI) [PubMed](http://ebm.bmj.com/lookup/external-ref?access_num=22563840&link_type=MED&atom=%2Febmed%2F19%2F3%2F85.atom) 7. Fontelo P. Consensus abstracts for evidence-based medicine. Evid Based Med 2011;16:36–8. [FREE Full Text](http://ebm.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6NToiZWJtZWQiO3M6NToicmVzaWQiO3M6NzoiMTYvMi8zNiI7czo0OiJhdG9tIjtzOjE5OiIvZWJtZWQvMTkvMy84NS5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=)