Article Text

Download PDFPDF

Review: computerised reminders and feedback can improve provider medication management
  1. Ida Sim, MD, PhD
  1. University of California San Francisco School of Medicine
 San Francisco, California, USA

    Statistics from

 QUESTION: What is the effectiveness of computer generated medication reminders or feedback directed at healthcare providers or patients?

    Data sources

    English language studies were identified by searching Medline (1966–2001), CINAHL (1982–2001), COMPENDEX (1987–2001), the Cochrane Controlled Trials Register (1996–2001), and Current Contents (1997–2001); hand searching the contents pages of conference proceedings from MEDINFO (1980–92) and SCAMC/AMIA Annual Fall Symposium (1984–91); and reviewing reference lists of retrieved articles.

    Study selection

    Randomised controlled trials (RCTs) were included if they assessed the use of computers to assist in identifying patients and generating reminders or feedback. Studies of systems that calculated drug doses were excluded.

    Data extraction

    Data were extracted on setting, participants, nature of reminders, and rates of compliance. Quality of individual studies was scored for randomisation method (3 points), attention to comparability of baseline data (2), objectivity of primary outcome (4), loss to follow up (4), clarity of inclusion criteria (1), unit of allocation (1), ease of implementation of reminder system (1), and statistical analysis (1) (total possible points = 17).

    Main results

    26 trials (29 comparisons) were included in the analysis. Mean quality score was 13.6 (range 9–17). Meta-analysis was not possible because of heterogeneity among the individual studies. The results are summarised in the table.

    Computerised decision support systems v control for medication management


    Despite considerable variability in study quality and findings, some evidence shows that computerised feedback and reminders to providers improve management of medication; reminders are more effective than feedback.


    Great attention has been paid recently to reducing medical errors in general, and medication errors in particular.1 Computerised physician order entry coupled with computerised decision support systems (DSSs) is being promoted as part of the solution. The systematic review by Bennett et al is a timely examination of the effectiveness of DSSs for medication management.

    Bennett et al offer some sobering conclusions: only 16 of 29 comparisons (55%) showed improvement with DSSs, effect sizes were modest, and no data were available on patient outcomes. Taking into account the tendency for positive studies to be disproportionately published, the current evidence can be summarised as being suggestive, but on the whole equivocal.

    Moreover, the reported successes may not be easily generalisable. Some of the studies with larger effect sizes were done on internally developed systems in large medical centres with electronic medical records (EMRs). However, EMR use occurs in only 13% of hospitals2 and 5% of ambulatory clinics3 in the US. Bennett et al rate 69% of the systems as “easy to implement” elsewhere, but better reporting on the financial costs and organisational challenges of implementation is needed for physicians to properly weigh the costs and benefits of using DSSs. For now, the low use of DSSs4 appears reasonable. More research is needed on DSS use in more typical care settings and on which DSS features predict success.



    • Source of funding: no external funding.

    • For correspondence: Dr J W Bennett, University of Queensland, Brisbane, Queensland, Australia. j.bennett{at}

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.