You are here

Article Text

Article menu
Download PDFPDF
Methods
Natural language processing: use in EBM and a guide for appraisal
  1. Mouaz Alsawas1,
  2. Fares Alahdab1,
  3. Noor Asi1,
  4. Ding Cheng Li1,2,
  5. Zhen Wang1,
  6. M Hassan Murad1
  1. 1Evidence-based Practice Center, Mayo Clinic Robert D and Patricia E Kern Center for the Science of Health Care Delivery, Mayo Clinic, Rochester, Minnesota, USA
  2. 2Health Services Research, Mayo Clinic Minnesota, Rochester, Minnesota, USA
  1. Correspondence to Dr M Hassan Murad
    , Evidence-based Practice Center, Mayo Clinic Robert D and Patricia E Kern Center for the Science of Health Care Delivery, Mayo Clinic, Rochester, MN 55905, USA; murad.mohammad{at}mayo.edu

Extract

Studies using natural language processing (NLP) techniques are increasingly being published. Evidence-based medicine (EBM) users need to learn the basics of NLP to be able to appraise these types of studies. We propose a set of criteria to evaluate the quality of studies that have used NLP, focusing on the methods of sample selection, coding, the gold standard, algorithm training, algorithm testing and measures of accuracy (such as recall and precision). NLP has proven critical for conducting biomedical research and has the potential to improve healthcare practice and facilitate EBM. Stakeholders (healthcare providers and policymakers) interested in using evidence derived from studies that used NLP need to know the basics of NLP and need to be able to appraise this type of study.

  • QUALITATIVE RESEARCH
  • GENERAL MEDICINE (see Internal Medicine)
  • EPIDEMIOLOGY

https://doi.org/10.1136/ebmed-2016-110437

Statistics from Altmetric.com

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

    Extract

    Studies using natural language processing (NLP) techniques are increasingly being published. Evidence-based medicine (EBM) users need to learn the basics of NLP to be able to appraise these types of studies. We propose a set of criteria to evaluate the quality of studies that have used NLP, focusing on the methods of sample selection, coding, the gold standard, algorithm training, algorithm testing and measures of accuracy (such as recall and precision). NLP has proven critical for conducting biomedical research and has the potential to improve healthcare practice and facilitate EBM. Stakeholders (healthcare providers and policymakers) interested in using evidence derived from studies that used NLP need to know the basics of NLP and need to be able to appraise this type of study.

    View Full Text

    Footnotes

    • Contributors MHM conceived the idea of the article. MA, FA, NA, DCL, ZW and MHM drafted and finalised the manuscript.

    • Competing interests None declared.

    • Provenance and peer review Not commissioned; internally peer reviewed.