Original article
The importance of work-up (verification) bias correction in assessing the accuracy of SPECT thallium-201 testing for the diagnosis of coronary artery disease

https://doi.org/10.1016/0895-4356(96)00014-5Get rights and content

Abstract

Noninvasive testing is often evaluated by the sensitivity and specificity in comparison with a more invasive, but more definitive “gold” standard. However, work-up or verification bias, which occurs when the results of a noninvasive test impact the decision to perform the gold standard invasive test, increases the “observed” sensitivity and decreases the “observed” specificity of the noninvasive test. Most large clinical studies utilizing a noninvasive technique to diagnose coronary artery disease have biases, particularly work-up bias. To obtain more accurate measurements of sensitivity and specificity, we determined the observed sensitivity and specificity of stress (exercise and dipyridamole) single photon emission computed tomographic (SPECT) thallium testing for the detection of coronary artery disease by angiography, and then applied previously published equations to correct for work-up bias. From a computerized data base, reports of 4354 stress SPECT thallium studies from January 1, 1986 through December 31, 1992 were reviewed. All patients with a known history of myocardial infarction or prior coronary angiography were excluded, leaving 2688 patients. From this total, 471 patients underwent coronary angiography within 90 days following stress SPECT thallium testing. Coronary artery disease was defined as a visually assessed stenosis of a coronary artery or a major branch >50%. of the 2688 stress SPECT thallium studies, 1265 were normal and 1423 were abnormal. For the 471 patients who underwent catheterization within 90 days following stress SPECT thallium testing, the “observed” sensitivity and specificity were 98 and 14%, respectively. After correction for work-up bias, the corrected sensitivity and specificity were 82 ± 6% and 59 ± 2%, respectively. Most studies utilizing noninvasive technologies for the detection of coronary artery disease include patients with known coronary artery disease and have work-up bias as well. By knowing the thallium results of patients with and without catheterization, we were able to correct for work-up bias. These data provide a better estimate of the sensitivity and specificity of stress SPECT thallium testing.

References (49)

  • RE Stewart et al.

    Comparison of rubidium-82 positron emission tomography and thallium-201 SPECT imaging for detection of coronary artery disease

    Am J Cardiol

    (1991)
  • HR Schelbert et al.

    Non-invasive assessment of coronary stenosis by myocardial imaging during pharmacologic coronary vasodilatation. VI. Detection of coronary artery disease in man with intravenous N-13 ammonia and positron emission tomography

    Am J Cardiol

    (1982)
  • LJ Crouse et al.

    Exercise echocardiography as a screening test for coronary artery disease and correlation with coronary arteriography

    Am J Cardiol

    (1991)
  • TH Marwick et al.

    Accuracy and limitations of exercise echocardiography in a routine clinical setting

    J Am Coll Cardiol

    (1992)
  • JL Cohen et al.

    Dobutamine digital echocardiography for detecting coronary artery disease

    Am J Cardiol

    (1991)
  • DS Segar et al.

    Dobutamine stress echocardiography: Correlation with coronary lesion severity as determined by quantitative angiography

    J Am Coll Cardiol

    (1992)
  • EG DePuey et al.

    Alterations in myocardial thallium-201 distribution in patients with chronic systemic hypertension undergoing singlephoton emission computed tomography

    Am J Cardiol

    (1988)
  • RJ Burns et al.

    Improved specificity of myocardial thallium-201 single-photon emission tomography in patients with left bundle branch block by dipyridamole

    Am J Cardiol

    (1991)
  • ME Tavel et al.

    Sensitivity and specificity of tests: Can the “silent majority” speak?

    Am J Cardiol

    (1987)
  • YT Van der Schouw et al.

    Problems in selecting the adequate patient population from existing data files for assessment studies of new diagnostic tests

    J Clin Epidemiol

    (1995)
  • WS Weintraub et al.

    Critical analysis of the application of Bayes' theorem to sequential testing in the noninvasive diagnosis of coronary artery disease

    Am J Cardiol

    (1984)
  • ML Marcus et al.

    Visual estimates of percent diameter coronary stenosis: “A battered gold standard”

    J Am Coll Cardiol

    (1988)
  • KL Gould

    Percent coronary stenosis: Battered gold standard, pernicious relic or clinical practicality

    J Am Coll Cardiol

    (1988)
  • DF Ransohoff et al.

    Problems of spectrum and bias in evaluating the efficacy of diagnostic tests

    N Engl J Med

    (1978)
  • Cited by (71)

    View all citing articles on Scopus
    View full text