Prevalence and Predictability of Low-Yield Inpatient Laboratory Diagnostic Tests

被引:29
作者
Xu, Song [1 ]
Hom, Jason [2 ]
Balasubramanian, Santhosh [1 ]
Schroeder, Lee F. [3 ]
Najafi, Nader [4 ]
Roy, Shivaal [5 ]
Chen, Jonathan H. [1 ,2 ]
机构
[1] Stanford Univ, Dept Med, Ctr Biomed Informat Res, 1265 Welch Rd,Med Sch Off Bldg X213, Stanford, CA 94305 USA
[2] Stanford Univ, Dept Med, Div Hosp Med, Stanford, CA 94305 USA
[3] Univ Michigan, Sch Med, Dept Pathol, Ann Arbor, MI USA
[4] Univ Calif San Francisco, Dept Med, San Francisco, CA 94143 USA
[5] Stanford Univ, Dept Comp Sci, Stanford, CA 94305 USA
基金
美国国家卫生研究院;
关键词
HOSPITAL-ACQUIRED ANEMIA; CARE; INTERVENTION; PREDICTION; REDUCTION; IMPACT;
D O I
10.1001/jamanetworkopen.2019.10967
中图分类号
R5 [内科学];
学科分类号
1002 ; 100201 ;
摘要
IMPORTANCE Laboratory testing is an important target for high-value care initiatives, constituting the highest volume of medical procedures. Prior studies have found that up to half of all inpatient laboratory tests may be medically unnecessary, but a systematic method to identify these unnecessary tests in individual cases is lacking. OBJECTIVE To systematically identify low-yield inpatient laboratory testing through personalized predictions. DESIGN, SETTING, AND PARTICIPANTS In this retrospective diagnostic study with multivariable prediction models, 116 637 inpatients treated at Stanford University Hospital from January 1, 2008, to December 31, 2017, a total of 60 929 inpatients treated at University of Michigan from January 1, 2015, to December 31, 2018, and 13 940 inpatients treated at the University of California, San Francisco from January 1 to December 31, 2018, were assessed. MAIN OUTCOMES AND MEASURES Diagnostic accuracy measures, including sensitivity, specificity, negative predictive values (NPVs), positive predictive values (PPVs), and area under the receiver operating characteristic curve (AUROC), of machine learning models when predicting whether inpatient laboratory tests yield a normal result as defined by local laboratory reference ranges. RESULTS In the recent data sets (July 1, 2014, to June 30, 2017) from Stanford University Hospital (including 22 664 female inpatients with a mean [SD] age of 58.8 [19.0] years and 22 016 male inpatients with a mean [SD] age of 59.0 [18.1] years), among the top 20 highest-volume tests, 792 397 were repeats of orders within 24 hours, including tests that are physiologically unlikely to yield new information that quickly (eg, white blood cell differential, glycated hemoglobin, and serum albumin level). The best-performing machine learning models predicted normal results with an AUROC of 0.90 or greater for 12 stand-alone laboratory tests (eg, sodium AUROC, 0.92 [95% CI, 0.91-0.93]; sensitivity, 98%; specificity, 35%; PPV, 66%; NPV, 93%; lactate dehydrogenase AUROC, 0.93 [95% CI, 0.93-0.94]; sensitivity, 96%; specificity, 65%; PPV, 71%; NPV, 95%; and troponin I AUROC, 0.92 [95% CI, 0.91-0.93]; sensitivity, 88%; specificity, 79%; PPV, 67%; NPV, 93%) and 10 common laboratory test components (eg, hemoglobin AUROC, 0.94 [95% CI, 0.92-0.95]; sensitivity, 99%; specificity, 17%; PPV, 90%; NPV, 81%; creatinine AUROC, 0.96 [95% CI, 0.96-0.97]; sensitivity, 93%; specificity, 83%; PPV, 79%; NPV, 94%; and urea nitrogen AUROC, 0.95 [95% CI, 0.94, 0.96]; sensitivity, 87%; specificity, 89%; PPV, 77%; NPV 94%). CONCLUSIONS AND RELEVANCE The findings suggest that low-yield diagnostic testing is common and can be systematically identified through data-driven methods and patient context-aware predictions. Implementing machine learning models appear to be able to quantify the level of uncertainty and expected information gained from diagnostic tests explicitly, with the potential to encourage useful testing and discourage low-value testing that incurs direct costs and indirect harms.
引用
收藏
页数:13
相关论文
共 47 条
  • [11] Choosing Wisely: Prevalence and Correlates of Low-Value Health Care Services in the United States
    Colla, Carrie H.
    Morden, Nancy E.
    Sequist, Thomas D.
    Schpero, William L.
    Rosenthal, Meredith B.
    [J]. JOURNAL OF GENERAL INTERNAL MEDICINE, 2015, 30 (02) : 221 - 228
  • [12] Collins GS, 2015, ANN INTERN MED, V162, P55, DOI [10.1016/j.jclinepi.2014.11.010, 10.1038/bjc.2014.639, 10.1136/bmj.g7594, 10.1016/j.eururo.2014.11.025, 10.7326/M14-0697, 10.1186/s12916-014-0241-z, 10.1002/bjs.9736, 10.7326/M14-0698]
  • [13] A multifaceted hospitalist quality improvement intervention: Decreased frequency of common labs
    Corson, Adam H.
    Fan, Vincent S.
    White, Travis
    Sullivan, Sean D.
    Asakura, Kenji
    Myint, Michael
    Dale, Christopher R.
    [J]. JOURNAL OF HOSPITAL MEDICINE, 2015, 10 (06) : 390 - 395
  • [14] Factors Associated With Increases in US Health Care Spending, 1996-2013
    Dieleman, Joseph L.
    Squires, Ellen
    Bui, Anthony L.
    Campbell, Madeline
    Chapin, Abigail
    Hamavid, Hannah
    Horst, Cody
    Li, Zhiyin
    Matyasz, Taylor
    Reynolds, Alex
    Sadat, Nafis
    Schneider, Matthew T.
    Murray, Christopher J. L.
    [J]. JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2017, 318 (17): : 1668 - 1678
  • [15] Evidence-Based Guidelines to Eliminate Repetitive Laboratory Testing
    Eaton, Kevin P.
    Levy, Kathryn
    Soong, Christine
    Pahwa, Amit K.
    Petrilli, Christopher
    Ziemba, Justin B.
    Cho, Hyung J.
    Alban, Rodrigo
    Blanck, Jaime F.
    Parsons, Andrew S.
    [J]. JAMA INTERNAL MEDICINE, 2017, 177 (12) : 1833 - 1839
  • [16] Decrease in unnecessary vitamin D testing using clinical decision support tools: making it harder to do the wrong thing
    Felcher, Andrew H.
    Gold, Rachel
    Mosen, David M.
    Stoneburner, Ashley B.
    [J]. JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION, 2017, 24 (04) : 776 - 780
  • [17] Impact of Providing Fee Data on Laboratory Test Ordering A Controlled Clinical Trial
    Feldman, Leonard S.
    Shihab, Hasan M.
    Thiemann, David
    Yeh, Hsin-Chieh
    Ardolino, Margaret
    Mandell, Steven
    Brotman, Daniel J.
    [J]. JAMA INTERNAL MEDICINE, 2013, 173 (10) : 903 - 908
  • [18] Targeted reduction in neurosurgical laboratory utilization: resident-led effort at a single academic institution
    Han, Seunggu J.
    Saigal, Rajiv
    Rolston, John D.
    Cheng, Jason S.
    Lau, Catherine Y.
    Mistry, Rita I.
    McDermott, Michael W.
    Berger, Mitchel S.
    [J]. JOURNAL OF NEUROSURGERY, 2014, 120 (01) : 173 - 177
  • [19] A high value care curriculum for interns: a description of curricular design, implementation and housestaff feedback
    Hom, Jason
    Kumar, Andre
    Evans, Kambria H.
    Svec, David
    Richman, Ilana
    Fang, Daniel
    Smeraglio, Andrea
    Holubar, Marisa
    Johnson, Tyler
    Shah, Neil
    Renault, Cybele
    Ahuja, Neera
    Witteles, Ronald
    Harman, Stephanie
    Shieh, Lisa
    [J]. POSTGRADUATE MEDICAL JOURNAL, 2017, 93 (1106) : 725 - 729