Augmenting Pathologists with NaviPath: Design and Evaluation of a Human-AI Collaborative Navigation System

被引：12

作者：

Gu, Hongyan ^{[1
]}

Yang, Chunxu ^{[1
]}

Haeri, Mohammad ^{[2
]}

Wang, Jing ^{[3
]}

Tang, Shirley ^{[1
]}

Yan, Wenzhong ^{[1
]}

He, Shujin ^{[3
]}

Williams, Christopher Kazu ^{[4
]}

Magaki, Shino ^{[4
]}

Chen, Xiang 'Anthony' ^{[1
]}

机构：

[1] Univ Calif Los Angeles, Los Angeles, CA 90095 USA

[2] Univ Kansas, Med Ctr, Kansas City, KS USA

[3] Capital Med Univ, Beijing Tongren Hosp, Beijing, Peoples R China

[4] UCLA, David Geffen Sch Med, Los Angeles, CA USA

来源：

PROCEEDINGS OF THE 2023 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2023 | 2023年

基金：

美国国家科学基金会;

关键词：

Human-AIcollaboration; digitalpathology; navigation; medicalAI; VISUAL-SEARCH; IMAGE; SLIDES;

D O I：

10.1145/3544548.3580694

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

Artificial Intelligence (AI) brings advancements to support pathologists in navigating high-resolution tumor images to search for pathology patterns of interest. However, existing AI-assisted tools have not realized this promised potential due to a lack of insight into pathology and HCI considerations for pathologists' navigation workflows in practice. We first conducted a formative study with six medical professionals in pathology to capture their navigation strategies. By incorporating our observations along with the pathologists' domain knowledge, we designed NAVIPATH - a human-AI collaborative navigation system. An evaluation study with 15 medical professionals in pathology indicated that: (i) compared to the manual navigation, participants saw more than twice the number of pathological patterns in unit time with NaviPath, and (ii) participants achieved higher precision and recall against the AI and the manual navigation on average. Further qualitative analysis revealed that navigation was more consistent with NaviPath, which can improve the overall examination quality.

引用

页数：19

共 85 条

[1] Guidelines for Human-AI Interaction [J].

Amershi, Saleema ;

Weld, Dan ;

Vorvoreanu, Mihaela ;

Fourney, Adam ;

Nushi, Besmira ;

Collisson, Penny ;

Suh, Jina ;

Iqbal, Shamsi ;

Bennett, Paul N. ;

Inkpen, Kori ;

Teevan, Jaime ;

Kikin-Gil, Ruth ;

Horvitz, Eric .

CHI 2019: PROCEEDINGS OF THE 2019 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2019,

[2]

AperioImageScope, AP IMAGESCOPE PATH S

[3] A completely annotated whole slide image dataset of canine breast cancer to aid human breast cancer research [J].

Aubreville, Marc ;

Bertram, Christof A. ;

Donovan, Taryn A. ;

Marzahl, Christian ;

Maier, Andreas ;

Klopfleisch, Robert .

SCIENTIFIC DATA, 2020, 7 (01)

[4]

Aubreville Marc, 2021, ARXIV210316515

[5] QuPath: Open source software for digital pathology image analysis [J].

Bankhead, Peter ;

Loughrey, Maurice B. ;

Fernandez, Jose A. ;

Dombrowski, Yvonne ;

Mcart, Darragh G. ;

Dunne, Philip D. ;

McQuaid, Stephen ;

Gray, Ronan T. ;

Murray, Liam J. ;

Coleman, Helen G. ;

James, Jacqueline A. ;

Salto-Tellez, Manuel ;

Hamilton, Peter W. .

SCIENTIFIC REPORTS, 2017, 7

[6]

Baudisch Patrick, 2003, Conference on Human Factors in Computing Systems-Proceedings, P481

[7] Pad++: A zoomable graphical sketchpad for exploring alternate interface physics [J].

Bederson, BB ;

Hollan, JD ;

Perlin, K ;

Meyer, J ;

Bacon, D ;

Furnas, G .

JOURNAL OF VISUAL LANGUAGES AND COMPUTING, 1996, 7 (01) :3-31

[8] A Human-Centered Evaluation of a Deep Learning System Deployed in Clinics for the Detection of Diabetic Retinopathy [J].

Beede, Emma ;

Baylor, Elizabeth ;

Hersch, Fred ;

Iurchenko, Anna ;

Wilcox, Lauren ;

Ruamviboonsuk, Paisan ;

Vardoulakis, Laura M. .

PROCEEDINGS OF THE 2020 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI'20), 2020,

[9] Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer [J].

Bejnordi, Babak Ehteshami ;

Veta, Mitko ;

van Diest, Paul Johannes ;

van Ginneken, Bram ;

Karssemeijer, Nico ;

Litjens, Geert ;

van der Laak, Jeroen A. W. M. .

JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2017, 318 (22) :2199-2210

[10] A large-scale dataset for mitotic figure assessment on whole slide images of canine cutaneous mast cell tumor [J].

Bertram, Christof A. ;

Aubreville, Marc ;

Marzahl, Christian ;

Maier, Andreas ;

Klopfleisch, Robert .

SCIENTIFIC DATA, 2019, 6 (1)

← 1 2 3 4 5 6 7 8 9 →