Multi-View Attention-Guided Multiple Instance Detection Network for Interpretable Breast Cancer Histopathological Image Diagnosis

被引:24
作者
Li, Guangli [1 ]
Li, Chuanxiu [1 ]
Wu, Guangting [1 ]
Ji, Donghong [2 ]
Zhang, Hongbin [3 ]
机构
[1] East China Jiaotong Univ, Sch Informat Engn, Nanchang 330013, Jiangxi, Peoples R China
[2] Wuhan Univ, Cyber Sci & Engn Sch, Wuhan 430071, Peoples R China
[3] East China Jiaotong Univ, Sch Software, Nanchang 330013, Jiangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Breast cancer; Cancer; Image classification; Solid modeling; Supervised learning; Location awareness; Deep learning; Breast cancer diagnosis; multiple instance learning; multi-view attention; diagnosis interpretability; deep mutual learning; CLASSIFICATION;
D O I
10.1109/ACCESS.2021.3084360
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep learning approaches have demonstrated significant progress in breast cancer histopathological image diagnosis. Training an interpretable diagnosis model using high-resolution histopathological image is still challenging. To alleviate this problem, a novel multi-view attention-guided multiple instance detection network (MA-MIDN) is proposed. The traditional image classification problem is framed as a weakly supervised multiple instance learning (MIL) problem. We first divide each histopathology image into instances and form a corresponding bag to fully utilize high-resolution information through MIL. Then a new multiple-view attention (MVA) algorithm is proposed to learn attention on the instances from the image to localize the lesion regions in this image. A MVA-guided MIL pooling strategy is designed for aggregating instance-level features to obtain bag-level features for the final classification. The proposed MA-MIDN model performs lesion localization and image classification, simultaneously. Particularly, we train the MA-MIDN model under the deep mutual learning (DML) schema. This transfers DML to a weakly supervised learning problem. Three public breast cancer histopathological image datasets are chosen to evaluate classification and localization results. The experimental results demonstrate that the MA-MIDN model is superior to the latest baselines in terms of diagnosis accuracy, AUC, Precision, Recall, and F1. Notably, it achieves better localization results without compromising classification performance, thereby proving its higher practicality. The code for the MA-MIDN model is available at https://github.com/lcxlcx/MA-MIDN.
引用
收藏
页码:79671 / 79684
页数:14
相关论文
共 45 条
  • [1] Ahmad H.M., 2019, P 16 INT BHURBAN C A, P812
  • [2] [Anonymous], 2017, ARXIV171206657
  • [3] BACH: Grand challenge on breast cancer histology images
    Aresta, Guilherme
    Araujo, Teresa
    Kwok, Scotty
    Chennamsetty, Sai Saketh
    Safwan, Mohammed
    Alex, Varghese
    Marami, Bahram
    Prastawa, Marcel
    Chan, Monica
    Donovan, Michael
    Fernandez, Gerardo
    Zeineh, Jack
    Kohl, Matthias
    Walz, Christoph
    Ludwig, Florian
    Braunewell, Stefan
    Baust, Maximilian
    Quoc Dang Vu
    Minh Nguyen Nhat To
    Kim, Eal
    Kwak, Jin Tae
    Galal, Sameh
    Sanchez-Freire, Veronica
    Brancati, Nadia
    Frucci, Maria
    Riccio, Daniel
    Wang, Yaqi
    Sun, Lingling
    Ma, Kaiqiang
    Fang, Jiannan
    Kone, Ismael
    Boulmane, Lahsen
    Campilho, Aurelio
    Eloy, Catarina
    Polonia, Antonio
    Aguiar, Paulo
    [J]. MEDICAL IMAGE ANALYSIS, 2019, 56 : 122 - 139
  • [4] Context-Aware Learning Using Transferable Features for Classification of Breast Cancer Histology Images
    Awan, Ruqayya
    Koohbanani, Navid Alemi
    Shaban, Muhammad
    Lisowska, Anna
    Rajpoot, Nasir
    [J]. IMAGE ANALYSIS AND RECOGNITION (ICIAR 2018), 2018, 10882 : 788 - 795
  • [5] Belsare A.D., 2016, P TENCON 2015 2015 I, P1, DOI [DOI 10.1109/TENCON.2015.7372809, 10.1109/tencon.2015.7372809]
  • [6] Computer-aided diagnosis system combining FCN and Bi-LSTM model for efficient breast cancer detection from histopathological images
    Budak, Umit
    Comert, Zafer
    Rashid, Zryan Najat
    Sengur, Abdulkadir
    Cibuk, Musa
    [J]. APPLIED SOFT COMPUTING, 2019, 85
  • [7] Clinical-grade computational pathology using weakly supervised deep learning on whole slide images
    Campanella, Gabriele
    Hanna, Matthew G.
    Geneslaw, Luke
    Miraflor, Allen
    Silva, Vitor Werneck Krauss
    Busam, Klaus J.
    Brogi, Edi
    Reuter, Victor E.
    Klimstra, David S.
    Fuchs, Thomas J.
    [J]. NATURE MEDICINE, 2019, 25 (08) : 1301 - +
  • [8] Automatic detection of invasive ductal carcinoma in whole slide images with Convolutional Neural Networks
    Cruz-Roa, Angel
    Basavanhally, Ajay
    Gonzalez, Fabio
    Gilmore, Hannah
    Feldman, Michael
    Ganesan, Shridar
    Shih, Natalie
    Tomaszewski, John
    Madabhushi, Anant
    [J]. MEDICAL IMAGING 2014: DIGITAL PATHOLOGY, 2014, 9041
  • [9] Das K, 2018, I S BIOMED IMAGING, P578, DOI 10.1109/ISBI.2018.8363642
  • [10] Automated grading of breast cancer histopathology using spectral clustering with textural and architectural image features
    Doyle, Scott
    Agner, Shannon
    Madabhushi, Anant
    Feldman, Michael
    Tomaszewski, John
    [J]. 2008 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING: FROM NANO TO MACRO, VOLS 1-4, 2008, : 496 - +