Attention-guided Deep Multi-instance Learning for Staging Retinopathy of Prematurity

被引:8
作者
Chen, Shaobin [1 ]
Zhang, Rugang [1 ]
Chen, Guazhen [1 ]
Zhao, Jinfeng [2 ]
Wang, Tianfu [1 ]
Zhang, Guoming [2 ]
Lei, Baiying [1 ]
机构
[1] Shenzhen Univ, Hlth Sci Ctr, Sch Biomed Engn,Natl Reg Key Technol Engn Lab Med, Guangdong Key Lab Biomed Measurements & Ultrasoun, Shenzhen 518060, Peoples R China
[2] Jinan Univ, Affiliated Hosp 2, Shenzhen Eye Hosp, Shenzhen Key Ophthalm Lab, Shenzhen, Peoples R China
来源
2021 IEEE 18TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI) | 2021年
基金
中国国家自然科学基金;
关键词
Multi-instance learning; Retinopathy of prematurity staging; Fully convolutional network;
D O I
10.1109/ISBI48211.2021.9434012
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Retinopathy of prematurity (ROP) is one of the commonest causes of acquired blindness in children. The stage of ROP is an important step to evaluate the ROP severity for disease control and management. However, there are still various challenges for ROP stage since the pattern of ROP is relatively obscure compared to the entire fundus image. Also, the dataset is small and the image quality is quite poor. To address these issues, we develop a multi-instance learning (MIL) network, which can extract the features of the images and these features can be enhanced by a fully convolutional network (FCN). The spatial score map (SSM) produced by the FCN is cropped into small patches and fed into the proposed MIL for further feature learning. An attention mechanism is leveraged to guide the MIL pooling, which can focus on the ROP features of different stages and improve the staging results. The proposed network is evaluated on an inhouse ROP dataset and experimental results demonstrate that our proposed method is promising for the stage of ROP.
引用
收藏
页码:1025 / 1028
页数:4
相关论文
共 11 条
[1]   Automated Diagnosis of Plus Disease in Retinopathy of Prematurity Using Deep Convolutional Neural Networks [J].
Brown, James M. ;
Campbell, J. Peter ;
Beers, Andrew ;
Chang, Ken ;
Ostmo, Susan ;
Chan, R. V. Paul ;
Dy, Jennifer ;
Erdogmus, Deniz ;
Ioannidis, Stratis ;
Kalpathy-Cramer, Jayashree ;
Chiang, Michael F. .
JAMA OPHTHALMOLOGY, 2018, 136 (07) :803-810
[2]   Solving the multiple instance problem with axis-parallel rectangles [J].
Dietterich, TG ;
Lathrop, RH ;
LozanoPerez, T .
ARTIFICIAL INTELLIGENCE, 1997, 89 (1-2) :31-71
[3]   The international classification of retinopathy of prematurity revisited [J].
Gole, GA ;
Ells, AL ;
Katz, X ;
Holmstrom, G ;
Fielder, AR ;
Capone, A ;
Flynn, JT ;
Good, WG ;
Holmes, JM ;
McNamara, JA ;
Palmer, EA ;
Quinn, GE ;
Shapiro, MJ ;
Trese, MGJ ;
Wallace, DK .
ARCHIVES OF OPHTHALMOLOGY, 2005, 123 (07) :991-999
[4]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[5]   Retinopathy of prematurity [J].
Hellstrom, Ann ;
Smith, Lois E. H. ;
Dammann, Olaf .
LANCET, 2013, 382 (9902) :1445-1457
[6]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[7]  
Liu H, 2019, AS C COMP VIS, V11365, P625
[8]  
Long J, 2015, PROC CVPR IEEE, P3431, DOI 10.1109/CVPR.2015.7298965
[9]  
Simonyan K, 2015, Arxiv, DOI arXiv:1409.1556
[10]  
Szegedy C, 2017, AAAI CONF ARTIF INTE, P4278