Learning image features with fewer labels using a semi-supervised deep convolutional network

被引:12
作者
dos Santos, Fernando P. [1 ]
Zor, Cemre [2 ]
Kittler, Josef [3 ]
Ponti, Moacir A. [1 ]
机构
[1] Univ Sao Paulo, Inst Math & Comp Sci ICMC, BR-13566590 Sao Carlos, SP, Brazil
[2] UCL, Ctr Med Image Comp CMIC, London WC1E 7JE, England
[3] Univ Surrey, Ctr Vis Speech & Signal Proc CVSSP, Guildford GU2 7XH, Surrey, England
基金
英国工程与自然科学研究理事会; 巴西圣保罗研究基金会;
关键词
Semi-supervised learning; Transfer learning; Feature generalisation;
D O I
10.1016/j.neunet.2020.08.016
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Learning feature embeddings for pattern recognition is a relevant task for many applications. Deep learning methods such as convolutional neural networks can be employed for this assignment with different training strategies: leveraging pre-trained models as baselines; training from scratch with the target dataset; or fine-tuning from the pre-trained model. Although there are separate systems used for learning features from labelled and unlabelled data, there are few models combining all available information. Therefore, in this paper, we present a novel semi-supervised deep network training strategy that comprises a convolutional network and an autoencoder using a joint classification and reconstruction loss function. We show our network improves the learned feature embedding when including the unlabelled data in the training process. The results using the feature embedding obtained by our network achieve better classification accuracy when compared with competing methods, as well as offering good generalisation in the context of transfer learning. Furthermore, the proposed network ensemble and loss function is highly extensible and applicable in many recognition tasks. (c) 2020 Elsevier Ltd. All rights reserved.
引用
收藏
页码:131 / 143
页数:13
相关论文
共 50 条
[1]  
[Anonymous], 2018, ARXIV180407612
[2]  
[Anonymous], 2009, HDB SYSTEMIC AUTOIMM
[3]  
[Anonymous], 2011, NEURAL INFORM PROCES
[4]  
[Anonymous], 2010, P 27 INT C MACH LEAR, DOI 10.5555/3104322.3104425
[5]  
[Anonymous], 2017, P IEEE C COMP VIS PA
[6]  
[Anonymous], 2018, ARXIV180510795
[7]  
Aytar Y, 2011, IEEE I CONF COMP VIS, P2252, DOI 10.1109/ICCV.2011.6126504
[8]   Representation Learning: A Review and New Perspectives [J].
Bengio, Yoshua ;
Courville, Aaron ;
Vincent, Pascal .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (08) :1798-1828
[9]   Unsupervised representation learning using convolutional and stacked auto-encoders: a domain and cross-domain feature space analysis [J].
Cavallari, Gabriel B. ;
Ribeiro, Leonardo S. F. ;
Ponti, Moacir A. .
PROCEEDINGS 2018 31ST SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), 2018, :440-446
[10]   Re-weighted Adversarial Adaptation Network for Unsupervised Domain Adaptation [J].
Chen, Qingchao ;
Liu, Yang ;
Wang, Zhaowen ;
Wassell, Ian ;
Chetty, Kevin .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :7976-7985