A comprehensive survey on design and application of autoencoder in deep learning

被引:223
作者
Li, Pengzhi [1 ]
Pei, Yan [2 ]
Li, Jianqiang [3 ]
机构
[1] Univ Aizu, Grad Sch Comp Sci & Engn, Aizu Wakamatsu, Fukushima 9658580, Japan
[2] Univ Aizu, Comp Sci Div, Aizu Wakamatsu, Fukushima 9658580, Japan
[3] Beijing Univ Technol, Sch Software Engn, Beijing 100124, Peoples R China
关键词
Deep learning; Autoencoder; Unsupervised learning; Feature extraction; Autoencoder application; REPRESENTATIONS; NETWORK; DOMAIN;
D O I
10.1016/j.asoc.2023.110176
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Autoencoder is an unsupervised learning model, which can automatically learn data features from a large number of samples and can act as a dimensionality reduction method. With the development of deep learning technology, autoencoder has attracted the attention of many scholars. Researchers have proposed several improved versions of autoencoder based on different application fields. First, this paper explains the principle of a conventional autoencoder and investigates the primary development process of an autoencoder. Second, We proposed a taxonomy of autoencoders according to their structures and principles. The related autoencoder models are comprehensively analyzed and discussed. This paper introduces the application progress of autoencoders in different fields, such as image classification and natural language processing, etc. Finally, the shortcomings of the current autoencoder algorithm are summarized, and prospected for its future development directions are addressed. (c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:21
相关论文
共 100 条
[1]   A Deep Autoencoder With Novel Adaptive Resolution Reconstruction Loss for Disentanglement of Concepts in Face Images [J].
Abdolahnejad, Mahla ;
Liu, Peter Xiaoping .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
[2]  
[Anonymous], The CIFAR-10 dataset
[3]   CVAE-GAN: Fine-Grained Image Generation through Asymmetric Training [J].
Bao, Jianmin ;
Chen, Dong ;
Wen, Fang ;
Li, Houqiang ;
Hua, Gang .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :2764-2773
[4]   Intelligent Machine Learning with Metaheuristics Based Sentiment Analysis and Classification [J].
Bhaskaran, R. ;
Saravanan, S. ;
Kavitha, M. ;
Jeyalakshmi, C. ;
Kadry, Seifedine ;
Rauf, Hafiz Tayyab ;
Alkhammash, Reem .
COMPUTER SYSTEMS SCIENCE AND ENGINEERING, 2023, 44 (01) :235-247
[5]   AUTO-ASSOCIATION BY MULTILAYER PERCEPTRONS AND SINGULAR VALUE DECOMPOSITION [J].
BOURLARD, H ;
KAMP, Y .
BIOLOGICAL CYBERNETICS, 1988, 59 (4-5) :291-294
[6]   Automatic Traffic State Recognition Based on Video Features Extracted by an Autoencoder [J].
Cai, Xiaoyu ;
Jing, Qiongli ;
Peng, Bo ;
Zhang, Yuanyuan ;
Wang, Yuting ;
Tang, Ju .
MATHEMATICAL PROBLEMS IN ENGINEERING, 2022, 2022
[7]  
Chandru AS, 2022, INT J ADV COMPUT SC, V13, P400
[8]   Disentangle, Align and Fuse for Multimodal and Semi-Supervised Image Segmentation [J].
Chartsias, Agisilaos ;
Papanastasiou, Giorgos ;
Wang, Chengjia ;
Semple, Scott ;
Newby, David E. ;
Dharmakumar, Rohan ;
Tsaftaris, Sotirios A. .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (03) :781-792
[9]  
Chen J., 2020, 37 INT C MACHINE LEA, P1638, DOI [10.48550/arXiv.2002.09741, DOI 10.48550/ARXIV.2002.09741]
[10]  
Chen MM, 2014, PR MACH LEARN RES, V32, P1476