Deep Learning: A Comprehensive Overview on Techniques, Taxonomy, Applications and Research Directions

被引：949
作者：
Sarker I.H. [1 ,2 ]
机构：
[1] Swinburne University of Technology, Melbourne, 3122, VIC
[2] Chittagong University of Engineering & Technology, Chittagong
来源：
SN Computer Science | 2021年 / 2卷 / 6期
关键词：
Artificial intelligence; Artificial neural network; Deep learning; Discriminative learning; Generative learning; Hybrid learning; Intelligent systems;
D O I：
10.1007/s42979-021-00815-1
中图分类号：
学科分类号：
摘要：
Deep learning (DL), a branch of machine learning (ML) and artificial intelligence (AI) is nowadays considered as a core technology of today’s Fourth Industrial Revolution (4IR or Industry 4.0). Due to its learning capabilities from data, DL technology originated from artificial neural network (ANN), has become a hot topic in the context of computing, and is widely applied in various application areas like healthcare, visual recognition, text analytics, cybersecurity, and many more. However, building an appropriate DL model is a challenging task, due to the dynamic nature and variations in real-world problems and data. Moreover, the lack of core understanding turns DL methods into black-box machines that hamper development at the standard level. This article presents a structured and comprehensive view on DL techniques including a taxonomy considering various types of real-world tasks like supervised or unsupervised. In our taxonomy, we take into account deep networks for supervised or discriminative learning, unsupervised or generative learning as well as hybrid learning and relevant others. We also summarize real-world application areas where deep learning techniques can be used. Finally, we point out ten potential aspects for future generation DL modeling with research directions. Overall, this article aims to draw a big picture on DL modeling that can be used as a reference guide for both academia and industry professionals. © 2021, The Author(s), under exclusive licence to Springer Nature Singapore Pte Ltd.
引用
收藏
相关论文
共 135 条
  • [1] Abadi M., Barham P., Chen J., Chen Z., Davis A., Deandevin Ma J., Ghemawat S, Irving G, Isard M, et al. Tensorflow: A system for large-scale machine learning, 12Th {USENIX} Symposium on Operating Systems Design and Implementation ({OSDI} 16), pp. 265-283, (2016)
  • [2] Abdel-Basset M., Hawash H., Chakrabortty R.K., Ryan M., Energy-net: a deep learning approach for smart energy management in iot-based smart cities, IEEE Internet of Things J, (2021)
  • [3] Aggarwal A., Mittal M., Battineni G., Generative adversarial network: An overview of theory and applications, Int J Inf Manag Data Insights, (2021)
  • [4] Al-Qatf M., Lasheng Y., Al-Habib M., Al-Sabahi K., Deep learning approach combining sparse autoencoder with svm for network intrusion detection, IEEE Access, 6, pp. 52843-52856, (2018)
  • [5] Ale L., Sheta A., Li L., Wang Y., Zhang N., Deep learning based plant disease detection for smart agriculture, In: 2019 IEEE Globecom Workshops (GC Wkshps, pp. 1-6, (2019)
  • [6] Amarbayasgalan T., Lee J.Y., Kim K.R., Ryu K.H., Deep autoencoder based neural networks for coronary heart disease risk prediction, Heterogeneous Data Management, Polystores, and Analytics for Healthcare, pp. 237-248, (2019)
  • [7] Anuradha J., Et al., Big data based stock trend prediction using deep cnn with reinforcement-lstm model, Int J Syst Assur Eng Manag, pp. 1-11, (2021)
  • [8] Aqib M., Mehmood R., Albeshri A., Alzahrani A., Disaster management in smart cities by forecasting traffic plan using deep learning and gpus, International Conference on Smart Cities, Infrastructure, Technologies and Applications, pp. 139-154, (2017)
  • [9] Arulkumaran K., Deisenroth M.P., Brundage M., Bharath A.A., Deep reinforcement learning: a brief survey, IEEE Signal Process Mag, 34, 6, pp. 26-38, (2017)
  • [10] Aslan M.F., Unlersen M.F., Sabanci K., Durdu A., Cnn-based transfer learning-bilstm network: a novel approach for covid-19 infection detection, Appl Soft Comput, 98, (2021)
12345678910