Machine learning: Overview of the recent progresses and implications for the process systems engineering field

被引:269
作者
Lee, Jay H. [1 ]
Shin, Joohyun [1 ]
Realff, Matthew J. [2 ]
机构
[1] Korea Advaced Inst Sci & Technol, Chem & Biomol Engn Dept, Daejeon, South Korea
[2] Georgia Inst Technol, Chem & Biomol Engn Dept, Atlanta, GA 30332 USA
基金
新加坡国家研究基金会;
关键词
Machine learning; Deep learning; Reinforcement learning; Process systems engineering; Stochastic decision problems; PRINCIPAL COMPONENT ANALYSIS; PROGRAMMING BASED APPROACH; NEURAL-NETWORKS; ALGORITHM; ARCHITECTURES; SELECTION; MODELS; NET;
D O I
10.1016/j.compchemeng.2017.10.008
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Machine learning (ML) has recently gained in popularity, spurred by well-publicized advances like deep learning and widespread commercial interest in big data analytics. Despite the enthusiasm, some renowned experts of the field have expressed skepticism, which is justifiable given the disappointment with the previous wave of neural networks and other AI techniques. On the other hand, new fundamental advances like the ability to train neural networks with a large number of layers for hierarchical feature learning may present significant new technological and commercial opportunities. This paper critically examines the main advances in deep learning. In addition, connections with another ML branch of reinforcement learning are elucidated and its role in control and decision problems is discussed. Implications of these advances for the fields of process and energy systems engineering are also discussed. (C) 2017 Elsevier Ltd. All rights reserved.
引用
收藏
页码:111 / 121
页数:11
相关论文
共 89 条
[1]  
[Anonymous], 2002, Optimal Learning: Computational procedures for Bayes-adaptive Markov decision processes
[2]  
[Anonymous], 2014, arXiv
[3]  
[Anonymous], IEEE SPECTR
[4]  
[Anonymous], 1998, REINFORCEMENT LEARNI
[5]   WAVE-NET - A MULTIRESOLUTION, HIERARCHICAL NEURAL NETWORK WITH LOCALIZED LEARNING [J].
BAKSHI, BR ;
STEPHANOPOULOS, G .
AICHE JOURNAL, 1993, 39 (01) :57-81
[6]   NEURAL NETWORKS AND PRINCIPAL COMPONENT ANALYSIS - LEARNING FROM EXAMPLES WITHOUT LOCAL MINIMA [J].
BALDI, P ;
HORNIK, K .
NEURAL NETWORKS, 1989, 2 (01) :53-58
[7]  
Baum E. B., 1987, PAPER PRESENTED NIPS
[8]   LEARNING LONG-TERM DEPENDENCIES WITH GRADIENT DESCENT IS DIFFICULT [J].
BENGIO, Y ;
SIMARD, P ;
FRASCONI, P .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (02) :157-166
[9]  
Bengio Y., 2006, ADV NEURAL INFORM PR, V19
[10]  
BENGIO Y, 2006, ADV NEURAL INFORM PR, V18, P107