Sensitivity analysis approaches to high-dimensional screening problems at low sample size

被引:25
作者
Becker, W. E. [1 ]
Tarantola, S. [1 ]
Deman, G. [2 ]
机构
[1] European Commiss, Joint Res Ctr, Via E Fermi 2749, I-21027 Ispra, Italy
[2] Univ Neuchatel, Ctr Hydrogeol & Geotherm CHYN, Neuchatel, Switzerland
关键词
Sensitivity analysis; screening; Sobol' indices; elementary effects; Derivative-based global sensitivity measures; G* function; low-discrepancy sequences; MODELS; VARIABLES; INDEXES; DESIGNS; OUTPUT; LINK;
D O I
10.1080/00949655.2018.1450876
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Sensitivity analysis is an essential tool in the development of robust models for engineering, physical sciences, economics and policy-making, but typically requires running the model a large number of times in order to estimate sensitivity measures. While statistical emulators allow sensitivity analysis even on complex models, they only perform well with a moderately low number of model inputs: in higher dimensional problems they tend to require a restrictively high number of model runs unless the model is relatively linear. Therefore, an open question is how to tackle sensitivity problems in higher dimensionalities, at very low sample sizes. This article examines the relative performance of four sampling-based measures which can be used in such high-dimensional nonlinear problems. The measures tested are the Sobol' total sensitivity indices, the absolute mean of elementary effects, a derivative-based global sensitivity measure, and a modified derivative-based measure. Performance is assessed in a screening' context, by assessing the ability of each measure to identify influential and non-influential inputs on a wide variety of test functions at different dimensionalities. The results show that the best-performing measure in the screening context is dependent on the model or function, but derivative-based measures have a significant potential at low sample sizes that is currently not widely recognised.
引用
收藏
页码:2089 / 2110
页数:22
相关论文
共 34 条
[21]   Probabilistic sensitivity analysis of complex models: a Bayesian approach [J].
Oakley, JE ;
O'Hagan, A .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2004, 66 :751-769
[22]  
Owen A. B., 1998, ACM Transactions on Modeling and Computer Simulation, V8, P71, DOI 10.1145/272991.273010
[23]  
Pareto V., 1906, MANUALE EC POLITICA, V13
[24]   Simplex-based screening designs for estimating metamodels [J].
Pujol, Gilles .
RELIABILITY ENGINEERING & SYSTEM SAFETY, 2009, 94 (07) :1156-1160
[25]   State dependent parameter metamodelling and sensitivity analysis [J].
Ratto, Marco ;
Pagano, Andrea ;
Young, Peter .
COMPUTER PHYSICS COMMUNICATIONS, 2007, 177 (11) :863-876
[26]   Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index [J].
Saltelli, Andrea ;
Annoni, Paola ;
Azzini, Ivano ;
Campolongo, Francesca ;
Ratto, Marco ;
Tarantola, Stefano .
COMPUTER PHYSICS COMMUNICATIONS, 2010, 181 (02) :259-270
[27]   Estimating the approximation error when fixing unessential factors in global sensitivity analysis [J].
Sobol, I. M. ;
Tarantola, S. ;
Gatelli, D. ;
Kucherenko, S. S. ;
Mauntz, W. .
RELIABILITY ENGINEERING & SYSTEM SAFETY, 2007, 92 (07) :957-960
[28]   A new derivative based importance criterion for groups of variables and its link with the global sensitivity indices [J].
Sobol, I. M. ;
Kucherenko, S. .
COMPUTER PHYSICS COMMUNICATIONS, 2010, 181 (07) :1212-1217
[29]   Derivative based global sensitivity measures and their link with global sensitivity indices [J].
Sobol, I. M. ;
Kucherenko, S. .
MATHEMATICS AND COMPUTERS IN SIMULATION, 2009, 79 (10) :3009-3017
[30]   Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates [J].
Sobol, IM .
MATHEMATICS AND COMPUTERS IN SIMULATION, 2001, 55 (1-3) :271-280