On Computationally Tractable Selection of Experiments in Measurement-Constrained Regression Models

被引:0
作者
Wang, Yining [1 ]
Yu, Adams Wei [1 ]
Singh, Aarti [1 ]
机构
[1] Carnegie Mellon Univ, Sch Comp Sci, Machine Learning Dept, Pittsburgh, PA 15213 USA
基金
美国国家科学基金会;
关键词
optimal selection of experiments; A-optimality; computationally tractable methods; minimax analysis; PERFORMANCE; MATRICES; LASSO;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We derive computationally tractable methods to select a small subset of experiment settings from a large pool of given design points. The primary focus is on linear regression models, while the technique extends to generalized linear models and Delta's method (estimating functions of linear regression models) as well. The algorithms are based on a continuous relaxation of an otherwise intractable combinatorial optimization problem, with sampling or greedy procedures as post-processing steps. Formal approximation guarantees are established for both algorithms, and numerical results on both synthetic and real-world data confirm the effectiveness of the proposed methods.
引用
收藏
页数:41
相关论文
共 38 条
[1]   Pipage rounding: A new method of constructing algorithms with proven performance guarantee [J].
Ageev, AA ;
Sviridenko, MI .
JOURNAL OF COMBINATORIAL OPTIMIZATION, 2004, 8 (03) :307-328
[2]  
Anderson D. G., 2014, ARXIV14104273
[3]  
[Anonymous], 1991, TOPICS MATRIX ANAL
[4]  
[Anonymous], 2000, Cambridge Series on Statistical and Probablistic Mathematics
[5]   FASTER SUBSET SELECTION FOR MATRICES AND APPLICATIONS [J].
Avron, Haim ;
Boutsidis, Christos .
SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2013, 34 (04) :1464-1499
[6]   TWICE-RAMANUJAN SPARSIFIERS [J].
Batson, Joshua ;
Spielman, Daniel A. ;
Srivastava, Nikhil .
SIAM JOURNAL ON COMPUTING, 2012, 41 (06) :1704-1721
[7]   SIMULTANEOUS ANALYSIS OF LASSO AND DANTZIG SELECTOR [J].
Bickel, Peter J. ;
Ritov, Ya'acov ;
Tsybakov, Alexandre B. .
ANNALS OF STATISTICS, 2009, 37 (04) :1705-1732
[8]  
Chaudhuri Kamalika, 2015, P ADV NEUR INF PROC
[9]  
Chen S., 2015, CoRR, Vabs/1503.05432
[10]   LOCALLY OPTIMAL DESIGNS FOR ESTIMATING PARAMETERS [J].
CHERNOFF, H .
ANNALS OF MATHEMATICAL STATISTICS, 1953, 24 (04) :586-602