Maximum pseudo likelihood estimation in network tomography

被引:87
作者
Liang, G [1 ]
Yu, B [1 ]
机构
[1] Univ Calif Berkeley, Dept Stat, Berkeley, CA 94720 USA
基金
美国国家科学基金会;
关键词
end-to-end measurement; multicast tree; network tomography; origin-destination matrix; pseudo likelihood;
D O I
10.1109/TSP.2003.814464
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Network monitoring and diagnosis are key to improving network performance. The difficulties of performance monitoring lie in today's fast growing Internet, accompanied by increasingly heterogeneous and unregulated structures. Moreover, these tasks become even harder since one cannot rely on the collaboration of individual routers and servers to directly measure network traffic. Even though the aggregative nature of possible network measurements gives rise to inverse problems, existing methods for solving inverse problems are usually computationally intractable or statistically inefficient. In this paper, a pseudo likelihood approach is proposed to solve a group of network tomography problems. The basic idea of pseudo likelihood is to form simple subproblems and ignore the dependences among the subproblems to form a product likelihood of the subproblems. As a result, this approach keeps a good balance between the computational complexity and the statistical efficiency of the parameter estimation. Some statistical properties of the pseudo likelihood estimator, such as consistency and asymptotic normality, are established. A pseudo expectation-maximization (EM) algorithm is developed to maximize the pseudo log-likelihood function. Two examples with simulated or real data are used to illustrate the pseudo likelihood proposal: 1) inference of the internal link delay distributions through multicast end-to-end measurements and 2) origin-destination matrix estimation through link traffic counts.
引用
收藏
页码:2043 / 2053
页数:11
相关论文
共 21 条
[1]   STATISTICAL-ANALYSIS OF NON-LATTICE DATA [J].
BESAG, J .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES D-THE STATISTICIAN, 1975, 24 (03) :179-195
[2]  
BESAG J, 1974, J ROY STAT SOC B MET, V36, P192
[3]  
BLACKWELL D, 1973, APPROXIMATE NORMALIT
[4]   Time-varying network tomography: Router link data [J].
Cao, J ;
Davis, D ;
Vander Wiel, S ;
Yu, B .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2000, 95 (452) :1063-1075
[5]  
Cao J., 2000, SCALABLE METHOD ESTI
[6]   Internet tomography [J].
Coates, M ;
Hero, AO ;
Nowak, R ;
Yu, B .
IEEE SIGNAL PROCESSING MAGAZINE, 2002, 19 (03) :47-65
[7]  
COATES M, 2001, NETOWK TOMOGRAPH INT
[8]   PARTIAL LIKELIHOOD [J].
COX, DR .
BIOMETRIKA, 1975, 62 (02) :269-276
[9]   I-DIVERGENCE GEOMETRY OF PROBABILITY DISTRIBUTIONS AND MINIMIZATION PROBLEMS [J].
CSISZAR, I .
ANNALS OF PROBABILITY, 1975, 3 (01) :146-158
[10]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38