Parameter Estimation of Binned Hawkes Processes

被引:9
作者
Shlomovich, Leigh [1 ]
Cohen, Edward A. K. [1 ]
Adams, Niall [1 ]
Patel, Lekha [1 ,2 ]
机构
[1] Imperial Coll London, Dept Math, London, England
[2] Sandia Natl Labs, Stat Sci, POB 5800, Albuquerque, NM 87185 USA
基金
英国工程与自然科学研究理事会;
关键词
Aggregated data; Binned data; EM algorithm; Hawkes processes; Self-exciting processes; MAXIMUM-LIKELIHOOD; NONPARAMETRIC-ESTIMATION; STATISTICAL-MODELS; TIME;
D O I
10.1080/10618600.2022.2050247
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
A key difficulty that arises from real event data is imprecision in the recording of event time-stamps. In many cases, retaining event times with a high precision is expensive due to the sheer volume of activity. Combined with practical limits on the accuracy of measurements, binned data is common. In order to use point processes to model such event data, tools for handling parameter estimation are essential. Here we consider parameter estimation of the Hawkes process, a type of self-exciting point process that has found application in the modeling of financial stock markets, earthquakes and social media cascades. We develop a novel optimization approach to parameter estimation of binned Hawkes processes using a modified Expectation-Maximization algorithm, referred to as Binned Hawkes Expectation Maximization (BH-EM). Through a detailed simulation study, we demonstrate that existing methods are capable of producing severely biased and highly variable parameter estimates and that our novel BH-EM method significantly outperforms them in all studied circumstances. We further illustrate the performance on network flow (NetFlow) data between devices in a real large-scale computer network, to characterize triggering behavior. These results highlight the importance of correct handling of binned data. Supplementary materials for this article are available online.
引用
收藏
页码:990 / 1000
页数:11
相关论文
共 50 条
  • [41] Transfer Hawkes Processes with Content Information
    Li, Tianbo
    Wei, Pengfei
    Ke, Yiping
    2018 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2018, : 1116 - 1121
  • [42] Parameter estimation of Markov modulated fluid arrival processes
    Almousa, Salah Al-Deen
    Horvath, Gabor
    Telek, Miklos
    PERFORMANCE EVALUATION, 2022, 157
  • [43] Process-level large deviations for nonlinear Hawkes point processes
    Zhu, Lingjiong
    ANNALES DE L INSTITUT HENRI POINCARE-PROBABILITES ET STATISTIQUES, 2014, 50 (03): : 845 - 871
  • [44] Hawkes branching point processes without ancestors
    Brémaud, P
    Massoulié, L
    JOURNAL OF APPLIED PROBABILITY, 2001, 38 (01) : 122 - 135
  • [45] Multivariate Hawkes Processes for Incomplete Biased Data
    Zhou, Zihan
    Sun, Mingxuan
    2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2021, : 968 - 977
  • [46] Limit theorems for Hawkes processes including inhibition
    Cattiaux, Patrick
    Colombani, Laetitia
    Costa, Manon
    STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 2022, 149 : 404 - 426
  • [47] Hawkes Processes Modeling, Inference, and Control: An Overview
    Lima, Rafael
    SIAM REVIEW, 2023, 65 (02) : 331 - 374
  • [48] LIMIT THEOREMS FOR NEARLY UNSTABLE HAWKES PROCESSES
    Jaisson, Thibault
    Rosenbaum, Mathieu
    ANNALS OF APPLIED PROBABILITY, 2015, 25 (02) : 600 - 631
  • [49] Proper Loss Functions for Nonlinear Hawkes Processes
    Menon, Aditya Krishna
    Lee, Young
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 3804 - 3811
  • [50] MODELING MICROSTRUCTURE NOISE USING HAWKES PROCESSES
    Bacry, Emmanuel
    Delattre, Sylvain
    Hoffmann, Marc
    Muzy, Jean-Francois
    2011 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2011, : 5740 - 5743