Parameter Estimation of Binned Hawkes Processes

被引:9
作者
Shlomovich, Leigh [1 ]
Cohen, Edward A. K. [1 ]
Adams, Niall [1 ]
Patel, Lekha [1 ,2 ]
机构
[1] Imperial Coll London, Dept Math, London, England
[2] Sandia Natl Labs, Stat Sci, POB 5800, Albuquerque, NM 87185 USA
基金
英国工程与自然科学研究理事会;
关键词
Aggregated data; Binned data; EM algorithm; Hawkes processes; Self-exciting processes; MAXIMUM-LIKELIHOOD; NONPARAMETRIC-ESTIMATION; STATISTICAL-MODELS; TIME;
D O I
10.1080/10618600.2022.2050247
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
A key difficulty that arises from real event data is imprecision in the recording of event time-stamps. In many cases, retaining event times with a high precision is expensive due to the sheer volume of activity. Combined with practical limits on the accuracy of measurements, binned data is common. In order to use point processes to model such event data, tools for handling parameter estimation are essential. Here we consider parameter estimation of the Hawkes process, a type of self-exciting point process that has found application in the modeling of financial stock markets, earthquakes and social media cascades. We develop a novel optimization approach to parameter estimation of binned Hawkes processes using a modified Expectation-Maximization algorithm, referred to as Binned Hawkes Expectation Maximization (BH-EM). Through a detailed simulation study, we demonstrate that existing methods are capable of producing severely biased and highly variable parameter estimates and that our novel BH-EM method significantly outperforms them in all studied circumstances. We further illustrate the performance on network flow (NetFlow) data between devices in a real large-scale computer network, to characterize triggering behavior. These results highlight the importance of correct handling of binned data. Supplementary materials for this article are available online.
引用
收藏
页码:990 / 1000
页数:11
相关论文
共 50 条
  • [21] The Hawkes process with renewal immigration & its estimation with an EM algorithm
    Wheatley, Spencer
    Filimonov, Vladimir
    Sornette, Didier
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2016, 94 : 120 - 135
  • [22] SWITCHED HAWKES PROCESSES
    Nadagouda, Namrata
    Davenport, Mark A.
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 5170 - 5174
  • [23] LARGE DEVIATIONS FOR MARKOVIAN NONLINEAR HAWKES PROCESSES
    Zhu, Lingjiong
    ANNALS OF APPLIED PROBABILITY, 2015, 25 (02) : 548 - 581
  • [24] Conditional Uniformity and Hawkes Processes
    Daw, Andrew
    MATHEMATICS OF OPERATIONS RESEARCH, 2024, 49 (01) : 40 - 57
  • [25] Stability of nonlinear Hawkes processes
    Bremaud, P
    Massoulie, L
    ANNALS OF PROBABILITY, 1996, 24 (03) : 1563 - 1588
  • [26] Precise deviations for Hawkes processes
    Gao, Fuqing
    Zhu, Lingjiong
    BERNOULLI, 2021, 27 (01) : 221 - 248
  • [28] Hawkes processes with hidden marks
    Cai, Yuzhi
    EUROPEAN JOURNAL OF FINANCE, 2022, 28 (07) : 679 - 704
  • [29] General Compound Hawkes Processes in Limit Order Books
    Swishchuk, Anatoliy
    Huffman, Aiden
    RISKS, 2020, 8 (01)
  • [30] A Multiresolution Method for Parameter Estimation of Diffusion Processes
    Kou, S. C.
    Olding, Benjamin P.
    Lysy, Martin
    Liu, Jun S.
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2012, 107 (500) : 1558 - 1574