Stable Synthetic Control with Anomaly Detection for Causal Inference

被引:0
|
作者
Li, Qiang [1 ]
Sun, Yiqiao [2 ]
Pang, Linsey [3 ]
Sun, Liang [4 ]
Wen, Qingsong [4 ]
机构
[1] Wilfrid Laurier Univ, Waterloo, ON, Canada
[2] Bytedance, Cambridge, England
[3] Salesforce, San Francisco, CA USA
[4] Alibaba Grp, Hangzhou, Peoples R China
来源
PROCEEDINGS OF THE 2024 SIAM INTERNATIONAL CONFERENCE ON DATA MINING, SDM | 2024年
关键词
Stable Synthetic Control; Anomaly Detection; Causal Inference; Observational Study;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The study of treatment effects is an essential area in causal inference that has received extensive attention in the sciences. When access to counterfactual groups and experimental settings is limited, the synthetic control method (SCM) emerges as a key approach for observational studies. However, conventional SCM techniques mainly concentrate on addressing confounding issues in the pre-treatment period, often overlooking the confounding effects of control groups in the post-treatment period. In this paper, we propose a new approach named Stable-SC, which integrates synthetic control with anomaly detection algorithms to mitigate the influence of confounding factors in both the pre- and post-treatment periods. Our algorithm incorporates an anomaly-detection process that identifies trends and distance anomalies within control groups, significantly impacting SCM estimation results. Subsequently, we employ a re-weighting schema to adjust the significance of these abnormal groups and utilize the Difference-in-Differences estimator to assess causal effects. Through extensive experimentation with multiple simulated and real-world datasets, we demonstrate that our Stable-SC approach yields more robust estimates compared to other existing methods in the literature. Furthermore, we have successfully applied our proposed framework in diverse business scenarios within a prominent retail company, where the need for stable and robust A/B testing is paramount in quantifying causal effects.
引用
收藏
页码:770 / 778
页数:9
相关论文
共 50 条
  • [1] A causal inference method for canal safety anomaly detection based on structural causal model and GBDT
    Li, Hairui
    Liu, Xuemei
    Huai, Xianfeng
    Chen, Xiaolu
    LHB-HYDROSCIENCE JOURNAL, 2023, 109 (01)
  • [2] Anomaly Detection in Network Traffic Based on Statistical Inference and α-Stable Modeling
    Simmross-Wattenberg, Federico
    Ignacio Asensio-Perez, Juan
    Casaseca-de-la-Higuera, Pablo
    Martin-Fernandez, Marcos
    Dimitriadis, Ioannis A.
    Alberola-Lopez, Carlos
    IEEE TRANSACTIONS ON DEPENDABLE AND SECURE COMPUTING, 2011, 8 (04) : 494 - 509
  • [3] Stable Knowledge Tracing Using Causal Inference
    Zhu, Jia
    Ma, Xiaodong
    Huang, Changqin
    IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, 2024, 17 : 124 - 134
  • [4] Detection of unfaithfulness and robust causal inference
    Zhang, Jiji
    Spirtes, Peter
    MINDS AND MACHINES, 2008, 18 (02) : 239 - 271
  • [5] Detection of Unfaithfulness and Robust Causal Inference
    Jiji Zhang
    Peter Spirtes
    Minds and Machines, 2008, 18 : 239 - 271
  • [6] On Root Cause Localization and Anomaly Mitigation through Causal Inference
    Han, Xiao
    Zhang, Lu
    Wu, Yongkai
    Yuan, Shuhan
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 699 - 708
  • [7] Adaptive causal anomaly detection for hyperspectral imagery
    Hsueh, M
    Chang, CI
    IGARSS 2004: IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM PROCEEDINGS, VOLS 1-7: SCIENCE FOR SOCIETY: EXPLORING AND MANAGING A CHANGING PLANET, 2004, : 3222 - 3224
  • [8] Counterfactual Root Cause Analysis via Anomaly Detection and Causal Graphs
    Rehak, Josephine
    Sommer, Anouk
    Becker, Maximilian
    Pfrommer, Julius
    Beyerer, Juergen
    2023 IEEE 21ST INTERNATIONAL CONFERENCE ON INDUSTRIAL INFORMATICS, INDIN, 2023,
  • [9] Model-Agnostic Causal Principle for Unbiased KPI Anomaly Detection
    Ji, Jiemin
    Guan, Donghai
    Deng, Yuwen
    Yuan, Weiwei
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [10] Fuzzy Logic Inference for Unsupervised Anomaly Detection
    Gladkykh, Tetiana
    Hnot, Taras
    Solskyy, Volodymyr
    PROCEEDINGS OF THE 2016 IEEE FIRST INTERNATIONAL CONFERENCE ON DATA STREAM MINING & PROCESSING (DSMP), 2016, : 42 - 47