Self-supervised anomaly detection for new physics

被引:23
作者
Dillon, Barry M. [1 ]
Mastandrea, Radha [2 ,3 ]
Nachman, Benjamin [3 ,4 ]
机构
[1] Heidelberg Univ, Inst Theoret Phys, Philosophenweg 16, D-69120 Heidelberg, Germany
[2] Univ Calif Berkeley, Dept Phys, Berkeley, CA 94720 USA
[3] Lawrence Berkeley Natl Lab, Phys Div, Berkeley, CA 94720 USA
[4] Univ Calif Berkeley, Berkeley Inst Data Sci, Berkeley, CA 94720 USA
基金
美国国家科学基金会;
关键词
D O I
10.1103/PhysRevD.106.056005
中图分类号
P1 [天文学];
学科分类号
0704 ;
摘要
We investigate a method of model-agnostic anomaly detection through studying jets, collimated sprays of particles produced in high-energy collisions. We train a transformer neural network to encode simulated QCD "event space" dijets into a low-dimensional "latent space" representation. We optimize the network using the self-supervised contrastive loss, which encourages the preservation of known physical symmetries of the dijets. We then train a binary classifier to discriminate a beyond the standard model resonant dijet signal from a QCD dijet background both in the event space and the latent space representations. We find the classifier performances on the event and latent spaces to be comparable. We finally perform an anomaly detection search using a weakly supervised bump hunt on the latent space dijets, finding again a comparable performance to a search run on the physical space dijets. This opens the door to using low-dimensional latent representations as a computationally efficient space for resonant anomaly detection in generic particle collision events.
引用
收藏
页数:12
相关论文
共 50 条
[21]   Natural Synthetic Anomalies for Self-supervised Anomaly Detection and Localization [J].
Schluter, Hannah M. ;
Tan, Jeremy ;
Hou, Benjamin ;
Kainz, Bernhard .
COMPUTER VISION, ECCV 2022, PT XXXI, 2022, 13691 :474-489
[22]   CADet: Fully Self-Supervised Anomaly Detection With Contrastive Learning [J].
Guille-Escuret, Charles ;
Rodriguez, Pau ;
Vazquez, David ;
Mitliagkas, Ioannis ;
Monteiro, Joao .
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
[23]   Self-supervised Complex Network for Machine Sound Anomaly Detection [J].
Kim, Miseul ;
Minh Tri Ho ;
Kang, Hong-Goo .
29TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2021), 2021, :586-590
[24]   Self-Supervised Masked Convolutional Transformer Block for Anomaly Detection [J].
Madan, Neelu ;
Ristea, Nicolae-Catalin ;
Ionescu, Radu Tudor ;
Nasrollahi, Kamal ;
Khan, Fahad Shahbaz ;
Moeslund, Thomas B. ;
Shah, Mubarak .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (01) :525-542
[25]   IMAGE QUALITY ASSESSMENT DRIVEN SELF-SUPERVISED ANOMALY DETECTION [J].
Wang, Zhipeng ;
Hou, Chunping ;
Liu, Yang ;
Ge, Bangbang ;
Yue, Guanghui ;
Song, Chunying .
2021 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2021,
[26]   Self-Supervised Image Anomaly Detection and Localization with Synthetic Anomalies [J].
Tsai, Min-Chun ;
Wang, Sheng-De .
2023 10TH INTERNATIONAL CONFERENCE ON INTERNET OF THINGS: SYSTEMS, MANAGEMENT AND SECURITY, IOTSMS, 2023, :90-95
[27]   Self-Supervised Random Forest on Transformed Distribution for Anomaly Detection [J].
Liu, Jiabin ;
Wang, Huadong ;
Hang, Hanyuan ;
Ma, Shumin ;
Shen, Xin ;
Shi, Yong .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025, 36 (02) :2675-2689
[28]   SeMAnD: Self-Supervised Anomaly Detection in Multimodal Geospatial Datasets [J].
Reshetova, Daria ;
Ganguli, Swetava ;
Iyer, C. V. K. ;
Pandey, V. .
31ST ACM SIGSPATIAL INTERNATIONAL CONFERENCE ON ADVANCES IN GEOGRAPHIC INFORMATION SYSTEMS, ACM SIGSPATIAL GIS 2023, 2023, :340-343
[29]   Self-Supervised Predictive Convolutional Attentive Block for Anomaly Detection [J].
Ristea, Nicolae-Catalin ;
Madan, Neelu ;
Ionescu, Radu Tudor ;
Nasrollahi, Kamal ;
Khan, Fahad Shahbaz ;
Moeslund, Thomas B. ;
Shah, Mubarak .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, :13566-13576
[30]   Pavement anomaly detection based on transformer and self-supervised learning [J].
Lin, Zijie ;
Wang, Hui ;
Li, Shenglin .
AUTOMATION IN CONSTRUCTION, 2022, 143