Highly-Efficient and Automatic Spectrum Inspection Based on AutoEncoder and Semi-Supervised Learning for Anomaly Detection in EONs

被引:7
作者
Liu, Siqi [1 ]
Kong, Jiawei [1 ]
Pan, Xiaoqin [1 ,2 ]
Li, Deyun [1 ]
Zhu, Zuqing [1 ]
机构
[1] Univ Sci & Technol China, Sch Informat Sci & Technol, Hefei 230027, Peoples R China
[2] Southwest Univ Sci & Technol, Engn Technol Ctr, Mianyang 621010, Sichuan, Peoples R China
关键词
Anomaly detection; Optical fiber networks; Inspection; Monitoring; Labeling; Optical sensors; Optical transmitters; Software-defined networking (SDN); elastic optical networks (EONs); network automation; anomaly detection; deep learning (DL); autoEncoder (AE); spectrum inspection; KNOWLEDGE-DEFINED ORCHESTRATION; CROSS-LAYER ORCHESTRATION; P-CYCLE PROTECTION; OPTICAL NETWORK; DESIGN; IDENTIFICATION; TRANSMISSION; PREDICTION; ALLOCATION; MODEL;
D O I
10.1109/JLT.2020.3034135
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
To closely monitor the performance of lightpaths in an elastic optical network (EON), people need to rely on real-time and fine-grained spectrum monitoring. This, however, will generate tremendous telemetry data, which can put great pressure on both the control and data planes. In this work, we design and experimentally demonstrate AutoSpecheck, which is a DL-assisted network automation (DLaNA) system that can realize highly-efficient and automatic spectrum inspection for anomaly detection in EONs. Specifically, we architect AutoSpecheck based on the software-defined EON (SD-EON) architecture, and propose techniques to greatly reduce the loads of data reporting (in the data plane) and data analyzing (in the control plane). To reduce the loads of data reporting, we leverage the AutoEncoder (AE) technique to design a spectrum data compression method. To improve the efficiency of data analytics, we first design a coarse filtering module (CFM) to let the control plane filter out most of the normal data before invoking the DL-based anomaly detection. Then, to address the difficulty of labeling massive spectrum data, we develop a DL-based anomaly detection based on semi-supervised learning. Our experimental demonstrations consider two representative intra-channel anomalies (i.e., the filter drifting and in-band jamming), and the results confirm that AutoSpecheck can achieve highly-efficient and automatic spectrum inspection for anomaly detection in EONs.
引用
收藏
页码:1243 / 1254
页数:12
相关论文
共 59 条
[1]  
[Anonymous], CISCO VISUAL NETWORK
[2]  
Barletta L, 2017, 2017 OPTICAL FIBER COMMUNICATIONS CONFERENCE AND EXHIBITION (OFC)
[3]   Demonstrations of Efficient Online Spectrum Defragmentation in Software-Defined Elastic Optical Networks [J].
Chen, Cen ;
Chen, Xiaoliang ;
Zhang, Mingyang ;
Ma, Shoujiang ;
Shao, Yan ;
Li, Suoheng ;
Suleiman, Munir Said ;
Zhu, Zuqing .
JOURNAL OF LIGHTWAVE TECHNOLOGY, 2014, 32 (24) :4701-4711
[4]   Self-Taught Anomaly Detection With Hybrid Unsupervised/Supervised Machine Learning in Optical Networks [J].
Chen, Xiaoliang ;
Li, Baojia ;
Proietti, Roberto ;
Zhu, Zuqing ;
Ben Yoo, S. J. .
JOURNAL OF LIGHTWAVE TECHNOLOGY, 2019, 37 (07) :1742-1749
[5]   Service Availability Oriented p-Cycle Protection Design in Elastic Optical Networks [J].
Chen, Xiaoliang ;
Ji, Fan ;
Zhu, Zuqing .
JOURNAL OF OPTICAL COMMUNICATIONS AND NETWORKING, 2014, 6 (10) :901-910
[6]   Elastic Bandwidth Allocation in Flexible OFDM-Based Optical Networks [J].
Christodoulopoulos, K. ;
Tomkos, I. ;
Varvarigos, E. A. .
JOURNAL OF LIGHTWAVE TECHNOLOGY, 2011, 29 (09) :1354-1366
[7]  
De Leenheer M, 2018, 22ND INTERNATIONAL CONFERENCE ON OPTICAL NETWORK DESIGN AND MODELING (ONDM 2018), P230, DOI 10.23919/ONDM.2018.8396136
[8]   Optical Performance Monitoring: A Review of Current and Future Technologies [J].
Dong, Zhenhua ;
Khan, Faisal Nadeem ;
Sui, Qi ;
Zhong, Kangping ;
Lu, Chao ;
Lau, Alan Pak Tao .
JOURNAL OF LIGHTWAVE TECHNOLOGY, 2016, 34 (02) :525-543
[9]   Predictive Analytics Based Knowledge-Defined Orchestration in a Hybrid Optical/Electrical Datacenter Network Testbed [J].
Fang, Hongqiang ;
Lu, Wei ;
Li, Qinhezi ;
Kong, Jiawei ;
Liang, Lipei ;
Kong, Bingxin ;
Zhu, Zuging .
JOURNAL OF LIGHTWAVE TECHNOLOGY, 2019, 37 (19) :4921-4934
[10]   Machine Learning for Optical Network Security Monitoring: A Practical Perspective [J].
Furdek, Marija ;
Natalino, Carlos ;
Lipp, Fabian ;
Hock, David ;
Di Giglio, Andrea ;
Schiano, Marco .
JOURNAL OF LIGHTWAVE TECHNOLOGY, 2020, 38 (11) :2860-2871