Highly-Efficient and Automatic Spectrum Inspection Based on AutoEncoder and Semi-Supervised Learning for Anomaly Detection in EONs

被引:7
作者
Liu, Siqi [1 ]
Kong, Jiawei [1 ]
Pan, Xiaoqin [1 ,2 ]
Li, Deyun [1 ]
Zhu, Zuqing [1 ]
机构
[1] Univ Sci & Technol China, Sch Informat Sci & Technol, Hefei 230027, Peoples R China
[2] Southwest Univ Sci & Technol, Engn Technol Ctr, Mianyang 621010, Sichuan, Peoples R China
关键词
Anomaly detection; Optical fiber networks; Inspection; Monitoring; Labeling; Optical sensors; Optical transmitters; Software-defined networking (SDN); elastic optical networks (EONs); network automation; anomaly detection; deep learning (DL); autoEncoder (AE); spectrum inspection; KNOWLEDGE-DEFINED ORCHESTRATION; CROSS-LAYER ORCHESTRATION; P-CYCLE PROTECTION; OPTICAL NETWORK; DESIGN; IDENTIFICATION; TRANSMISSION; PREDICTION; ALLOCATION; MODEL;
D O I
10.1109/JLT.2020.3034135
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
To closely monitor the performance of lightpaths in an elastic optical network (EON), people need to rely on real-time and fine-grained spectrum monitoring. This, however, will generate tremendous telemetry data, which can put great pressure on both the control and data planes. In this work, we design and experimentally demonstrate AutoSpecheck, which is a DL-assisted network automation (DLaNA) system that can realize highly-efficient and automatic spectrum inspection for anomaly detection in EONs. Specifically, we architect AutoSpecheck based on the software-defined EON (SD-EON) architecture, and propose techniques to greatly reduce the loads of data reporting (in the data plane) and data analyzing (in the control plane). To reduce the loads of data reporting, we leverage the AutoEncoder (AE) technique to design a spectrum data compression method. To improve the efficiency of data analytics, we first design a coarse filtering module (CFM) to let the control plane filter out most of the normal data before invoking the DL-based anomaly detection. Then, to address the difficulty of labeling massive spectrum data, we develop a DL-based anomaly detection based on semi-supervised learning. Our experimental demonstrations consider two representative intra-channel anomalies (i.e., the filter drifting and in-band jamming), and the results confirm that AutoSpecheck can achieve highly-efficient and automatic spectrum inspection for anomaly detection in EONs.
引用
收藏
页码:1243 / 1254
页数:12
相关论文
共 59 条
  • [1] [Anonymous], CISCO VISUAL NETWORK
  • [2] Barletta L, 2017, 2017 OPTICAL FIBER COMMUNICATIONS CONFERENCE AND EXHIBITION (OFC)
  • [3] Demonstrations of Efficient Online Spectrum Defragmentation in Software-Defined Elastic Optical Networks
    Chen, Cen
    Chen, Xiaoliang
    Zhang, Mingyang
    Ma, Shoujiang
    Shao, Yan
    Li, Suoheng
    Suleiman, Munir Said
    Zhu, Zuqing
    [J]. JOURNAL OF LIGHTWAVE TECHNOLOGY, 2014, 32 (24) : 4701 - 4711
  • [4] Self-Taught Anomaly Detection With Hybrid Unsupervised/Supervised Machine Learning in Optical Networks
    Chen, Xiaoliang
    Li, Baojia
    Proietti, Roberto
    Zhu, Zuqing
    Ben Yoo, S. J.
    [J]. JOURNAL OF LIGHTWAVE TECHNOLOGY, 2019, 37 (07) : 1742 - 1749
  • [5] Service Availability Oriented p-Cycle Protection Design in Elastic Optical Networks
    Chen, Xiaoliang
    Ji, Fan
    Zhu, Zuqing
    [J]. JOURNAL OF OPTICAL COMMUNICATIONS AND NETWORKING, 2014, 6 (10) : 901 - 910
  • [6] Elastic Bandwidth Allocation in Flexible OFDM-Based Optical Networks
    Christodoulopoulos, K.
    Tomkos, I.
    Varvarigos, E. A.
    [J]. JOURNAL OF LIGHTWAVE TECHNOLOGY, 2011, 29 (09) : 1354 - 1366
  • [7] De Leenheer M, 2018, 22ND INTERNATIONAL CONFERENCE ON OPTICAL NETWORK DESIGN AND MODELING (ONDM 2018), P230, DOI 10.23919/ONDM.2018.8396136
  • [8] Optical Performance Monitoring: A Review of Current and Future Technologies
    Dong, Zhenhua
    Khan, Faisal Nadeem
    Sui, Qi
    Zhong, Kangping
    Lu, Chao
    Lau, Alan Pak Tao
    [J]. JOURNAL OF LIGHTWAVE TECHNOLOGY, 2016, 34 (02) : 525 - 543
  • [9] Predictive Analytics Based Knowledge-Defined Orchestration in a Hybrid Optical/Electrical Datacenter Network Testbed
    Fang, Hongqiang
    Lu, Wei
    Li, Qinhezi
    Kong, Jiawei
    Liang, Lipei
    Kong, Bingxin
    Zhu, Zuging
    [J]. JOURNAL OF LIGHTWAVE TECHNOLOGY, 2019, 37 (19) : 4921 - 4934
  • [10] Machine Learning for Optical Network Security Monitoring: A Practical Perspective
    Furdek, Marija
    Natalino, Carlos
    Lipp, Fabian
    Hock, David
    Di Giglio, Andrea
    Schiano, Marco
    [J]. JOURNAL OF LIGHTWAVE TECHNOLOGY, 2020, 38 (11) : 2860 - 2871