Intelligent methods for natural data analysis: application to space weather

被引:1
|
作者
Mandrikova, O., V [1 ]
机构
[1] Russian Acad Sci, Far Eastern Branch, Inst Cosmophys Res & Radio Wave Propagat, Mirnaya St 7, Kamchatskiy Kray 684034, Paratunka, Russia
关键词
data analysis methods; anomaly detection; space weather; wavelet transform; neural networks; LONG-TERM DEPENDENCIES; PLANE;
D O I
10.18287/2412-6179-CO-1367
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
The paper describes methods for detecting anomalies in geophysical monitoring data. This work studies a highly relevant class of problems in this area, aimed at creating methods for space weather forecasting. The negative impact of space weather anomalies on human health and practically all modern infrastructure objects requires the development of methods and the creation of effective means of detecting anomalies. Threshold wavelet filtering methods widely used for data analysis and anomaly detection allow one to obtain fairly accurate estimates using a "greed" strategy, even in the case of incomplete noise data. With this approach, the signal is estimated by isolating coherent structures. But these methods have high computational complexity, failing to provide accurate estimates when the signal-to-noise ratio is low. For such signals, we propose using adaptive probabilistic thresholds. Threshold function parameters are introduced that make it possible to estimate the variability of the process, suppress noise, and detect nonstationary features of different time-frequency structures. The paper also considers ways to combine threshold wavelet filtering with neural networks of the NARX and Autoencoder architectures. Schemes for the implementation of such approaches in the problems of detecting space weather anomalies are proposed. Using the problem of detecting ionospheric anomalies as an example, the efficiency of combining threshold wavelet filtering with the NARX network is shown. The efficiency of network sharing an Autoencoder with adaptive wavelet threshold filtering is shown in the problem of detection in cosmic flux data.
引用
收藏
页码:139 / 148
页数:11
相关论文
共 50 条
  • [1] On the application of Exploratory Data Analysis for characterization of space weather data sets
    Krause, L. Habash
    Franz, A.
    Stevenson, A.
    ADVANCES IN SPACE RESEARCH, 2011, 47 (12) : 2199 - 2209
  • [2] Application of Intelligent Data Analysis Methods for Information Security Problems
    Vagin, Vadim
    Antipov, Sergey
    Fomina, Marina
    Morosin, Oleg
    PROCEEDINGS OF THE SECOND INTERNATIONAL SCIENTIFIC CONFERENCE INTELLIGENT INFORMATION TECHNOLOGIES FOR INDUSTRY (IITI'17), VOL 1, 2018, 679 : 16 - 25
  • [3] APPLICATION OF SODAR DATA IN WEATHER ANALYSIS AND LOCAL WEATHER FORECASTING
    周明煜
    吕乃平
    曲绍厚
    A Monthly Journal of Science, 1980, (04) : 328 - 331
  • [4] Space weather research: A major application of imagery and data fusion
    Poland, AI
    Withbroe, G
    Evans, JC
    32ND APPLIED IMAGERY PATTERN RECOGNITION WORKSHOP, PROCEEDINGS, 2004, : 3 - 3
  • [5] Design and Application of Intelligent Large Data Analysis System for Space Target Detection and Recognition
    Chen, Hongyan
    Wang, Sihong
    Wan, Junwei
    2019 4TH INTERNATIONAL CONFERENCE ON MECHANICAL, CONTROL AND COMPUTER ENGINEERING (ICMCCE 2019), 2019, : 447 - 451
  • [6] Fuzzy methods for automated intelligent data analysis
    Nauck, DD
    Spott, MT
    Azvine, B
    2004 IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS, VOLS 1-3, PROCEEDINGS, 2004, : 487 - 492
  • [7] A Comparative Analysis of Data Mining Methods for Weather Prediction
    Zeyad, Mohammad
    Hossain, Md Sajid
    2021 INTERNATIONAL CONFERENCE ON COMPUTATIONAL PERFORMANCE EVALUATION (COMPE-2021), 2021, : 167 - +
  • [8] Methods of Analysis of the Space System Application Process in Forecasting of the Development of Regional Natural Emergency
    Privalov, A. A.
    Kolesov, V. A.
    Veremyev, V., I
    PROCEEDINGS OF 2019 XXII INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND MEASUREMENTS (SCM), 2019, : 160 - 163
  • [9] MULTISCALING MODELLING OF RANDOM EXTREME EVENTS WITH APPLICATION TO NATURAL HAZARDS AND SPACE WEATHER
    Varlamov, A. A.
    Yakovchouk, S.
    PROCEEDINGS OF THE 8TH INTERNATIONAL CONFERENCE PROBLEMS OF GEOCOSMOS, 2010, : 449 - 454
  • [10] Automated shock detection and analysis algorithm for space weather application
    Vorotnikov, Vasiliy S.
    Smith, Charles W.
    Hu, Qiang
    Szabo, Adam
    Skoug, Ruth M.
    Cohen, Christina M. S.
    SPACE WEATHER-THE INTERNATIONAL JOURNAL OF RESEARCH AND APPLICATIONS, 2008, 6 (03):