REAL-TIME CLASSIFICATION OF DISASTER IMAGES FROM SOCIAL MEDIA WITH A SELF-SUPERVISED LEARNING FRAMEWORK

被引:1
作者
Cai, Tianhui [1 ]
Gan, Hongyu [2 ]
Peng, Bo [3 ]
Huang, Qunying [3 ]
Zou, Zhiqiang [2 ]
机构
[1] Univ Illinois, Coll Liberal Arts & Sci, Urbana, IL USA
[2] Nanjing Univ Posts & Telecommun, Coll Comp, Nanjing, Jiangsu, Peoples R China
[3] Univ Wisconsin, Dept Geog, Madison, WI 53706 USA
来源
2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022) | 2022年
关键词
Self-supervised learning; image classification; MoCo; disaster assessment; transfer learning;
D O I
10.1109/IGARSS46834.2022.9883129
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
Many studies have shown that disaster images posted on social media by users can be helpful to establish situational awareness and support disaster management. As such, it is important to develop a real-time framework to automatically classify disaster related images on social media from not informative ones. Unfortunately, most of the existing methods are based on supervised learning which requires manual data labeling. Meanwhile, some studies adopt unsupervised learning classification, which avoids manual labeling, but results in lower accuracy. To fill the research gap, this paper built upon MoCo model and developed a self-supervised learning classification framework. Using social media images of seven real disaster events as case studies, the results demonstrate that the proposed method without the manual labeling, can reach relatively high accuracy for disaster image classification by comparing with the state-of-the-art supervised learning and unsupervised learning models.
引用
收藏
页码:671 / 674
页数:4
相关论文
共 50 条
  • [41] DEEP SELF-SUPERVISED BAND-LEVEL LEARNING FOR HYPERPSPECTRAL CLASSIFICATION
    Santiago, Jonathan Gonzalez
    Schenkel, Fabian
    Middelmann, Wolfgang
    IMAGE AND SIGNAL PROCESSING FOR REMOTE SENSING XXVIII, 2022, 12267
  • [42] Histopathological Classification of Colon Tissue Images with Self-Supervised Models
    Erden, Mehmet Bahadir
    Cansiz, Selahattin
    Demir, Cigdem Gunduz
    2023 31ST SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE, SIU, 2023,
  • [43] Self-supervised ensembled learning for autism spectrum classification
    Gaur, Manu
    Chaturvedi, Kunal
    Vishwakarma, Dinesh Kumar
    Ramasamy, Savitha
    Prasad, Mukesh
    RESEARCH IN AUTISM SPECTRUM DISORDERS, 2023, 107
  • [44] Tackling Low-Resource ECG Classification with Self-supervised Learning
    Silva, Rafael da Costa
    Silva, Diego Furtado
    INTELLIGENT SYSTEMS, BRACIS 2024, PT IV, 2025, 15415 : 238 - 252
  • [45] Self-Supervised 3D Representation Learning of Dressed Humans From Social Media Videos
    Jafarian, Yasamin
    Park, Hyun Soo
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (07) : 8969 - 8983
  • [46] Image Classification Algorithm Named OCFC Based on Self-supervised Learning
    Shu, Qihui
    Liu, Song
    Wang, Jianwen
    Lai, Qinghan
    Zhou, Zihan
    PROCEEDINGS OF 2020 IEEE 5TH INFORMATION TECHNOLOGY AND MECHATRONICS ENGINEERING CONFERENCE (ITOEC 2020), 2020, : 589 - 594
  • [47] Self-supervised Learning and Graph Classification under Heterophily
    Ding, Yilin
    Liu, Zhen
    Hao, Hao
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 3849 - 3853
  • [48] A Self-Supervised Learning Framework for Road Centerline Extraction From High-Resolution Remote Sensing Images
    Guo, Qing
    Wang, Zhipan
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 : 4451 - 4461
  • [49] A novel self-supervised ensemble learning framework for land use and land cover classification of polarimetric synthetic aperture radar images
    Darvishnezhad, Mohsen
    Sebt, Mohammad Ali
    IET RADAR SONAR AND NAVIGATION, 2024, 18 (03) : 379 - 409
  • [50] CoSleep: A Multi-View Representation Learning Framework for Self-Supervised Learning of Sleep Stage Classification
    Ye, Jianan
    Xiao, Qinfeng
    Wang, Jing
    Zhang, Hongjun
    Deng, Jiaoxue
    Lin, Youfang
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 189 - 193