REAL-TIME CLASSIFICATION OF DISASTER IMAGES FROM SOCIAL MEDIA WITH A SELF-SUPERVISED LEARNING FRAMEWORK

被引:1
作者
Cai, Tianhui [1 ]
Gan, Hongyu [2 ]
Peng, Bo [3 ]
Huang, Qunying [3 ]
Zou, Zhiqiang [2 ]
机构
[1] Univ Illinois, Coll Liberal Arts & Sci, Urbana, IL USA
[2] Nanjing Univ Posts & Telecommun, Coll Comp, Nanjing, Jiangsu, Peoples R China
[3] Univ Wisconsin, Dept Geog, Madison, WI 53706 USA
来源
2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022) | 2022年
关键词
Self-supervised learning; image classification; MoCo; disaster assessment; transfer learning;
D O I
10.1109/IGARSS46834.2022.9883129
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
Many studies have shown that disaster images posted on social media by users can be helpful to establish situational awareness and support disaster management. As such, it is important to develop a real-time framework to automatically classify disaster related images on social media from not informative ones. Unfortunately, most of the existing methods are based on supervised learning which requires manual data labeling. Meanwhile, some studies adopt unsupervised learning classification, which avoids manual labeling, but results in lower accuracy. To fill the research gap, this paper built upon MoCo model and developed a self-supervised learning classification framework. Using social media images of seven real disaster events as case studies, the results demonstrate that the proposed method without the manual labeling, can reach relatively high accuracy for disaster image classification by comparing with the state-of-the-art supervised learning and unsupervised learning models.
引用
收藏
页码:671 / 674
页数:4
相关论文
共 50 条
  • [1] Self-Supervised Transfer Learning from Natural Images for Sound Classification
    Shin, Sungho
    Kim, Jongwon
    Yu, Yeonguk
    Lee, Seongju
    Lee, Kyoobin
    APPLIED SCIENCES-BASEL, 2021, 11 (07):
  • [2] Image classification framework based on contrastive self-supervised learning
    Zhao H.-W.
    Zhang J.-R.
    Zhu J.-P.
    Li H.
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2022, 52 (08): : 1850 - 1856
  • [3] Self-supervised learning for Environmental Sound Classification
    Tripathi, Achyut Mani
    Mishra, Aakansha
    APPLIED ACOUSTICS, 2021, 182
  • [4] Kidney Tumor Classification on CT images using Self-supervised Learning
    Özbay E.
    Özbay F.A.
    Gharehchopogh F.S.
    Computers in Biology and Medicine, 2024, 176
  • [5] A MULTI-TASK SELF-SUPERVISED LEARNING FRAMEWORK FOR SCOPY IMAGES
    Li, Yuexiang
    Chen, Jiawei
    Zheng, Yefeng
    2020 IEEE 17TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2020), 2020, : 2005 - 2009
  • [6] Classification of Polyps in Endoscopic Images Using Self-Supervised Structured Learning
    Huang, Qi-Xian
    Lin, Guo-Shiang
    Sun, Hung-Min
    IEEE ACCESS, 2023, 11 : 50025 - 50037
  • [7] Semi-supervised Time Series Classification Model with Self-supervised Learning
    Xi, Liang
    Yun, Zichao
    Liu, Han
    Wang, Ruidong
    Huang, Xunhua
    Fan, Haoyi
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 116
  • [8] Self-Supervised Edge Perceptual Learning Framework for High-Resolution Remote Sensing Images Classification
    Li, Guangfei
    Liu, Wenbing
    Gao, Quanxue
    Wang, Qianqian
    Han, Jungong
    Gao, Xinbo
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (07) : 6024 - 6038
  • [9] Self-Supervised Representation Learning for Document Image Classification
    Siddiqui, Shoaib Ahmed
    Dengel, Andreas
    Ahmed, Sheraz
    IEEE ACCESS, 2021, 9 : 164358 - 164367
  • [10] Self-Supervised Learning for Solar Radio Spectrum Classification
    Li, Siqi
    Yuan, Guowu
    Chen, Jian
    Tan, Chengming
    Zhou, Hao
    UNIVERSE, 2022, 8 (12)