SELF-SUPERVISED TEMPORAL ANALYSIS OF SPATIOTEMPORAL DATA

被引:0
|
作者
Cao, Yi [1 ]
Ganguli, Swetava [1 ]
Pandey, Vipul [1 ]
机构
[1] Apple, Cupertino, CA 90210 USA
关键词
Discrete Fourier Transform (DFT); Autoencoders; Semantic Segmentation; Deep Learning;
D O I
10.1109/IGARSS52108.2023.10282482
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
There exists a correlation between geospatial activity temporal patterns and type of land use. A novel self-supervised approach is proposed to stratify landscape based on mobility activity time series. First, the time series signal is transformed to the frequency domain and then compressed into task-agnostic temporal embeddings by a contractive autoencoder, which preserves cyclic temporal patterns observed in time series. The pixel-wise embeddings are converted to image-like channels that can be used for task-based, multimodal modeling of downstream geospatial tasks using deep semantic segmentation. Experiments show that temporal embeddings are semantically meaningful representations of time series data and are effective across different tasks such as classifying residential and commercial areas.
引用
收藏
页码:4856 / 4859
页数:4
相关论文
共 50 条
  • [31] Spatiotemporal consistency enhancement self-supervised representation learning for action recognition
    Shuai Bi
    Zhengping Hu
    Mengyao Zhao
    Shufang Li
    Zhe Sun
    Signal, Image and Video Processing, 2023, 17 : 1485 - 1492
  • [32] Self-Supervised Spatiotemporal Imputation Model for Highly Sparse Chl-a Data via Fusing Multisource Satellite Data
    Wang, Shuyu
    Li, Wengen
    Guan, Jihong
    Liu, Xiwei
    Zhang, Yichao
    Zhou, Shuigeng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [33] CONTRASTIVE SELF-SUPERVISED LEARNING FOR SPATIO-TEMPORAL ANALYSIS OF LUNG ULTRASOUND VIDEOS
    Chen, Li
    Rubin, Jonathan
    Ouyang, Jiahong
    Balaraju, Naveen
    Patil, Shubham
    Mehanian, Courosh
    Kulhare, Sourabh
    Millin, Rachel
    Gregory, Kenton W.
    Gregory, Cynthia R.
    Zhu, Meihua
    Kessler, David O.
    Malia, Laurie
    Dessie, Almaz
    Rabiner, Joni
    Coneybeare, Di
    Shopsin, Bo
    Hersh, Andrew
    Madar, Cristian
    Shupp, Jeffrey
    Johnson, Laura S.
    Avila, Jacob
    Dwyer, Kristin
    Weimersheimer, Peter
    Raju, Balasundar
    Kruecker, Jochen
    Chen, Alvin
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [34] Self-Supervised Spatiotemporal Graph Neural Networks With Self-Distillation for Traffic Prediction
    Ji, Junzhong
    Yu, Fan
    Lei, Minglong
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (02) : 1580 - 1593
  • [35] Supervised and self-supervised learning-based cascade spatiotemporal fusion framework and its application
    Sun, Weixuan
    Li, Jie
    Jiang, Menghui
    Yuan, Qiangqiang
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2023, 203 : 19 - 36
  • [36] Constrained Self-supervised Method with Temporal Ensembling for Fiber Bundle Detection on Anatomic Tracing Data
    Sundaresan, Vaanathi
    Lehman, Julia F.
    Fitzgibbon, Sean
    Jbabdi, Saad
    Haber, Suzanne N.
    Yendiki, Anastasia
    MEDICAL OPTICAL IMAGING AND VIRTUAL MICROSCOPY IMAGE ANALYSIS, MOVI 2022, 2022, 13578 : 115 - 125
  • [37] Self-Supervised Place Recognition by Refining Temporal and Featural Pseudo Labels From Panoramic Data
    Chen, Chao
    Cheng, Zegang
    Liu, Xinhao
    Li, Yiming
    Ding, Li
    Wang, Ruoyu
    Feng, Chen
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (01): : 248 - 255
  • [38] RAPID WILDFIRE HOTSPOT DETECTION USING SELF-SUPERVISED LEARNING ON TEMPORAL REMOTE SENSING DATA
    Barco, Luca
    Urbanelli, Angelica
    Rossi, Claudio
    IGARSS 2024-2024 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, IGARSS 2024, 2024, : 2061 - 2065
  • [39] Joint-task Self-supervised Learning for Temporal Correspondence
    Li, Xueting
    Liu, Sifei
    De Mello, Shalini
    Wang, Xiaolong
    Kautz, Jan
    Yang, Ming-Hsuan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [40] Self-Supervised Video Action Localization with Adversarial Temporal Transforms
    Gong, Guoqiang
    Zheng, Liangfeng
    Jiang, Wenhao
    Mu, Yadong
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 693 - 699