Social Self-Attention Generative Adversarial Networks for Human Trajectory Prediction

被引:2
|
作者
Yang C. [1 ]
Pan H. [1 ]
Sun W. [1 ]
Gao H. [1 ]
机构
[1] Harbin Institute of Technology, Research Institute of Intelligent Control and Systems, Harbin
来源
IEEE Transactions on Artificial Intelligence | 2024年 / 5卷 / 04期
基金
中国国家自然科学基金;
关键词
Generative adversarial networks (GANs); self-attention; social interactions; trajectory prediction;
D O I
10.1109/TAI.2023.3299899
中图分类号
学科分类号
摘要
Predicting accurate human future trajectories is of critical importance for self-driving vehicles if they are to navigate complex scenarios. Trajectories of humans are not only dependent on the humans themselves, but also the interactions with surrounding agents. Previous works mainly model interactions among agents by using a diversity of polymerization methods that integrate various learned agent states hit or miss. In this article, we propose social self-attention generative adversarial networks (Social SAGAN), which generate socially acceptable multimodal trajectory predictions. Social SAGAN incorporates a generator that predicts future trajectories of pedestrians, a discriminator that classifies trajectory predictions as real or fake, and a social self-attention mechanism that selectively refines the most interactive information and helps the overall model to capture what to pay attention to. Through extensive experiments, we demonstrate that our model achieves competitive prediction accuracy and computational complexity compared with previous state-of-the-art methods on all trajectory forecasting benchmarks. © 2020 IEEE.
引用
收藏
页码:1805 / 1815
页数:10
相关论文
共 50 条
  • [1] Self-attention and generative adversarial networks for algae monitoring
    Nhut Hai Huynh
    Boer, Gordon
    Schramm, Hauke
    EUROPEAN JOURNAL OF REMOTE SENSING, 2022, 55 (01) : 10 - 22
  • [2] Generative Adversarial Networks for Abnormal Event Detection in Videos Based on Self-Attention Mechanism
    Zhang, Weichao
    Wang, Guanjun
    Huang, Mengxing
    Wang, Hongyu
    Wen, Shaoping
    IEEE ACCESS, 2021, 9 : 124847 - 124860
  • [3] Self-attention generative adversarial network with the conditional constraint
    Jia Y.
    Ma L.
    Xi'an Dianzi Keji Daxue Xuebao/Journal of Xidian University, 2019, 46 (06): : 163 - 170
  • [4] SELF-ATTENTION GENERATIVE ADVERSARIAL NETWORK FOR SPEECH ENHANCEMENT
    Huy Phan
    Nguyen, Huy Le
    Chen, Oliver Y.
    Koch, Philipp
    Duong, Ngoc Q. K.
    McLoughlin, Ian
    Mertins, Alfred
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 7103 - 7107
  • [5] Social-Scene-Aware Generative Adversarial Networks for Pedestrian Trajectory Prediction
    Huang, Binhao
    Ma, Zhenwei
    Chen, Lianggangxu
    He, Gaoqi
    ADVANCES IN COMPUTER GRAPHICS, CGI 2021, 2021, 13002 : 190 - 201
  • [6] SATP-GAN: self-attention based generative adversarial network for traffic flow prediction
    Zhang, Liang
    Wu, Jianqing
    Shen, Jun
    Chen, Ming
    Wang, Rui
    Zhou, Xinliang
    Xu, Cankun
    Yao, Quankai
    Wu, Qiang
    TRANSPORTMETRICA B-TRANSPORT DYNAMICS, 2021, 9 (01) : 552 - 568
  • [7] SADD: Generative Adversarial Networks via Self-attention and Dual Discriminator in Unsupervised Domain Adaptation
    Dai, Zaiyan
    Yang, Jun
    Fan, Anfei
    Jia, Jinyin
    Chen, Junfan
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT VIII, 2024, 14432 : 473 - 484
  • [8] Maneuver Conditioned Vehicle Trajectory Prediction Using Self-Attention
    Huang, Junan
    Huang, Zhiqiu
    Shen, Guohua
    Wang, Jinyong
    Yin, Xiaohua
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE AND APPLICATIONS, 2023, 22 (02)
  • [9] Missing Data Imputation for Online Monitoring of Power Equipment Based on Self-attention Generative Adversarial Networks
    Zhou Y.
    Lin M.
    Chen J.
    Bai Z.
    Chen M.
    Gaodianya Jishu/High Voltage Engineering, 2023, 49 (05): : 1795 - 1809
  • [10] Vector Decomposition of Elastic Seismic Wavefields Using Self-Attention Deep Convolutional Generative Adversarial Networks
    Liu, Wei
    Cao, Junxing
    You, Jiachun
    Wang, Haibo
    APPLIED SCIENCES-BASEL, 2023, 13 (16):