Graph-Neural-Network-Based User Intent Understanding for Visual Analytics

被引:1
|
作者
Wang, Yue [1 ]
Qi, Yusheng [1 ]
Zhang, Xiaolong [2 ]
Chen, Siming [1 ]
机构
[1] Fudan Univ, Shanghai, Peoples R China
[2] Penn State Univ, University Pk, PA 16802 USA
来源
2024 IEEE 17TH PACIFIC VISUALIZATION CONFERENCE, PACIFICVIS | 2024年
关键词
Human-Computer Interaction-Graph/Network Data-Visual Analysis Models-User intent understanding; VISUALIZATION;
D O I
10.1109/PacificVis60374.2024.00011
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In the design of visual analytics systems, good understanding of user intents can make systems adapt to user needs and help users better complete analytical tasks. However, user intent is difficult to observe directly. Current work tends to focus more on analyzing user behaviors and overlook the potential connections between data. In this paper, we propose an approach to understanding user intents by automatically extracting data features and combining them with user interaction history. We develop a framework for understanding user intents based on graph neural networks to support two high-level tasks: 1) real-time recommendation for the next interaction based on interaction history, and 2) real-time storytelling to characterize user intents. In our framework, we apply an SR-GATNE model based on graph neural networks to real-time recommendations and story generation. We incorporate the framework in a visual analytics system for industry analysis and evaluating the system. Results of evaluation show that our approach can help users complete the tasks better and improve their experience in analytical tasks.
引用
收藏
页码:11 / 21
页数:11
相关论文
共 26 条
  • [21] Precise Measurement of Position and Attitude Based on Convolutional Neural Network and Visual Correspondence Relationship
    Yang, Jiachen
    Man, Jiabao
    Xi, Meng
    Gao, Xinbo
    Lu, Wen
    Meng, Qinggang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (06) : 2030 - 2041
  • [22] Graph-Based Visual-Semantic Entanglement Network for Zero-Shot Image Recognition
    Hu, Yang
    Wen, Guihua
    Chapman, Adriane
    Yang, Pei
    Luo, Mingnan
    Xu, Yingxue
    Dai, Dan
    Hall, Wendy
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 2473 - 2487
  • [23] Visual Attention Estimation Algorithm and Dynamic Neural Network Based Object Detection for Intelligent Vehicles
    Zhao, Baixuan
    Hu, Chuan
    Zhu, Wangwang
    Hu, Shuang
    Zhang, Xi
    IEEE SENSORS JOURNAL, 2024, 24 (11) : 18535 - 18545
  • [24] Attention-Based Parallel Multiscale Convolutional Neural Network for Visual Evoked Potentials EEG Classification
    Gao, Zhongke
    Sun, Xinlin
    Liu, Mingxu
    Dang, Weidong
    Ma, Chao
    Chen, Guanrong
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2021, 25 (08) : 2887 - 2894
  • [25] Neural Network Structure Analysis Based on Hierarchical Force-Directed Graph Drawing for Multi-Task Learning
    Shibata, Atsushi
    Dong, Fangyan
    Hirota, Kaoru
    JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2015, 19 (02) : 225 - 231
  • [26] Mobile Robot Control Based on 2D Visual Servoing: A New Approach Combining Neural Network With Variable Structure and Flatness Theory
    Kaaniche, Khaled
    Rashid, Nasr
    Miraoui, Imed
    Mekki, Hassen
    El-Hamrawy, Osama, I
    IEEE ACCESS, 2021, 9 : 83688 - 83694