Graph-Neural-Network-Based User Intent Understanding for Visual Analytics

被引:1
|
作者
Wang, Yue [1 ]
Qi, Yusheng [1 ]
Zhang, Xiaolong [2 ]
Chen, Siming [1 ]
机构
[1] Fudan Univ, Shanghai, Peoples R China
[2] Penn State Univ, University Pk, PA 16802 USA
来源
2024 IEEE 17TH PACIFIC VISUALIZATION CONFERENCE, PACIFICVIS | 2024年
关键词
Human-Computer Interaction-Graph/Network Data-Visual Analysis Models-User intent understanding; VISUALIZATION;
D O I
10.1109/PacificVis60374.2024.00011
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In the design of visual analytics systems, good understanding of user intents can make systems adapt to user needs and help users better complete analytical tasks. However, user intent is difficult to observe directly. Current work tends to focus more on analyzing user behaviors and overlook the potential connections between data. In this paper, we propose an approach to understanding user intents by automatically extracting data features and combining them with user interaction history. We develop a framework for understanding user intents based on graph neural networks to support two high-level tasks: 1) real-time recommendation for the next interaction based on interaction history, and 2) real-time storytelling to characterize user intents. In our framework, we apply an SR-GATNE model based on graph neural networks to real-time recommendations and story generation. We incorporate the framework in a visual analytics system for industry analysis and evaluating the system. Results of evaluation show that our approach can help users complete the tasks better and improve their experience in analytical tasks.
引用
收藏
页码:11 / 21
页数:11
相关论文
共 26 条
  • [1] Hierarchical User Intent Graph Network for Multimedia Recommendation
    Wei, Yinwei
    Wang, Xiang
    He, Xiangnan
    Nie, Liqiang
    Rui, Yong
    Chua, Tat-Seng
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 2701 - 2712
  • [2] Illation of Video Visual Relation Detection Based on Graph Neural Network
    Qu, MingCheng
    Cui, JianXun
    Nie, Yuxi
    Su, TongHua
    IEEE ACCESS, 2021, 9 : 141144 - 141153
  • [3] Toward Addressing Ambiguous Interactions and Inferring User Intent with Dimension Reduction and Clustering Combinations in Visual Analytics
    Wenskovitch, John
    Dowling, Michelle
    North, Chris
    ACM TRANSACTIONS ON INTERACTIVE INTELLIGENT SYSTEMS, 2024, 14 (01)
  • [4] GNNLens: A Visual Analytics Approach for Prediction Error Diagnosis of Graph Neural Networks
    Jin, Zhihua
    Wang, Yong
    Wang, Qianwen
    Ming, Yao
    Ma, Tengfei
    Qu, Huamin
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2023, 29 (06) : 3024 - 3038
  • [5] Comprehensive Evaluation Method of Visual Analytics Tools Based on Fuzzy Theory and Artificial Neural Network
    Amri, Saber
    Ltifi, Hela
    Ben Ayed, Mounir
    2017 12TH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS AND KNOWLEDGE ENGINEERING (IEEE ISKE), 2017,
  • [6] Neural network training fingerprint: visual analytics of the training process in classification neural networks
    Ferreira, Martha Dais
    Cantareira, Gabriel D.
    de Mello, Rodrigo F.
    Paulovich, Fernando V.
    JOURNAL OF VISUALIZATION, 2022, 25 (03) : 593 - 612
  • [7] Neural network training fingerprint: visual analytics of the training process in classification neural networks
    Martha Dais Ferreira
    Gabriel D. Cantareira
    Rodrigo F. de Mello
    Fernando V. Paulovich
    Journal of Visualization, 2022, 25 : 593 - 612
  • [8] A User-based Visual Analytics Workflow for Exploratory Model Analysis
    Cashman, Dylan
    Humayoun, Shah Rukh
    Heimerl, Florian
    Park, Kendall
    Das, Subhajit
    Thompson, John
    Saket, Bahador
    Mosca, Abigail
    Stasko, John
    Endert, Alex
    Gleicher, Michael
    Chang, Remco
    COMPUTER GRAPHICS FORUM, 2019, 38 (03) : 185 - 199
  • [9] Visual Annotations for Hybrid Graph-based User Model
    Guchev, Vladimir
    Cena, Federica
    Vernero, Fabiana
    Gena, Cristina
    ACM UMAP '19: PROCEEDINGS OF THE 27TH ACM CONFERENCE ON USER MODELING, ADAPTATION AND PERSONALIZATION, 2019, : 31 - 35
  • [10] Visual Analytics of Multiple Network Ranking Based on Structural Similarity
    Cheng, Aosheng
    Yin, Yulong
    Yan, Zhenyu
    Liu, Yuhua
    Zhou, Zhiguang
    2022 IEEE 15TH PACIFIC VISUALIZATION SYMPOSIUM (PACIFICVIS 2022), 2022, : 196 - 200