Conversational Group Detection with Graph Neural Networks

被引:18
作者
Thompson, Sydney [1 ]
Gupta, Abhijit [1 ]
Gupta, Anjali W. [1 ]
Chen, Austin [1 ]
Vazquez, Marynel [1 ]
机构
[1] Yale Univ, New Haven, CT 06520 USA
来源
PROCEEDINGS OF THE 2021 INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, ICMI 2021 | 2021年
基金
美国国家科学基金会;
关键词
F-formation; clustering; graph neural network;
D O I
10.1145/3462244.3479963
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
We study conversational group detection in varied social scenes using a message-passing Graph Neural Network (GNN) in combination with the Dominant Sets clustering algorithm. Our approach first describes a scene as an interaction graph, where nodes encode individual features and edges encode pairwise relationship data. Then, it uses a GNN to predict pairwise affinity values that represent the likelihood of two people interacting together, and computes non-overlapping group assignments based on these affinities. We evaluate the proposed approach on the Cocktail Party and MatchNMingle datasets. Our results suggest that using GNNs to leverage both individual and relationship features when computing groups is beneficial, especially when more features are available for each individual.
引用
收藏
页码:248 / 252
页数:5
相关论文
共 41 条
[1]   SALSA: A Novel Dataset for Multimodal Group Behavior Analysis [J].
Alameda-Pineda, Xavier ;
Staiano, Jacopo ;
Subramanian, Ramanathan ;
Batrinca, Ligia ;
Ricci, Elisa ;
Lepri, Bruno ;
Lanz, Oswald ;
Sebe, Nicu .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (08) :1707-1720
[2]  
[Anonymous], 1966, Anchor
[3]  
Bianchi FM, 2020, PR MACH LEARN RES, V119
[4]  
Bohus D, 2014, AAMAS'14: PROCEEDINGS OF THE 2014 INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS & MULTIAGENT SYSTEMS, P637
[5]   The MatchNMingle Dataset: A Novel Multi-Sensor Resource for the Analysis of Social Interactions and Group Dynamics In-the-Wild During Free-Standing Conversations and Speed Dates [J].
Cabrera-Quiros, Laura ;
Demetriou, Andrew ;
Gedik, Ekin ;
van der Meij, Leander ;
Hung, Hayley .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2021, 12 (01) :113-130
[6]   Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networks [J].
Chiang, Wei-Lin ;
Liu, Xuanqing ;
Si, Si ;
Li, Yang ;
Bengio, Samy ;
Hsieh, Cho-Jui .
KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, :257-266
[7]   Social interaction discovery by statistical analysis of F-formations [J].
Cristani, Marco ;
Bazzani, Loris ;
Paggetti, Giulia ;
Fossati, Andrea ;
Tosato, Diego ;
Del Bue, Alessio ;
Menegaz, Gloria ;
Murino, Vittorio .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2011, 2011,
[8]   Human behavior analysis in video surveillance: A Social Signal Processing perspective [J].
Cristani, Marco ;
Raghavendra, R. ;
Del Bue, Alessio ;
Murino, Vittorio .
NEUROCOMPUTING, 2013, 100 :86-97
[9]   PPF-FoldNet: Unsupervised Learning of Rotation Invariant 3D Local Descriptors [J].
Deng, Haowen ;
Birdal, Tolga ;
Ilic, Slobodan .
COMPUTER VISION - ECCV 2018, PT V, 2018, 11209 :620-638
[10]   Automatic Detection of Social Behavior of Museum Visitor Pairs [J].
Dim, Eyal ;
Kuflik, Tsvi .
ACM TRANSACTIONS ON INTERACTIVE INTELLIGENT SYSTEMS, 2015, 4 (04)