Laboratory Abnormal Behavior Detection Based on Multimodal Information Fusion

被引:0
|
作者
Zhang, Dawei [1 ]
机构
[1] Liaodong Univ, Sch Informat Engn, Liaodong, Peoples R China
关键词
Multimodal Information Fusion; Optical Flow Theory; Abnormal Behavior Detection; Motion Mode Information; Contour Modal Information;
D O I
10.4018/IJDCF.350265
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The traditional laboratory anomaly detection methods mainly focus on the hidden dangers caused by chemical leaks and other items, ignoring the impact of abnormal behaviors such as incorrect operations and improper behavior on safety in the laboratory. This paper proposes a laboratory abnormal behavior detection method based on multimodal information fusion. The method generates a dense optical flow field of RGB image sequences based on optical flow theory and global smoothing constraints, and mines motion mode information. Meanwhile, the contour modal information of behavior is captured through convolution and adjacency matrix operations. Using decision level and proximity functions to integrate student behavior motion mode information and contour mode information, and using the maximum value as the behavior detection result. The experimental results show that the method can effectively detect abnormal behavior in the laboratory environment, with small detection errors and a specificity close to 1.00, effectively ensuring the safety of the laboratory environment.
引用
收藏
页数:16
相关论文
共 50 条
  • [41] Human Abnormal Behavior Detection Based on RGBD Video's Skeleton Information Entropy
    Bian, Ziyang
    Xu, Tingfa
    Su, Chang
    Luo, Xuan
    PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON COMMUNICATIONS, SIGNAL PROCESSING, AND SYSTEMS, 2016, 386 : 715 - 723
  • [42] Blind Image Tamper Detection Based on Multimodal Fusion
    Chetty, Girija
    Singh, Monica
    White, Matthew
    NEURAL INFORMATION PROCESSING: MODELS AND APPLICATIONS, PT II, 2010, 6444 : 557 - +
  • [43] A survey of multimodal event detection based on data fusion
    Mondal, Manuel
    Khayati, Mourad
    Sandlin, Hong-an
    Cudre-Mauroux, Philippe
    VLDB JOURNAL, 2025, 34 (01):
  • [44] An Abnormal Behavior Recognition Method Based on Fusion Features
    Yu, Gang
    Liu, Jia
    Zhang, Chang
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2021, PT III, 2021, 13015 : 222 - 232
  • [45] Abnormal behavior detection algorithm based on multi-branch convolutional fusion neural network
    Zheng Xu
    Yuanyao Lu
    Multimedia Tools and Applications, 2023, 82 : 22723 - 22740
  • [46] Abnormal behavior detection algorithm based on multi-branch convolutional fusion neural network
    Xu, Zheng
    Lu, Yuanyao
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (15) : 22723 - 22740
  • [47] Abnormal event detection based on saliency information
    Fang, Zhijun
    Fei, Fengchang
    Fang, Yuming
    Shu, Lei
    Wan, Wanggen
    International Journal of Multimedia and Ubiquitous Engineering, 2015, 10 (09): : 339 - 352
  • [48] Multimodal Emotion Recognition based on Global Information Fusion in Conversations
    Kim, Dae Hyeon
    Choi, Young-Seok
    2024 INTERNATIONAL TECHNICAL CONFERENCE ON CIRCUITS/SYSTEMS, COMPUTERS, AND COMMUNICATIONS, ITC-CSCC 2024, 2024,
  • [49] Multimodal information fusion detection of fall-related disability based on video images and sensing signals
    Qiu, Yuke
    He, Yuchen
    Ying, Yangwei
    Ma, Xiaoyu
    Zhou, Hong
    Liang, Kewei
    APPLIED INTELLIGENCE, 2025, 55 (06)
  • [50] Image-based Plant Recognition by Fusion of Multimodal Information
    Liu, Jen-Chang
    Chiang, Chieh-Yu
    Chen, Sam
    2016 10TH INTERNATIONAL CONFERENCE ON INNOVATIVE MOBILE AND INTERNET SERVICES IN UBIQUITOUS COMPUTING (IMIS), 2016, : 5 - 11