Transformer-based dual-view X-ray security inspection image analysis

被引:0
|
作者
Meng, Xianglong [1 ,2 ]
Feng, Hao [1 ,2 ]
Ren, Yu [3 ]
Zhang, Haigang [1 ]
Zou, Weidong [4 ]
Ouyang, Xinyu [2 ]
机构
[1] Shenzhen Polytech Univ, Shenzhen, Peoples R China
[2] Univ Sci & Technol Liaoning, Anshan, Liaoning, Peoples R China
[3] Shenzhen Univ, Shenzhen, Peoples R China
[4] Beijing Inst Technol, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
X-ray image analysis; Object detection; Dual-view security inspection; Feature fusion;
D O I
10.1016/j.engappai.2024.109382
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Artificial intelligence technology is rapidly advancing and has been widely applied in the field of intelligent security inspection. Utilizing computer vision technology to detect prohibited items in X-ray images has drawn much attention. Due to the transmission effect of X-rays, single-view security inspection images are prone to object occlusion and poor imaging angles, which seriously affects the performance of object detection models. Dual-view security inspection equipment can simultaneously capture X-ray transmission images of the item under inspection from both horizontal and vertical angles, which can effectively address issues of poor imaging angles and object occlusions that single-view imaging cannot resolve. In this paper, we introduced the artificial intelligence technology in dual-view security inspection image analysis, and proposed the dual-view feature fusion and prohibited item detection model in X-ray security inspection images based on the Vision Transformer framework. The detection model contains two input channels: the main and secondary channel. The main function of the main channel is to detect prohibited items in security inspection images, while the secondary channel is dedicated to providing effective feature information of prohibited items for the main channel. Two feature interaction modules are applied in the proposed model to realize dual channel information exchange and supplement from local and global perspectives respectively. Simulation results based on the public Dualray dataset have demonstrated the state-of-the-art performance of the proposed dual-view X-ray image detection model. Code is available at https://github.com/zhg-SZPT/Trans2Ray.
引用
收藏
页数:11
相关论文
共 40 条
  • [31] Towards Real-world X-ray Security Inspection: A High-Quality Benchmark And Lateral Inhibition Module For Prohibited Items Detection
    Tao, Renshuai
    Wei, Yanlu
    Jiang, Xiangjian
    Li, Hainan
    Qin, Haotong
    Wang, Jiakai
    Ma, Yuqing
    Zhang, Libo
    Liu, Xianglong
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 10903 - 10912
  • [32] EslaXDET: A new X-ray baggage security detection framework based on self-supervised vision transformers
    Wu, Jiajie
    Xu, Xianghua
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 127
  • [33] Real-time CNN-based object detection of prohibited items for X-ray security screening
    Park, Junsung
    An, Geunyoung
    Lee, Byeong-No
    Seo, Hee
    RADIATION PHYSICS AND CHEMISTRY, 2025, 232
  • [34] A machine learning color-based segmentation for object detection within dual X-ray baggage images
    Chouai, Mohamed
    Merah, Mostefa
    Sancho-Gomez, Jose-Luis
    Mimi, Malika
    3RD INTERNATIONAL CONFERENCE ON NETWORKING, INFORMATION SYSTEM & SECURITY (NISS'20), 2020,
  • [35] Web-based efficient dual attention networks to detect COVID-19 from X-ray images
    Sarker, Md. Mostafa Kamal
    Makhlouf, Yasmine
    Banu, Syeda Furruka
    Chambon, Sylvie
    Radeva, Petia
    Puig, Domenec
    ELECTRONICS LETTERS, 2020, 56 (24) : 1298 - 1300
  • [36] 114Xray: A Large-Scale X-Ray Security Detection Benchmark and Aware Enhance Network for Real-World Prohibited Item Inspection in Baggage
    Gao, Hongxia
    Guan, Zhenming
    Huang, Yaobin
    Hong, Xiaomeng
    Liao, Hongyu
    Huang, Bin
    Zheng, Hongzhen
    Lin, Runze
    Li, Litao
    Tang, Haolin
    Lin, Guoyuan
    Chen, Zhanhong
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT XI, 2025, 15041 : 246 - 260
  • [37] Intelligent Gangue Sorting System Based on Dual-Energy X-ray and Improved YOLOv5 Algorithm
    Qin, Yuchen
    Kou, Ziming
    Han, Cong
    Wang, Yutong
    APPLIED SCIENCES-BASEL, 2024, 14 (01):
  • [38] Automatic Detection of Threat Objects in X-ray Baggage Inspection Using Mask Region-Based Convolutional Neural Network and Deformable Convolutional Network
    Jongchol Kim
    Jinmyong Ri
    Hyok Jo
    Russian Journal of Nondestructive Testing, 2022, 58 : 1175 - 1184
  • [39] Automatic Detection of Threat Objects in X-ray Baggage Inspection Using Mask Region-Based Convolutional Neural Network and Deformable Convolutional Network
    Kim, Jongchol
    Ri, Jinmyong
    Jo, Hyok
    RUSSIAN JOURNAL OF NONDESTRUCTIVE TESTING, 2022, 58 (12) : 1175 - 1184
  • [40] PIXDet: Prohibited Item Detection in X-Ray Image Based on Whole-Process Feature Fusion and Local–Global Semantic Dependency Interaction
    Xu, Yan
    Zhang, Qiyuan
    Su, Qian
    Lu, Yu
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72 (1-17) : 1 - 17