A YOLO-based deep learning model for Real-Time face mask detection via drone surveillance in public spaces

被引:4
作者
Mostafa, Salama A. [1 ]
Ravi, Sharran [1 ]
Zebari, Dilovan Asaad [2 ]
Zebari, Nechirvan Asaad [3 ]
Mohammed, Mazin Abed [4 ,5 ,9 ]
Nedoma, Jan [5 ]
Martinek, Radek [6 ,9 ]
Deveci, Muhammet [7 ,8 ,9 ]
Ding, Weiping [10 ]
机构
[1] Univ Tun Hussein Onn Malaysia, Fac Comp Sci & Informat Technol, Parit Raja 86400, Johor, Malaysia
[2] Nawroz Univ, Coll Sci, Dept Comp Sci, Duhok 42001, Kurdistan Reg, Iraq
[3] Lebanese French Univ, Dept Informat Technol, Erbil, Kurdistan Reg, Iraq
[4] Univ Anbar, Coll Comp Sci & Informat Technol, Dept Artificial Intelligence, Anbar 31001, Iraq
[5] VSB Tech Univ Ostrava, Dept Telecommun, Ostrava 70800, Czech Republic
[6] Opole Univ Technol, Fac Elect Engn Automat Control & Informat, PL-45758 Opole, Poland
[7] Natl Def Univ, Turkish Naval Acad, Dept Ind Engn, TR-34942 Istanbul, Turkiye
[8] Lebanese Amer Univ, Dept Elect & Comp Engn, Byblos, Lebanon
[9] VSB Tech Univ Ostrava, Dept Cybernet & Biomed Engn, Ostrava 70800, Czech Republic
[10] Nantong Univ, Sch Informat Sci & Technol, Nantong 226019, Peoples R China
关键词
Face mask detection; COVID-19; Drone; Convolutional Neural Networks (CNNs); YOLO;
D O I
10.1016/j.ins.2024.120865
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Automating face mask detection in public areas is paramount to maintaining public health, especially in the context of the COVID-19 pandemic. Utilization of technologies such as deep learning and computer vision systems enables effective monitoring of mask compliance, thereby minimizing the risk of virus spread. Real-time detection helps in prompt intervention for and enforcement of the use of masks, thereby preventing potential outbreaks and ensuring compliance with public health guidelines. This method helps save human resources and makes the reinforcement of wearing masks in public areas consistent and objective. Automatic detection of face masks serves as a key tool for preventing the spread of contagious diseases, protecting public health, and creating a safer environment for every person. This study addresses the challenges of real-time face mask detection via drone surveillance in public spaces, with reference to three categories: wearing of mask, incorrect wearing of mask, and no mask. Addressing these challenges entails an efficient and robust object detection and recognition algorithm. This algorithm can deal with a crowd of multiple faces via a mobile camera carried by a mini drone, and performs realtime video processing. Accordingly, this study proposes a You Only Look Once (YOLO) based deep learning C-Mask model for real-time face mask detection and recognition via drone surveillance in public spaces. The C-Mask model aims to operate within a mini drone surveillance system and provide efficient and robust face mask detection. The C-Mask model performs preprocessing, feature extraction, feature generation, feature enhancement, feature selection, and multivariate classification tasks for each face mask detection cycle. The preprocessing task prepares the training and testing data in the form of images for further processing. The feature extraction task is performed using a Convolutional Neural Network (CNN). Moreover, Cross -Stage Partial (CSP) DarkNet53 is used to improve the feature extraction and to facilitate the model 's object detection ability. A data augmentation algorithm is used for feature generation to enhance the model 's training robustness. The feature enhancement task is performed by applying the Path Aggregation Network (PANet) and Spatial Pyramid Pooling Network (SPPNet) algorithms, which are deployed to enhance the extracted and generated features. The classification task is performed through multi -label classification, wherein each object in an image can belong to multiple classes simultaneously, and the network generates a grid of bounding boxes and corresponding confi- dence scores for each class. The YOLO-based C -Mask model testing is performed by experimenting with various face mask detection scenarios and with varying mask colors and types, to ensure the efficiency and robustness of the proposed model. The C -Mask model test results show that this model can correctly and effectively detect face masks in real-time video streams under various conditions with an overall accuracy of 92.20%, precision of 92.04, recall of 90.83%, and F1 -score of 89.95%, for all the three classes. These high scores have been obtained despite mini drone mobility and camera orientation adjustment substantially affecting face mask detection performance.
引用
收藏
页数:21
相关论文
共 50 条
  • [41] An Efficient Automatic Face Mask Detection System for Human Safety Based on Deep Learning using Novel YOLOv3 in Comparison of YOLO with Improved Accuracy
    Nithin, A.
    Jaisharma, K.
    Suresh, V.
    2022 14TH INTERNATIONAL CONFERENCE ON MATHEMATICS, ACTUARIAL SCIENCE, COMPUTER SCIENCE AND STATISTICS (MACS), 2022,
  • [42] Real-time detection of cracks in tiled sidewalks using YOLO-based method applied to unmanned aerial vehicle (UAV) images
    Qiu, Qiwen
    Lau, Denvid
    AUTOMATION IN CONSTRUCTION, 2023, 147
  • [43] Real-time face mask detection for COVID-19 prevention
    Sujon, Mohammad Rezaul Karim
    Hossain, Md Rasel
    Al Amin, Md Jaki
    Bepery, Chinmay
    Rahman, Md Mahbubur
    2022 IEEE 12TH ANNUAL COMPUTING AND COMMUNICATION WORKSHOP AND CONFERENCE (CCWC), 2022, : 341 - 346
  • [44] Performance Evaluation of Face Mask Detection for Real-Time Implementation on an RPi
    Tarun, Ivan George L.
    Lopez, Vidal Wyatt M.
    Serrano, Pamela Anne C.
    Abu, Patricia Angela R.
    Reyes, Rosula S. J.
    Estuar, Regina Justina E.
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (07) : 967 - 974
  • [45] Fighting against COVID-19: A novel deep learning model based on YOLO-v2 with ResNet-50 for medical face mask detection
    Loey, Mohamed
    Manogaran, Gunasekaran
    Taha, Mohamed Hamed N.
    Khalifa, Nour Eldeen M.
    SUSTAINABLE CITIES AND SOCIETY, 2021, 65
  • [46] Detection of Invasive Species (Siam Weed) Using Drone-Based Imaging and YOLO Deep Learning Model
    Gautam, Deepak
    Mawardi, Zulfadli
    Elliott, Louis
    Loewensteiner, David
    Whiteside, Timothy
    Brooks, Simon
    REMOTE SENSING, 2025, 17 (01)
  • [47] Edge Deployment Framework of GuardBot for Optimized Face Mask Recognition With Real-Time Inference Using Deep Learning
    Manzoor, Sumaira
    Kim, Eun-Jin
    Joo, Sung-Hyeon
    Bae, Sang-Hyeon
    In, Gun-Gyo
    Joo, Kyeong-Jin
    Choi, Jun-Hyeon
    Kuc, Tae-Yong
    IEEE ACCESS, 2022, 10 : 77898 - 77921
  • [48] Real-time vehicle detection for traffic monitoring by applying a deep learning algorithm over images acquired from satellite and drone
    Vohra, D. S.
    Garg, Pradeep Kumar
    Ghosh, Sanjay
    INTERNATIONAL JOURNAL OF INTELLIGENT UNMANNED SYSTEMS, 2023, 11 (04) : 441 - 452
  • [49] Real-Time Detection based on Modified YOLO for Herniated Intervertebral Discs
    Zhong, Zhenxiao
    Deng, Jianzhi
    2019 4TH INTERNATIONAL CONFERENCE ON INTELLIGENT INFORMATION PROCESSING (ICIIP 2019), 2019, : 467 - 471
  • [50] OSDDY: embedded system-based object surveillance detection system with small drone using deep YOLO
    Kaliappan Madasamy
    Vimal Shanmuganathan
    Vijayalakshmi Kandasamy
    Mi Young Lee
    Manikandan Thangadurai
    EURASIP Journal on Image and Video Processing, 2021