Application of Deep Learning in the Deployment of an Industrial SCARA Machine for Real-Time Object Detection

被引:17
|
作者
Kapusi, Tibor Peter [1 ]
Erdei, Timotei Istvan [2 ]
Husi, Geza [2 ]
Hajdu, Andras [1 ]
机构
[1] Univ Debrecen, Fac Informat, Dept Data Sci & Visualizat, Kassai Str 26, H-4028 Debrecen, Hungary
[2] Univ Debrecen, Fac Engn, Dept Air & Rd Vehicles, Otemeto Str 24, H-4028 Debrecen, Hungary
关键词
cyber-physical systems; Industry; 4.0; SCARA robot; deep learning; YOLO;
D O I
10.3390/robotics11040069
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
In the spirit of innovation, the development of an intelligent robot system incorporating the basic principles of Industry 4.0 was one of the objectives of this study. With this aim, an experimental application of an industrial robot unit in its own isolated environment was carried out using neural networks. In this paper, we describe one possible application of deep learning in an Industry 4.0 environment for robotic units. The image datasets required for learning were generated using data synthesis. There are significant benefits to the incorporation of this technology, as old machines can be smartened and made more efficient without additional costs. As an area of application, we present the preparation of a robot unit which at the time it was originally produced and commissioned was not capable of using machine learning technology for object-detection purposes. The results for different scenarios are presented and an overview of similar research topics on neural networks is provided. A method for synthetizing datasets of any size is described in detail. Specifically, the working domain of a given robot unit, a possible solution to compatibility issues and the learning of neural networks from 3D CAD models with rendered images will be discussed.
引用
收藏
页数:20
相关论文
共 50 条
  • [31] A real-time defective pixel detection system for LCDs using deep learning based object detectors
    Celik, Asli
    Kucukmanisa, Ayhan
    Sumer, Aydin
    Celebi, Aysun Tasyapi
    Urhan, Oguzhan
    JOURNAL OF INTELLIGENT MANUFACTURING, 2022, 33 (04) : 985 - 994
  • [32] A real-time foreign object detection method based on deep learning in complex open railway environments
    Zhang, Binlin
    Yang, Qing
    Chen, Fengkui
    Gao, Dexin
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2024, 21 (05)
  • [33] Real-Time Robotic Grasping and Localization Using Deep Learning-Based Object Detection Technique
    Farag, Mohannad
    Abd Ghafar, Abdul Nasir
    Alsibai, Mohammed Hayyan
    2019 IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC CONTROL AND INTELLIGENT SYSTEMS (I2CACIS), 2019, : 139 - 144
  • [34] Lightweight and Energy-Efficient Deep Learning Accelerator for Real-Time Object Detection on Edge Devices
    Kim, Kyungho
    Jang, Sung-Joon
    Park, Jonghee
    Lee, Eunchong
    Lee, Sang-Seol
    SENSORS, 2023, 23 (03)
  • [35] An optimization approach for real-time object detection in IoT devices through edge computing and deep learning
    Poonia, Ramesh Chandra
    Almakki, Riyad
    Saudagar, Abdul Khader Jilani
    Altameem, Abdullah
    Albathan, Mubarak
    JOURNAL OF INFORMATION & OPTIMIZATION SCIENCES, 2024, 45 (05) : 1465 - 1475
  • [36] A real-time defective pixel detection system for LCDs using deep learning based object detectors
    Aslı Çelik
    Ayhan Küçükmanisa
    Aydın Sümer
    Aysun Taşyapı Çelebi
    Oğuzhan Urhan
    Journal of Intelligent Manufacturing, 2022, 33 : 985 - 994
  • [37] A Survey on Deep-Learning-Based Real-Time SAR Ship Detection
    Li, Jianwei
    Chen, Jie
    Cheng, Pu
    Yu, Zhentao
    Yu, Lu
    Chi, Cheng
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 3218 - 3247
  • [38] A deep learning approach for real-time detection of sleep spindles
    Kulkarni, Prathamesh M.
    Xiao, Zhengdong
    Robinson, Eric J.
    Jami, Apoorva Sagarwal
    Zhang, Jianping
    Zhou, Haocheng
    Henin, Simon E.
    Liu, Anli A.
    Osorio, Ricardo S.
    Wang, Jing
    Chen, Zhe
    JOURNAL OF NEURAL ENGINEERING, 2019, 16 (03)
  • [39] Real-time Driver Drowsiness Detection using Deep Learning
    Dipu, Md Tanvir Ahammed
    Hossain, Syeda Sumbul
    Arafat, Yeasir
    Rafiq, Fatama Binta
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2021, 12 (07) : 844 - 850
  • [40] Application of Deep Learning in Object Detection
    Zhou, Xinyi
    Gong, Wei
    Fu, WenLong
    Du, Fengtong
    2017 16TH IEEE/ACIS INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION SCIENCE (ICIS 2017), 2017, : 631 - 634