Investigating the optimisation of real-world and synthetic object detection training datasets through the consideration of environmental and simulation factors

Computer vision is used for many industrial applications involving automation, especially those related to efficiency and safety. Computer vision techniques which use machine learning, such as object detectors, need a dataset of images for training and testing. Publicly available datasets or new datasets can be used. However, these datasets rarely consider whether the dataset is leading to optimal performance. Environmental factors, such as lighting and occlusion, will alter the appearance of the images and so images taken under certain condition may have different effects on training. A knowledge gap has formed as to how the test performance of deep neural networks can be improved by considering the effect and interactions of factors where either real or synthetic images are used. The following research illustrates that the different factors can have a significant impact on the test performance and demonstrates a process that can be used on real-world and synthetic images to identify the effect of each factor and discusses how this information may be used to create an optimal training dataset. (c) 2022 The Author(s). Published by Elsevier Ltd. This is an open access article under the CC BY license ( http://creativecommons.org/licenses/by/4.0/ )