Computer vision detection of defective apples using automatic lightness correction and weighted RVM classifier

被引:96
作者
Zhang, Baohua [1 ,2 ]
Huang, Wenqian [2 ]
Gong, Liang [1 ]
Li, Jiangbo [2 ]
Zhao, Chunjiang [1 ,2 ]
Liu, Chengliang [1 ]
Huang, Danfeng [1 ]
机构
[1] Shanghai Jiao Tong Univ, State Key Lab Mech Syst & Vibrat, Shanghai 200240, Peoples R China
[2] Beijing Acad Agr & Forestry Sci, Beijing Res Ctr Intelligent Equipment Agr, Beijing 100097, Peoples R China
基金
中国国家自然科学基金;
关键词
Computer vision; Defective apple detection; Lightness correction; Weighted RVM; Image processing; RELEVANCE VECTOR MACHINE; QUALITY INSPECTION; SYSTEM; CITRUS; FRUITS; BRUISES;
D O I
10.1016/j.jfoodeng.2014.08.024
中图分类号
TQ [化学工业];
学科分类号
0817 ;
摘要
Automatic detection of defective apples by computer vision system is still not available due to the uneven lightness distribution on the surface of apples and the similarity between the true defects, stems and calyxes. This paper presents a novel automatic defective apple detection method by using computer vision system combining with automatic lightness correction, number of the defect candidate (including true defect, stem and calyx) region counting, and weighted relevance vector machine (RVM) classifier. Automatic lightness correction was used to solve the problem of the uneven lightness distribution, especially in the edge area of the apples. According to the fact that the calyx and stem cannot appear at the same view of image, some apples could be classified as sound (N = 0, N is the number of defect candidate region) or defective (N >= 2) apples based on the number of defect candidate region in the preliminary step without any other complex processing. For the rest uncertain apples (N = 1), further discrimination was conducted. Average color, statistical, and average textural features were extracted from each candidate region, the relevant features and their weights were also analyzed by using I-RELIEF algorithm. Finally, the defect candidate regions are classified as true defect or stem/calyx by the weighted RVM classifier, and the apples would be finally classified as sound or defective class according to the category of the candidate regions. The result with 95.63% overall detection accuracy for the 160 samples indicated that the proposed algorithm was effective and suitable for the defective apples detection. The limitation of our research is the one single limited inspection view of the apples. Future work will be focused on whole surface and fast on-line inspection. (C) 2014 Elsevier Ltd. All rights reserved.
引用
收藏
页码:143 / 151
页数:9
相关论文
共 34 条
[1]   Multispectral inspection of citrus in real-time using machine vision and digital signal processors [J].
Aleixos, N ;
Blasco, J ;
Navarrón, F ;
Moltó, E .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2002, 33 (02) :121-137
[2]   Performance of a system for apple surface defect identification in near-infrared images [J].
Bennedsen, BS ;
Peterson, DL .
BIOSYSTEMS ENGINEERING, 2005, 90 (04) :419-431
[3]   Machine vision system for automatic quality grading of fruit [J].
Blasco, J ;
Aleixos, N ;
Moltó, E .
BIOSYSTEMS ENGINEERING, 2003, 85 (04) :415-423
[4]  
Blasco J., 2002, INT C AGR ENG AGENG
[5]   Inspection and grading of agricultural and food products by computer vision systems - a review [J].
Brosnan, T ;
Sun, DW .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2002, 36 (2-3) :193-213
[6]   Improving quality inspection of food products by computer vision - a review [J].
Brosnan, T ;
Sun, DW .
JOURNAL OF FOOD ENGINEERING, 2004, 61 (01) :3-16
[7]   Advances in Machine Vision Applications for Automatic Inspection and Quality Evaluation of Fruits and Vegetables [J].
Cubero, Sergio ;
Aleixos, Nuria ;
Molto, Enrique ;
Gomez-Sanchis, Juan ;
Blasco, Jose .
FOOD AND BIOPROCESS TECHNOLOGY, 2011, 4 (04) :487-504
[8]   Hyperspectral image classification using relevance vector machines [J].
Demir, Beguem ;
Erturk, Sarp .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2007, 4 (04) :586-590
[9]   Early detection of apple bruises on different background colors using hyperspectral imaging [J].
ElMasry, Gamal ;
Wang, Ning ;
Vigneault, Clement ;
Qiao, Jun ;
ElSayed, Adel .
LWT-FOOD SCIENCE AND TECHNOLOGY, 2008, 41 (02) :337-345
[10]   Automatic correction of the effects of the light source on spherical objects.: An application to the analysis of hyperspectral images of citrus fruits [J].
Gomez-Sanchis, J. ;
Molto, E. ;
Camps-Valls, G. ;
Gomez-Chova, L. ;
Aleixos, N. ;
Blasco, J. .
JOURNAL OF FOOD ENGINEERING, 2008, 85 (02) :191-200