Integrating new classes on the fly in evolving fuzzy classifier designs and their application in visual inspection

被引:40
作者
Lughofer, Edwin [1 ]
Weigl, Eva [2 ]
Heidl, Wolfgang [2 ]
Eitzinger, Christian [2 ]
Radauer, Thomas
机构
[1] Johannes Kepler Univ Linz, Dept Knowledge Based Math Syst, A-4040 Linz, Austria
[2] Profactor GmbH, Med Vis Grp, Steyr Gleink, Austria
关键词
Evolving (fuzzy) classifiers; Integration of new classes on the fly; On-line visual inspection; All pairs decomposition; Class imbalance; Expected change in classifier accuracy; TIME ADAPTIVE CLASSIFIERS; SURFACE INSPECTION;
D O I
10.1016/j.asoc.2015.06.038
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we address the problem of integrating new classes on the fly into on-line classification systems. The main focus is on visual inspection tasks, although the concepts proposed in this paper can easily be applied to any other on-line classification systems. We use evolving fuzzy classifiers (EFCs), which can adapt their structure and update their parameters in incrementally due to embedded on-line adaptable classifier learning engines. We consider two different model architectures classical single model and an all-pairs approach that uses class information to decompose the classification problem into several smaller sub-problems. The latter technique is essential for establishing new classes quickly and efficiently in the classifier, and for reducing class imbalance. Methodological novelties are (i) making appropriate structural changes in the EFC whenever a new class appears while operating in a single-pass incremental manner and (ii) estimating the expected change in classifier accuracy on the older classes. The estimation is based on an analysis of the impact of new classes on the established decision boundaries. This is important for operators, who are already familiar with an established classifier, the accuracy of which is known. The new concepts are evaluated in a real-world visual inspection scenario, where the main task is to classify event types which may occur dynamically on micro-fluidic chips and may reduce their quality. The results show stable performance of established classifiers and efficient (low number of samples requested) as well as fast integration (steeply rising accuracy curves) of new event types (classes). (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:558 / 582
页数:25
相关论文
共 70 条
[21]   Round robin classification [J].
Fürnkranz, J .
JOURNAL OF MACHINE LEARNING RESEARCH, 2002, 2 (04) :721-747
[22]  
Gama J, 2010, CH CRC DATA MIN KNOW, P1
[23]  
Gray R. M., 1984, IEEE ASSP Magazine, V1, P4, DOI 10.1109/MASSP.1984.1162229
[24]   A semi-supervised dynamic version of Fuzzy K-Nearest Neighbours to monitor evolving systems [J].
Hartert, Laurent ;
Mouchaweh, Moamar Sayed ;
Billaudel, Patrice .
EVOLVING SYSTEMS, 2010, 1 (01) :3-15
[25]   Machine learning based analysis of gender differences in visual inspection decision making [J].
Heidl, Wolfgang ;
Thumfart, Stefan ;
Lughofer, Edwin ;
Eitzinger, Christian ;
Klement, Erich Peter .
INFORMATION SCIENCES, 2013, 224 :62-76
[26]   Unsupervised Active Learning Based on Hierarchical Graph-Theoretic Clustering [J].
Hu, Weiming ;
Hu, Wei ;
Xie, Nianhua ;
Maybank, Steve .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2009, 39 (05) :1147-1161
[27]   Learning valued preference structures for solving classification problems [J].
Huellermeier, Eyke ;
Brinker, Klaus .
FUZZY SETS AND SYSTEMS, 2008, 159 (18) :2337-2352
[28]   Effect of rule weights in fuzzy rule-based classification systems [J].
Ishibuchi, H ;
Nakashima, T .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2001, 9 (04) :506-515
[29]   Online activity recognition using evolving classifiers [J].
Javier Ordonez, Fco. ;
Antonio Iglesias, Jose ;
de Toledo, Paula ;
Ledezma, Agapito ;
Sanchis, Araceli .
EXPERT SYSTEMS WITH APPLICATIONS, 2013, 40 (04) :1248-1255
[30]  
Joshi Ajay J., 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), P2372, DOI 10.1109/CVPRW.2009.5206627