An Uncertainty Measure for Incomplete Decision Tables and Its Applications

被引:131
作者
Dai, Jianhua [1 ]
Wang, Wentao [1 ]
Xu, Qing [1 ]
机构
[1] Zhejiang Univ, Coll Comp Sci, Hangzhou 310027, Zhejiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature selection; incomplete decision systems; monotonicity; rough-set theory; uncertainty measure; FUZZY-ROUGH SETS; KNOWLEDGE GRANULATION; INFORMATION ENTROPY; CO-ENTROPY; PARTITIONS; COVERINGS; SYSTEMS;
D O I
10.1109/TSMCB.2012.2228480
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Uncertainty measures can supply new viewpoints for analyzing data. They can help us in disclosing the substantive characteristics of data. The uncertainty measurement issue is also a key topic in the rough-set theory. Although there are some measures to evaluate the uncertainty for complete decision systems (also called decision tables), they cannot be trivially transplanted into incomplete decision systems. There are relatively few studies on uncertainty measurement in incomplete decision systems. In this paper, we propose a new form of conditional entropy, which can be used to measure the uncertainty in incomplete decision systems. Some important properties of the conditional entropy are obtained. In particular, two validity theorems guarantee that the proposed conditional entropy can be used as a reasonable uncertainty measure for incomplete decision systems. Experiments on some real-life data sets are conducted to test and verify the validity of the proposed measure. Applications of the proposed uncertainty measure in ranking attributes and feature selection are also studied with experiments.
引用
收藏
页码:1277 / 1289
页数:13
相关论文
共 45 条
[1]  
Bazan J. G., 1994, Methodologies for Intelligent Systems. 8th International Symposium, ISMIS '94 Proceedings, P346
[2]   Information-theoretic measures of uncertainty for rough sets and rough relational databases [J].
Beaubouef, T ;
Petry, FE ;
Arora, G .
INFORMATION SCIENCES, 1998, 109 (1-4) :185-195
[3]  
Bianucci D, 2009, LECT NOTES COMPUT SC, V5656, P15, DOI 10.1007/978-3-642-03281-3_2
[4]  
Cattaneo G, 2008, STUD FUZZ SOFT COMP, V224, P55
[5]  
Clark P., 1989, Machine Learning, V3, P261, DOI 10.1023/A:1022641700528
[6]   Attribute selection based on information gain ratio in fuzzy rough set theory with application to tumor classification [J].
Dai, Jianhua ;
Xu, Qing .
APPLIED SOFT COMPUTING, 2013, 13 (01) :211-221
[7]   Conditional entropy for incomplete decision systems and its application in data mining [J].
Dai, Jianhua ;
Xu, Qing ;
Wang, Wentao ;
Tian, Haowei .
INTERNATIONAL JOURNAL OF GENERAL SYSTEMS, 2012, 41 (07) :713-728
[8]   Approximations and uncertainty measures in incomplete information systems [J].
Dai, Jianhua ;
Xu, Qing .
INFORMATION SCIENCES, 2012, 198 :62-80
[9]   Uncertainty measurement for interval-valued decision systems based on extended conditional entropy [J].
Dai, Jianhua ;
Wang, Wentao ;
Xu, Qing ;
Tian, Haowei .
KNOWLEDGE-BASED SYSTEMS, 2012, 27 :443-450
[10]  
Dai Jianhua, 2011, INT J ADV COMPUTING, V3, P176