Conformal prediction with Neural Networks

被引:49
作者
Papadopoulos, Harris [1 ]
Vovk, Volodya [2 ]
Garnmerman, Alex [2 ]
机构
[1] Frederick Inst Technol, 7 Y Frederickou St, Nicosia, Cyprus
[2] Univ London Royal Holloway, Dept Comp Sci, Egham TW20 0EX, Surrey, England
来源
19TH IEEE INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, VOL II, PROCEEDINGS | 2007年
关键词
D O I
10.1109/ICTAI.2007.47
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Conformal Prediction (CP) is a method that can be used for complementing the bare predictions produced by any traditional machine learning algorithm with measures of confidence. CP gives good accuracy and confidence values, but unfortunately it is quite computationally inefficient. This computational inefficiency problem becomes huge when CP is coupled with a method that requires long training times, such as Neural Networks. In this paper we use a modification of the original CP method, called Inductive Conformal Prediction (ICP), which allows us to construct a Neural Network confidence predictor without the massive computational overhead of CP The method we propose accompanies its predictions with confidence measures that are useful in practice, while still preserving the computational efficiency of its underlying Neural Network.
引用
收藏
页码:388 / +
页数:2
相关论文
共 12 条
[1]  
[Anonymous], 1994, MACHINE LEARNING NEU
[2]  
Cristianini N., 2000, Intelligent Data Analysis: An Introduction
[3]   STATLOG - COMPARISON OF CLASSIFICATION ALGORITHMS ON LARGE REAL-WORLD PROBLEMS [J].
KING, RD ;
FENG, C ;
SUTHERLAND, A .
APPLIED ARTIFICIAL INTELLIGENCE, 1995, 9 (03) :289-333
[4]   DEFINITION OF RANDOM SEQUENCES [J].
MARTINLOF, P .
INFORMATION AND CONTROL, 1966, 9 (06) :602-+
[5]  
Melluish T., 2001, P 12 EUROPEAN C MACH, V2167, P360
[6]  
Nouretdinov I, 2001, LECT NOTES ARTIF INT, V2111, P337
[7]  
Papadopoulos H, 2002, LECT NOTES ARTIF INT, V2430, P345
[8]  
Papadopoulos H., 2002, P 2002 INT C MACH LE, P159
[9]  
Saunders C, 1999, IJCAI-99: PROCEEDINGS OF THE SIXTEENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOLS 1 & 2, P722
[10]  
Vovk V, 2002, ANN IEEE SYMP FOUND, P187, DOI 10.1109/SFCS.2002.1181895