Experimental comparison of classification uncertainty for randomised and Bayesian decision tree ensembles
 
 
          
 RME Home 
 
 DCS Home 
 
 Research 
 
 Teaching 
 
 Publications 
 
 Contact 
 
 Outgoing 
 
 
 Email me
  

Experimental comparison of classification uncertainty for randomised and Bayesian decision tree ensembles

V. Schetinin, D. Partridge, W.J. Krzanowski, R.M. Everson, J.E. Fieldsend, T.C. Bailey and A. Hernandez
In: Proceedings of Fifth International Conference on Intelligent Data Engineering and Automated Learning, IDEAL04, Z.R. Yang, R. Everson and H. Yin (Eds.)3177, 726-732, Springer, 2004.

Abstract

In this paper we experimentally compare the classification uncertainty of the randomised Decision Tree (DT) ensemble technique and the Bayesian DT technique with a restarting strategy on a synthetic dataset as well as on some datasets commonly used in machine learning community. For quantitative evaluation of classification uncertainty, we use an Uncertainty Envelope dealing with the class posterior distribution and a given confidence probability. Counting the classifier outcomes, this technique produces feasible evaluations of the classification uncertainty. Using this technique in our experiments, we found that the Bayesian DT technique is superior to the randomised DT ensemble technique.


Gzipped postscript  (117 kb)     PDF  (43 kb)