|
|
|
Experimental comparison of classification uncertainty for randomised and Bayesian decision tree ensemblesV. Schetinin, D. Partridge, W.J. Krzanowski, R.M. Everson, J.E. Fieldsend, T.C. Bailey and A. HernandezIn: Proceedings of Fifth International Conference on Intelligent Data Engineering and Automated Learning, IDEAL04, Z.R. Yang, R. Everson and H. Yin (Eds.)3177, 726-732, Springer, 2004.
Abstract
In this paper we experimentally compare the classification uncertainty of the randomised Decision Tree (DT) ensemble technique and the Bayesian DT technique with a restarting strategy on a synthetic dataset as well as on some datasets commonly used in machine learning community. For quantitative evaluation of classification uncertainty, we use an Uncertainty Envelope dealing with the class posterior distribution and a given confidence probability. Counting the classifier outcomes, this technique produces feasible evaluations of the classification uncertainty. Using this technique in our experiments, we found that the Bayesian DT technique is superior to the randomised DT ensemble technique.
Gzipped postscript (117 kb) PDF (43 kb)
|