Publikationsansicht

Evaluating predictive uncertainty challenge (2006)

Abstract
This Chapter presents the PASCAL(1) Evaluating Predictive Uncertainty Challenge, introduces the contributed Chapters by the participants who obtained outstanding results, and provides a discussion with some lessons to be learnt. The Challenge was set up to evaluate the ability of Machine Learning algorithms to provide good "probabilistic predictions", rather than just the usual "point predictions" with no measure of uncertainty, in regression and classification problems. Participants had to compete on a number of regression and classification tasks, and were evaluated by both traditional losses that only take into account point predictions and losses we proposed that evaluate the quality of the probabilistic predictions.

Details der Publikation
Archiv Fraunhofer Publica (Germany)
Typ Conference Paper
Sprache english
Verknüpfungen Quinonero-Candela, J.: Machine learning challenges: Evaluating predictive uncertainty, visual object classification and recognizing textual entailment: First PASCAL Machine Learning Challenges Workshop, MLCW 2005, Southampton, UK, April 11 - 13, 2005; Revised selected papers. Berlin: Springer, 2006. (Lecture Notes in Artificial Intelligence 3944), pp. 1-27