Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

What does a Bayesian Classifier score represent?

I'm using the ruby classifier gem whose classifications method returns the scores for a given string classified against the trained model.

Is the score a percentage? If so, is the maximum difference 100 points?

like image 801
Mike Buckbee Avatar asked Feb 04 '11 03:02

Mike Buckbee


People also ask

What do you mean by Bayesian classifier?

Bayesian classifiers are the statistical classifiers. Bayesian classifiers can predict class membership probabilities such as the probability that a given tuple belongs to a particular class.

What does the Bayesian classification provide?

Bayesian classification is based on Bayes Theorem. It provides the basis for probabilistic learning that accommodates prior knowledge and takes into account the observed data.

What is Bayesian classifier prove that it is an optimal classifier?

The Bayes optimal classifier is a probabilistic model that makes the most probable prediction for a new example, given the training dataset. This model is also referred to as the Bayes optimal learner, the Bayes classifier, Bayes optimal decision boundary, or the Bayes optimal discriminant function.

Why is Bayes classifier optimal?

It can be shown that of all classifiers, the Optimal Bayes classifier is the one that will have the lowest probability of miss classifying an observation, i.e. the lowest probability of error. So if we know the posterior distribution, then using the Bayes classifier is as good as it gets.


1 Answers

It's the logarithm of a probability. With a large trained set, the actual probabilities are very small numbers, so the logarithms are easier to compare. Theoretically, scores will range from infinitesimally close to zero down to negative infinity. 10**score * 100.0 will give you the actual probability, which indeed has a maximum difference of 100.

like image 98
Karl Bielefeldt Avatar answered Oct 21 '22 09:10

Karl Bielefeldt