Naive Bayes Classifier - Introduction



In simple terms, a naive Bayes classifier assumes that the presence (or absence) of a particular feature of a class is unrelated to the presence (or absence) of any other feature, given the class variable. For example, a fruit may be considered to be an apple if it is red, round, and about 4" in diameter. Even if these features depend on each other or upon the existence of the other features, a naive Bayes classifier considers all of these properties to independently contribute to the probability that this fruit is an apple.

Depending on the precise nature of the probability model, naive Bayes classifiers can be trained very efficiently in a supervised learning setting. In many practical applications, parameter estimation for naive Bayes models uses the method of maximum likelihood; in other words, one can work with the naive Bayes model without believing in Bayesian probability or using any Bayesian methods.

In spite of their naive design and apparently oversimplified assumptions, naive Bayes classifiers have worked quite well in many complex real-world situations. In 2004, analysis of the Bayesian classification problem has shown that there are some theoretical reasons for the apparently unreasonable efficacy of naive Bayes classifiers. Still, a comprehensive comparison with other classification methods in 2006 showed that Bayes classification is outperformed by more current approaches, such as boosted trees or random forests.

An advantage of the naive Bayes classifier is that it only requires a small amount of training data to estimate the parameters (means and variances of the variables) necessary for classification. Because independent variables are assumed, only the variances of the variables for each class need to be determined and not the entire covariance matrix.

Read more about this topic:  Naive Bayes Classifier

Other articles related to "introduction, introductions":

Reintroduction - Re-introduction Specialist Group (RSG)
... and massive loss of biodiversity by using re-introductions as a responsible tool for the management and restoration of biodiversity ... need for this role was felt due to the increased demand from re-introduction practitioners, the global conservation community and increase in re-introduction ...
Introduction - Music - Songs and Tracks
... Introduction", by Chicago from The Chicago Transit Authority "Introduction", by Hood from Outside Closer "Introduction", by Kajagoogoo from White Feathers "Introduct ...
Introduction To Metaphysics
... An Introduction to Metaphysics (Introduction à la Métaphysique) is a 1903 essay by Henri Bergson that explores the concept of reality ...
China Miéville - Bibliography - Nonfiction - Introductions To Fiction By Other Authors
... The Borribles An Introduction, 2001 ... Things That Never Happen An Introduction, 2002 ... Wizardry and Wild An Introduction, 2004 ...
John Frame (theologian) - Selected Works
... Introduction to Presuppositional Apologetics Part 2 ... Van Til The Theologian, 1976 ISBN 0-916034-02-X Medical Ethics, 1988 ISBN 0-87552-261-0 Perspectives on the Word of God An ...

Famous quotes containing the word introduction:

    For the introduction of a new kind of music must be shunned as imperiling the whole state; since styles of music are never disturbed without affecting the most important political institutions.
    Plato (c. 427–347 B.C.)

    We used chamber-pots a good deal.... My mother ... loved to repeat: “When did the queen reign over China?” This whimsical and harmless scatological pun was my first introduction to the wonderful world of verbal transformations, and also a first perception that a joke need not be funny to give pleasure.
    Angela Carter (1940–1992)

    The role of the stepmother is the most difficult of all, because you can’t ever just be. You’re constantly being tested—by the children, the neighbors, your husband, the relatives, old friends who knew the children’s parents in their first marriage, and by yourself.
    —Anonymous Stepparent. Making It as a Stepparent, by Claire Berman, introduction (1980, repr. 1986)