Random Naive Bayes and Random Forest
Generalizing Random Forest to Naive Bayes, Random Naive Bayes (Random NB), is a bagged classifier combining a forest of B Naive Bayes. Each bth Naive Bayes is estimated on a bootstrap sample Sb with m randomly selected features. To classify an observation put the input vector down the B Naive Bayes in the forest. Each Naive Bayes generates posterior class probabilities. Unlike Random Forest, the predicted class of the ensemble is assessed by adjusted majority voting rather than majority voting, as each bth Naive Bayes delivers continuous posterior probabilities. Similar to Random Forests, the importance of each feature is estimated on the out-of-bag (oob) data.
Read more about this topic: Random Naive Bayes
Famous quotes containing the words random, naive and/or forest:
“There is a potential 4-6 percentage point net gain for the President [George Bush] by replacing Dan Quayle on the ticket with someone of neutral stature.”
—Mary Matalin, U.S. Republican political advisor, author, and James Carville b. 1946, U.S. Democratic political advisor, author. All’s Fair: Love, War, and Running for President, p. 205, Random House (1994)
“The naive notion that a mother naturally acquires the complex skills of childrearing simply because she has given birth now seems as absurd to me as enrolling in a nine-month class in composition and imagining that at the end of the course you are now prepared to begin writing War and Peace.”
—Mary Kay Blakely (20th century)
“Nature herself has not provided the most graceful end for her creatures. What becomes of all these birds that people the air and forest for our solacement? The sparrow seems always chipper, never infirm. We do not see their bodies lie about. Yet there is a tragedy at the end of each one of their lives. They must perish miserably; not one of them is translated. True, “not a sparrow falleth to the ground without our Heavenly Father’s knowledge,” but they do fall, nevertheless.”
—Henry David Thoreau (1817–1862)