Local Regression - Degree of Local Polynomials

Degree of Local Polynomials

The local polynomials fit to each subset of the data are almost always of first or second degree; that is, either locally linear (in the straight line sense) or locally quadratic. Using a zero degree polynomial turns LOESS into a weighted moving average. Such a simple local model might work well for some situations, but may not always approximate the underlying function well enough. Higher-degree polynomials would work in theory, but yield models that are not really in the spirit of LOESS. LOESS is based on the ideas that any function can be well approximated in a small neighborhood by a low-order polynomial and that simple models can be fit to data easily. High-degree polynomials would tend to overfit the data in each subset and are numerically unstable, making accurate computations difficult.

Read more about this topic:  Local Regression

Famous quotes containing the words degree of, degree and/or local:

    Crude men who feel themselves insulted tend to assess the degree of insult as high as possible, and talk about the offense in greatly exaggerated language, only so they can revel to their heart’s content in the aroused feelings of hatred and revenge.
    Friedrich Nietzsche (1844–1900)

    O, when degree is shaked,
    Which is the ladder to all high designs,
    The enterprise is sick.
    William Shakespeare (1564–1616)

    Back now to autumn, leaving the ended husk
    Of summer that brought them here for Show Saturday
    The men with hunters, dog-breeding wool-defined women,
    Children all saddle-swank, mugfaced middleaged wives
    Glaring at jellies, husbands on leave from the garden
    Watchful as weasels, car-tuning curt-haired sons
    Back now, all of them, to their local lives....
    Philip Larkin (1922–1986)