Wolfe Conditions - Strong Wolfe Condition On Curvature

Strong Wolfe Condition On Curvature

The Wolfe conditions, however, can result in a value for the step length that is not close to a minimizer of . If we modify the curvature condition to the following,

iia)

then i) and iia) together form the so-called strong Wolfe conditions, and force to lie close to a critical point of .

The principal reason for imposing the Wolfe conditions in an optimization algorithm where is to ensure convergence of the gradient to zero. In particular, if the cosine of the angle between and the gradient,

is bounded away from zero and the i) and ii) hold, then .

An additional motivation, in the case of a quasi-Newton method is that if, where the matrix is updated by the BFGS or DFP formula, then if is positive definite ii) implies is also positive definite.

Read more about this topic:  Wolfe Conditions

Famous quotes containing the words condition, strong and/or wolfe:

    ... solitude is such a potential thing. We hear voices in solitude, we never hear in the hurry and turmoil of life; we receive counsels and comforts, we get under no other condition ...
    Amelia E. Barr (1831–1919)

    Usually, when people talk about the “strength” of black women they are referring to the way in which they perceive black women coping with oppression. They ignore the reality that to be strong in the face of oppression is not the same as overcoming oppression, that endurance is not to be confused with transformation.
    bell hooks (b. c. 1955)

    His bill’s so yellow,
    his coat’s so black,
    that he makes a fellow
    whistle back.
    —Humbert Wolfe (1885–1940)