In optimization, the line search strategy is one of two basic iterative approaches to finding a local minimum of an objective function . The other approach is trust region.
The line search approach first finds a descent direction along which the objective function will be reduced and then computes a step size that decides how far should move along that direction. The descent direction can be computed by various methods, such as gradient descent, Newton's method and Quasi-Newton method. The step size can be determined either exactly or inexactly.
Other articles related to "search, line search":
... In the latter case the search space is typically a function space, and one calculates the Gâteaux derivative of the functional to be minimized to determine the descent direction ... The gradient descent can be combined with a line search, finding the locally optimal step size on every iteration ... Performing the line search can be time-consuming ...
... methods of dividing the interval, golden section search is particularly simple and effective, as the interval proportions are preserved regardless of how the search proceeds where ...
Famous quotes containing the words search and/or line:
“When a person doesnt understand something, he feels internal discord: however he doesnt search for that discord in himself, as he should, but searches outside of himself. Thence a war develops with that which he doesnt understand.”
—Anton Pavlovich Chekhov (18601904)
“What, will the line stretch out to the crack of doom?”
—William Shakespeare (15641616)