Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Regulating Newton-Raphson's Method by Unconstrained Minimization of a Weighted Sum of Squared Residuals

Published

Author(s)

D M. Lorenzetti

Abstract

To control the Newton-Raphson solution of a nonlinear algebraic system, a descent method forces each step to reduce some norm of the residual errors. This prevents divergence, but risks stagnation in flat regions of the norm. Employing a family of cost functions -- here a weighted sum of squaredresiduals -- allows a solver, in principle, to avoid all minima except at the desired solution. Geometric arguments suggest several rules for choosing weights, and numerical experiments show these improve the global convergence of a representative method, provided the weights incorporate sufficient information from the residual models at each iteration. The technique extends to otherminimization based equation solvers, either directly, or through its interpretation as a means of automatically rescaling the residuals.
Citation
Siam Journal on Scientific Computing

Keywords

indefinite dogleg, Newton-Raphson, nonlinear system, scaling, trust region

Citation

Lorenzetti, D. (2017), Regulating Newton-Raphson's Method by Unconstrained Minimization of a Weighted Sum of Squared Residuals, Siam Journal on Scientific Computing (Accessed July 19, 2024)

Issues

If you have any questions about this publication or are having problems accessing it, please contact reflib@nist.gov.

Created February 19, 2017