Home Home  Article Index Article Index  
GuruPedia  

Least squares

(this article needs work, more content, explanation of the Gauss method)

Least squares is a mathematical optimization technique that attempts to find a "best fit" to a set of data by attempting to minimize the sum of the squares of the differences (called residuals) between the fitted function and the data.

It is commonly used in curve fitting. Many other optimization problems can also be expressed in a least squares form, either minimizing energy or maximizing entropy.

See linear regression and Gauss-Markov theorem. The Gauss-Markov theorem says that least-squares estimators are in a certain sense optimal.

To use the method of least squares we use a function f(x), containing some number of unknown constants (for instance f(x) = mx + b, where m and b are not yet known), and find the values of m and b that minimize the sum of the squares of the residuals (that is, the sum of terms of the form (yif(xi))2). We then have the equation for the curve, y = f(x), of the required form, that best fits the data points (xi, yi).

For linear functions f see linear least squares.

External links

Topics in mathematics related to linear algebra

Vectors | Vector spaces | Linear span | Linear transformation | Linear independence | Linear combination | Basis | Column space | Row space | Dual space | Orthogonality | Eigenvector | Eigenvalue | Least squares regressions | Outer product | Cross product | Dot product | Transpose | Matrix decomposition

Popular Topics

This article is from Wikipedia. All text is available under the terms of the GNU Free Documentation License.  For the live article, click here.

Privacy