# Choosing Ridge Parameter for Regression Problems

@article{Khalaf2005ChoosingRP, title={Choosing Ridge Parameter for Regression Problems}, author={Ghadban Khalaf and Ghazi Shukur}, journal={Communications in Statistics - Theory and Methods}, year={2005}, volume={34}, pages={1177 - 1182} }

ABSTRACT Hoerl and Kennard (1970a) introduced the ridge regression estimator as an alternative to the ordinary least squares estimator in the presence of multicollinearity. In this article, a new approach for choosing the ridge parameter (K), when multicollinearity among the columns of the design matrix exists, is suggested and evaluated by simulation techniques, in terms of mean squared errors (MSE). A number of factors that may affect the properties of these methods have been varied. The MSE…

## 187 Citations

New ridge parameters for ridge regression

- Mathematics
- 2014

Abstract Hoerl and Kennard (1970a) introduced the ridge regression estimator as an alternative to the ordinary least squares (OLS) estimator in the presence of multicollinearity. In ridge regression,…

Some Modifications for Choosing Ridge Parameters

- Mathematics
- 2006

Standard least square regression can produce estimates having a large mean squares error (MSE) when predictor variables are highly correlated or multicollinear. In this article, we propose four…

Ridge Regression and Ill-Conditioning

- Mathematics
- 2014

Hoerl and Kennard (1970) suggested the ridge regression estimator as an alternative to the Ordinary Least Squares (OLS) estimator in the presence of multicollinearity. This article proposes new…

Alternative Method for Choosing Ridge Parameter for Regression

- Engineering
- 2010

The parameter estimation method based on minimum residual sum of squares is unsatisfactory in the presence of multicollinearity. Hoerl and Kennard [1] introduced alternative method called ridge…

Performance of a new ridge regression estimator

- Mathematics
- 2010

Abstract Ridge regression estimator has been introduced as an alternative to the ordinary least squares estimator (OLS) in the presence of multicollinearity. Several studies concerning ridge…

On Comparison of Some Ridge Parameters in Ridge Regression

- Engineering
- 2014

In this article, a new approach to obtain the ridge parameter introduces for the multiple linear regression model suffers from the problem of multicollinearity. Furthermore, we compare the proposed…

A RIDGE REGRESSION ESTIMATION APPROACH WHEN MULTICOLLINEARITY IS PRESENT

- 2016

In regression problems, we usually try to estimate the parameters β in the general linear regression model . u X Y + β = We need a method to estimate the parameter vector . β The most common method…

Modified Ridge Regression Estimators

- Mathematics
- 2013

Ridge regression is a variant of ordinary multiple linear regression whose goal is to circumvent the problem of predictors collinearity. It gives up the Ordinary Least Squares (OLS) estimator as a…

A Comparative Study on the Performance of New Ridge Estimators

- Mathematics
- 2016

Least square estimators in multiple linear regressions under multicollinearity become unstable as they produce large variance for the estimated regression coefficients. Hoerl and Kennard 1970,…

Multicollinearity and A Ridge Parameter Estimation Approach

- Mathematics
- 2016

One of the main goals of the multiple linear regression model, Y = Xβ + u, is to assess the importance of independent variables in determining their predictive ability. However, in practical…

## References

SHOWING 1-9 OF 9 REFERENCES

A Monte Carlo Evaluation of Some Ridge-Type Estimators

- Mathematics
- 1975

Abstract Consider the standard linear model . Ridge regression, as viewed here, defines a class of estimators of indexed by a scalar parameter k. Two analytic methods of specifying k are proposed and…

Ridge Regression: Biased Estimation for Nonorthogonal Problems

- Computer ScienceTechnometrics
- 2000

The ridge trace is introduced is the ridge trace, a method for showing in two dimensions the effects of nonorthogonality, and how to augment X′X to obtain biased estimates with smaller mean square error.

Ridge regression:some simulations

- Mathematics
- 1975

An algorithm is given for selacting the biasing paramatar, k, in RIDGE regrassion. By means of simulaction it is shown that the algorithm has the following properties: (i) it produces an aberaged…

A class of almost unbiased and efficient estimators of regression coefficients

- Mathematics
- 1984

Abstract In this paper we develop a family of approximately unbiased non-linear estimators and show that they are more efficient than OLS as well as improved biased estimators.

Ridge regression: application to non-orthogonal problems

- Tech
- 1970

An almost unbiased estimators

- Sankhya
- 1986

A Monte-Carlo evaluation of some ridge-type

- 1975

1970a). Ridge regression: biased estimation

- 1970