Bias of Estimators and Regularization Terms Noboru Murata

@inproceedings{Murata1998BiasOE,
  title={Bias of Estimators and Regularization Terms Noboru Murata},
  author={Noboru Murata},
  year={1998}
}
In this paper, a role of regularization terms (penalty terms) is discussed from the view point of minimizing the generalization error. First the bias of minimum training error estimation is clariied. The bias is caused by the nonlinearity of the learning system and depends on the number of training examples. Then an appropriate size of the regularization term is considered by taking account of the balance of the bias and the variance of the estimator, so that the generalization error is… CONTINUE READING