# Transfer learning of regression models from a sequence of datasets by penalized estimation.

@article{Wieringen2020TransferLO, title={Transfer learning of regression models from a sequence of datasets by penalized estimation.}, author={Wessel N. van Wieringen and Harald Binder}, journal={arXiv: Methodology}, year={2020} }

Transfer learning refers to the promising idea of initializing model fits based on pre-training on other data. We particularly consider regression modeling settings where parameter estimates from previous data can be used as anchoring points, yet may not be available for all parameters, thus covariance information cannot be reused. A procedure that updates through targeted penalized estimation, which shrinks the estimator towards a nonzero value, is presented. The parameter estimate from the…

## One Citation

Package ‘porridge’

- Mathematics
- 2022

Maintainer Wessel N. van Wieringen <w.vanwieringen@vumc.nl> Description The name of the package is derived from the French, 'pour' ridge, and provides functionality for ridge-type estimation of a…

## References

SHOWING 1-10 OF 24 REFERENCES

Updating of the Gaussian graphical model through targeted penalized estimation

- MathematicsJ. Multivar. Anal.
- 2020

A General Class of Transfer Learning Regression without Implementation Cost

- Computer ScienceAAAI
- 2021

A novel framework that unifies and extends existing methods of transfer learning (TL) for regression by introducing a density-ratio reweighting function, which is estimated through the Bayesian framework with a specific prior distribution.

A Survey on Transfer Learning

- Computer ScienceIEEE Transactions on Knowledge and Data Engineering
- 2010

The relationship between transfer learning and other related machine learning techniques such as domain adaptation, multitask learning and sample selection bias, as well as covariate shift are discussed.

Ridge Estimators in Logistic Regression

- Computer Science
- 1992

It is shown how ridge estimators can be used in logistic regression to improve the parameter estimates and to diminish the error made by further predictions and to predict new observations more accurately.

On Robustness in the Logistic Regression Model

- Mathematics
- 1993

SUMMARY We investigate robustness in the logistic regression model. Copas has studied two forms of robust estimator: a robust-resistant estimate of Pregibon and an estimate based on a…

Ridge Regression: Biased Estimation for Nonorthogonal Problems

- MathematicsTechnometrics
- 2000

The ridge trace is introduced is the ridge trace, a method for showing in two dimensions the effects of nonorthogonality, and how to augment X′X to obtain biased estimates with smaller mean square error.

Online Learning and Online Convex Optimization

- Computer ScienceFound. Trends Mach. Learn.
- 2012

A modern overview of online learning is provided to give the reader a sense of some of the interesting ideas and in particular to underscore the centrality of convexity in deriving efficient online learning algorithms.

An Explicit Solution for Generalized Ridge Regression

- Mathematics
- 1975

The general form of ridge regression proposed by Hoerl and Kennard is examined in the context of the iterative procedure they suggest for obtaining optimal estimators. It is shown that a…

Linear Mixed Models for Longitudinal Data

- Computer ScienceTechnometrics
- 2001

This book provides a comprehensive treatment of linear mixed models for continuous longitudinal data and attempts to target applied statisticians and biomedical researchers in industry, public health organizations, contract research organizations, and academia.