Constructing Orthogonal Latent Features for Arbitrary Loss

@inproceedings{Momma2004ConstructingOL,
title={Constructing Orthogonal Latent Features for Arbitrary Loss},
author={Michinari Momma and Kristin P. Bennett},
year={2004}
}

A boosting framework for constructing orthogonal features targeted to a given loss function is developed. Combined with techniques from spectral methods such as PCA and PLS, an orthogonal boosting algorithm for linear hypothesis is used to efficiently construct orthogonal latent features selected to optimize the given loss function. The method is generalized to construct orthogonal nonlinear features using the kernel trick. The resulting method, Boosted Latent Features (BLF) is demonstrated to… CONTINUE READING