Regularization methods for additive models

Abstract : This paper tackles the problem of model complexity in the context of additive models. Several methods have been proposed to estimate smoothing parameters, as well as to perform variable selection. However, these procedures are inefficient or computationally expensive in high dimension. To answer this problem, the lasso technique has been adapted to additive models, but its experimental performance has not been analyzed. We propose a modified lasso for additive models, performing variable selection. A benchmark is developed to examine its practical behavior, comparing it with forward selection. Our simulation studies suggest ability to carry out model selection of the proposed method. The lasso technique shows up better than forward selection in the most complex situations. The computing time of modified lasso is considerably smaller since it does not depend on the number of relevant variables.
Complete list of metadatas

Cited literature [17 references]  Display  Hide  Download

https://www.hal.inserm.fr/inserm-00149855
Contributor : Marta Avalos <>
Submitted on : Tuesday, May 29, 2007 - 5:23:10 PM
Last modification on : Wednesday, July 4, 2018 - 4:44:02 PM
Long-term archiving on : Thursday, April 8, 2010 - 6:06:00 PM

Identifiers

  • HAL Id : inserm-00149855, version 1

Collections

Citation

Marta Avalos, Yves Grandvalet, Christophe Ambroise. Regularization methods for additive models. 2003, pp.509-520. ⟨inserm-00149855⟩

Share

Metrics

Record views

213

Files downloads

551