Skip to Main content Skip to Navigation
Conference papers

Parsimonious additive logistic models

Marta Avalos 1, *
Abstract : Logistic regression is a standard tool in statistics for binary classification. The logistic model relates the logarithm of the odds-ratio to the predictors via a linear regression model. A generalization is the additive logistic model, which replaces each linear term by an unspecified smooth function, allowing for more flexibility while preserving interpretability. Another variant is penalized logistic regression, which shrinks coefficients to improve the accuracy of prediction. Ridge regression (L2-penalization) and lasso (L1-penalization) are the main penalization procedures. An attractive property of the later is that it performs parameter estimation and variable selection simultaneously. New theoretical results, efficient algorithms, and available software play a major role in the recent popularization of lasso. In this study, L1-penalization is adapted to additive logistic regression fitted by smoothing splines. Coefficients associated to predictors. Coefficients associated to predictors with little effect on the response may be shrunk (some of them to zero). This approach gives parsimonious models, removes irrelevant variables, and identifies non linear trends. The estimates are computed via the usual Newton-Raphson update, combined with the lars-lasso algorithm, to resolve the penalization problem, and the backfitting algorithm to fit additive models. Different criteria based on the effective degrees of freedom are proposed to choose the penalization parameters. Performance is illustrated with some examples.
Complete list of metadatas

https://www.hal.inserm.fr/inserm-00402444
Contributor : Marta Avalos <>
Submitted on : Tuesday, July 7, 2009 - 1:51:59 PM
Last modification on : Wednesday, November 29, 2017 - 2:53:55 PM
Long-term archiving on: : Tuesday, June 15, 2010 - 7:39:39 PM

Files

Parsimonious_additive_log.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : inserm-00402444, version 1

Collections

Citation

Marta Avalos. Parsimonious additive logistic models. First Workshop of the ERCIM Working Group on Computing & Statistics, Jun 2008, Neuchâtel, Switzerland. page 56. ⟨inserm-00402444⟩

Share

Metrics

Record views

161

Files downloads

641