Detection of independent associations in a large epidemiologic dataset: a comparison of random forests, boosted regression trees, conventional and penalized logistic regression for identifying independent factors associated with H1N1pdm influenza infections

Abstract : Background: Big data is steadily growing in epidemiology. We explored the performances of methods dedicated to big data analysis for detecting independent associations between exposures and a health outcome. Methods: We searched for associations between 303 covariates and influenza infection in 498 subjects (14% infected) sampled from a dedicated cohort. Independent associations were detected using two data mining methods, the Random Forests (RF) and the Boosted Regression Trees (BRT); the conventional logistic regression framework (Univariate Followed by Multivariate Logistic Regression -UFMLR) and the Least Absolute Shrinkage and Selection Operator (LASSO) with penalty in multivariate logistic regression to achieve a sparse selection of covariates. We developed permutations tests to assess the statistical significance of associations. We simulated 500 similar sized datasets to estimate the True (TPR) and False (FPR) Positive Rates associated with these methods. Results: Between 3 and 24 covariates (1%-8%) were identified as associated with influenza infection depending on the method. The pre-seasonal haemagglutination inhibition antibody titer was the unique covariate selected with all methods while 266 (87%) covariates were not selected by any method. At 5% nominal significance level, the TPR were 85% with RF, 80% with BRT, 26% to 49% with UFMLR, 71% to 78% with LASSO. Conversely, the FPR were 4% with RF and BRT, 9% to 2% with UFMLR, and 9% to 4% with LASSO. Conclusions: Data mining methods and LASSO should be considered as valuable methods to detect independent associations in large epidemiologic datasets.
Type de document :
Article dans une revue
BMC Medical Research Methodology, BioMed Central, 2014, 14, pp.99. 〈10.3201/eid1610.100516〉
Liste complète des métadonnées

Littérature citée [42 références]  Voir  Masquer  Télécharger

http://www.hal.inserm.fr/inserm-01098222
Contributeur : Christine Dupuis <>
Soumis le : mardi 23 décembre 2014 - 13:03:52
Dernière modification le : mercredi 21 mars 2018 - 18:57:57
Document(s) archivé(s) le : mardi 24 mars 2015 - 10:17:53

Fichier

1471-2288-14-99.pdf
Fichiers éditeurs autorisés sur une archive ouverte

Identifiants

Collections

Citation

Yohann Mansiaux, Fabrice Carrat. Detection of independent associations in a large epidemiologic dataset: a comparison of random forests, boosted regression trees, conventional and penalized logistic regression for identifying independent factors associated with H1N1pdm influenza infections. BMC Medical Research Methodology, BioMed Central, 2014, 14, pp.99. 〈10.3201/eid1610.100516〉. 〈inserm-01098222〉

Partager

Métriques

Consultations de la notice

270

Téléchargements de fichiers

120