Accéder directement au contenu Accéder directement à la navigation
Pré-publication, Document de travail

Tight conditions for consistency of variable selection in the context of high dimensionality

Laëtitia Comminges 1, 2 Arnak S. Dalalyan 1, 2
2 imagine [Marne-la-Vallée]
LIGM - Laboratoire d'Informatique Gaspard-Monge, CSTB - Centre Scientifique et Technique du Bâtiment, ENPC - École des Ponts ParisTech
Abstract : We address the issue of variable selection in the regression model with very high ambient dimension, \textit{i.e.}, when the number of variables is very large. The main focus is on the situation where the number of relevant variables, called intrinsic dimension and denoted by $d^*$, is much smaller than the ambient dimension $d$. Without assuming any parametric form of the underlying regression function, we get tight conditions making it possible to consistently estimate the set of relevant variables. These conditions relate the intrinsic dimension to the ambient dimension and to the sample size. The procedures that are provably consistent under these tight conditions are simple: they are based on comparing the empirical Fourier coefficients with an appropriately chosen threshold value. The asymptotic analysis reveals the presence of two quite different re\-gimes. The first regime is when $d^*$ is fixed. In this case the situation in nonparametric regression is the same as in linear regression, \textit{i.e.}, consistent variable selection is possible if and only if $\log d$ is small compared to the sample size $n$. The picture is completely different in the second regime, $d^*\to\infty$ as $n\to\infty$, where we prove that consistent variable selection in nonparametric set-up is possible only if $d^*+\log\log d$ is small compared to $\log n$.
Liste complète des métadonnées

https://hal-enpc.archives-ouvertes.fr/hal-00602211
Contributeur : Arnak Dalalyan <>
Soumis le : mardi 21 juin 2011 - 18:03:31
Dernière modification le : mercredi 3 février 2021 - 07:54:25
Archivage à long terme le : : vendredi 9 novembre 2012 - 16:46:31

Fichiers

CoDa_Var_Sel_journal.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-00602211, version 1
  • ARXIV : 1106.4293

Collections

Citation

Laëtitia Comminges, Arnak S. Dalalyan. Tight conditions for consistency of variable selection in the context of high dimensionality. 2011. ⟨hal-00602211v1⟩

Partager

Métriques

Consultations de la notice

136

Téléchargements de fichiers

75