Nonconcave penalized likelihood with a diverging number of parameters

Type: Article

Publication Date: 2004-05-27

Citations: 988

DOI: https://doi.org/10.1214/009053604000000256

Abstract

A class of variable selection procedures for parametric models via nonconcave penalized likelihood was proposed by Fan and Li to simultaneously estimate parameters and select important variables. They demonstrated that this class of procedures has an oracle property when the number of parameters is finite. However, in most model selection problems the number of parameters should be large and grow with the sample size. In this paper some asymptotic properties of the nonconcave penalized likelihood are established for situations in which the number of parameters tends to \infty as the sample size increases. Under regularity conditions we have established an oracle property and the asymptotic normality of the penalized likelihood estimators. Furthermore, the consistency of the sandwich formula of the covariance matrix is demonstrated. Nonconcave penalized likelihood ratio statistics are discussed, and their asymptotic distributions under the null hypothesis are obtained by imposing some mild conditions on the penalty functions.

Locations

  • The Annals of Statistics - View - PDF
  • DataCite API - View

Similar Works

Action Title Year Authors
+ Combined-penalized likelihood estimations with a diverging number of parameters 2014 Ying Dong
Lixin Song
Mingqiu Wang
Ying Xu
+ Combined-penalized likelihood estimations with a diverging number of parameters 2014 Ying Dong
Lixin Song
Mingqiu Wang
Ying Xu
+ Combined-penalized likelihood estimations with a diverging number of parameters 2013 Ying Dong
Lixin Song
Mingqiu Wang
Ying Xu
+ NONCONCAVE PENALIZED M-ESTIMATION WITH A DIVERGING NUMBER OF PARAMETERS 2011 Gaorong Li
Heng Peng
Lixing Zhu
+ Variable selection of diverging number of parameters under combined penalized likelihood estimations 2015 Dong Yin
+ Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties 2001 Jianqing Fan
Runze Li
+ AIC for Non-concave Penalized Likelihood Method 2015 Yuta Umezu
Yusuke Shimizu
H. Masuda
Yoshiyuki Ninomiya
+ Penalized composite quantile estimation for censored regression model with a diverging number of parameters 2016 Huilan Liu
Hu Yang
+ Variable selection under multicollinearity using modified log penalty 2019 Van Cuong Nguyen
Chi Tim Ng
+ Regularization for Cox’s proportional hazards model with NP-dimensionality 2011 Jelena Bradić
Jianqing Fan
Jiancheng Jiang
+ Variable selection for general transformation models with right censored data via nonconcave penalties 2012 Jianbo Li
Minggao Gu
Riquan Zhang
+ PDF Chat Penalized Composite Quasi-Likelihood for Ultrahigh Dimensional Variable Selection 2011 Jelena Bradić
Jianqing Fan
Weiwei Wang
+ SCAD-Ridge Penalized Likelihood Estimators for Ultra-high Dimensional Models 2016 Ying Dong
Lixin Song
Muhammad Amin
+ Variable selection in high dimensional semi-varying coefficient models 2013 Chi Chen
+ Penalized high-dimensional empirical likelihood 2010 Cheng Yong Tang
Chenlei Leng
+ On the Consistency of the Bias Correction Term of the AIC for the Non-Concave Penalized Likelihood Method 2016 Yuta Umezu
Yoshiyuki Ninomiya
+ Variable Selection in Semiparametric Quantile Modeling for Longitudinal Data 2014 Kangning Wang
Lu Lin
+ An Extensive Simulation Study for Evaluation of Penalized Variable Selection Methods in Logistic Regression Model with High Dimensional Data 2024 Nuriye Sancar
Ayad Bacar
+ PDF Chat AIC for the non-concave penalized likelihood method 2018 Yuta Umezu
Yusuke Shimizu
H. Masuda
Yoshiyuki Ninomiya
+ PDF Chat Nonparametric screening under conditional strictly convex loss for ultrahigh dimensional sparse data 2019 Xu Han