Large-sample properties of unsupervised estimation of the linear discriminant using projection pursuit

Type: Article

Publication Date: 2021-01-01

Citations: 3

DOI: https://doi.org/10.1214/21-ejs1956

Abstract

We study the estimation of the linear discriminant with projection pursuit, a method that is blind in the sense that it does not use the class labels in the estimation. Our viewpoint is asymptotic and, as our main contribution, we derive central limit theorems for estimators based on three different projection indices, skewness, kurtosis and their convex combination. The results show that in each case the limiting covariance matrix is proportional to that of linear discriminant analysis (LDA), an unblind estimator of the discriminant. An extensive comparative study between the asymptotic variances reveals that projection pursuit is able to achieve efficiency equal to LDA when the groups are arbitrarily well-separated and their sizes are reasonably balanced. We conclude with a real data example and a simulation study investigating the validity of the obtained asymptotic formulas for finite samples.

Locations

  • arXiv (Cornell University) - View - PDF
  • Jyväskylä University Digital Archive (University of Jyväskylä) - View - PDF
  • UTUPub (University of Turku) - View - PDF
  • DataCite API - View
  • Electronic Journal of Statistics - View - PDF

Similar Works

Action Title Year Authors
+ Large-Sample Properties of Blind Estimation of the Linear Discriminant Using Projection Pursuit 2021 Una Radojičić
Klaus Nordhausen
Joni Virta
+ Robust linear discriminant analysis with a Laplacian assumption on projection distribution 2017 Shujian Yu
Zheng Cao
Xiubao Jiang
+ Projection-pursuit approach to robust linear discriminant analysis 2010 Ana M. Pires
João A. Branco
+ High breakdown estimators for principal components: the projection-pursuit approach revisited 2004 Christophe Croux
Anne Ruiz‐Gazen
+ PDF Chat Divergence Maximizing Linear Projection for Supervised Dimension Reduction 2025 Biao Chen
Joshua Kortje
+ PDF Chat Divergence Maximizing Linear Projection for Supervised Dimension Reduction 2024 Biao Chen
Joshua Kortje
+ Kurtosis-based projection pursuit for matrix-valued data 2021 Una Radojičić
Klaus Nordhausen
Joni Virta
+ Kurtosis-based projection pursuit for matrix-valued data 2021 Una Radojičić
Klaus Nordhausen
Joni Virta
+ PDF Chat Assessment of Projection Pursuit Index for Classifying High Dimension Low Sample Size Data in R 2023 Zhaoxing Wu
Chunming Zhang
+ Pivotal Estimation of Linear Discriminant Analysis in High Dimensions 2023 Ethan X. Fang
Yajun Mei
Yuyang Shi
Qunzhi Xu
Tuo Zhao
+ A Density Distance Based Approach to Projection Pursuit Discriminant Analysis 1998 Laura Lizzani
+ Asymptotic Performance of Linear Discriminant Analysis with Random Projections 2019 Khalil Elkhalil
Abla Kammoun
Robert Calderbank
Tareq Y. Al-Naffouri
Mohamed‐Slim Alouini
+ Projection-Pursuit Based Principal Component Analysis: a Large Sample Theory 2006 Jian Zhang
+ PDF Chat A comparison of robust linear discriminant procedures using projection pursuit methods 1994 Zen-Yi Chen
Robb J. Muirhead
+ High breakdown estimators for principal components: the projections-pursuit approach revisited 2005 Anne Ruiz‐Gazen
C. Croux
+ Robust Linear Discriminant Analysis and the Projection Pursuit Approach 2003 Ana M. Pires
+ Supervised projection pursuit – A dimensionality reduction technique optimized for probabilistic classification 2019 Andrei Barcaru
+ PDF Chat Regularized Discriminant Analysis: A Large Dimensional Study 2018 Xiaoke Yang
Khalil Elkhalil
Abla Kammoun
Tareq Y. Al-Naffouri
Mohamed‐Slim Alouini
+ Projection Pursuit Discriminant Analysis 1993 Jörg Polzehl
+ Asymptotic properties of correlation-based principal component analysis 2021 Jungjun Choi
Xiye Yang