A penalized maximum likelihood approach to sparse factor analysis

Jang Choi, Gary W. Oehlert, Hui Zou

Type: Article

Publication Date: 2010-01-01

Citations: 59

DOI: https://doi.org/10.4310/sii.2010.v3.n4.a1

Abstract

Factor analysis is a popular multivariate analysis method which is used to describe observed variables as linear combinations of hidden factors.In applications one usually needs to rotate the estimated factor loading matrix in order to obtain a more understandable model.In this article, an 1 penalization method is introduced for performing sparse factor analysis in which factor loadings naturally adopt a sparse representation, greatly facilitating the interpretation of the fitted factor model.A generalized expectationmaximization algorithm is developed for computing the 1 penalized estimator.Efficacy of the proposed methodology and algorithm is demonstrated by simulated and real data.

Locations

Statistics and Its Interface - View - PDF

Similar Works

Action	Title	Year	Authors
+ PDF Chat	Approximated Penalized Maximum Likelihood for Exploratory Factor Analysis: An Orthogonal Case	2018	Shaobo Jin Irini Moustaki Fan Yang‐Wallentin
+ PDF Chat	Sparse estimation via nonconcave penalized likelihood in factor analysis model	2014	Kei Hirose Michio Yamamoto
+	Sparse estimation via nonconcave penalized likelihood in a factor analysis model	2012	Kei Hirose Michio Yamamoto
+	Estimation of oblique structure via penalized likelihood factor analysis	2013	Kei Hirose Michio Yamamoto
+ PDF Chat	Estimation of an oblique structure via penalized likelihood factor analysis	2014	Kei Hirose Michio Yamamoto
+ PDF Chat	Probabilistic penalized principal component analysis	2017	Chongsun Park Morgan C. Wang Eun Bi Mo
+	Penalized maximum likelihood factor analysis.	2010	Jang Hoon Choi
+	Approximated Penalized Maximum Likelihood for Exploratory Factor Analysis	2015	Shaobo Jin Irini Moustaki Fan Yang‐Wallentin
+ PDF Chat	Two-Stage Procrustes Rotation with Sparse Target Matrix and Least Squares Criterion with Regularization and Generalized Weighting	2023	Naoto Yamashita
+	Sparse factor regression via penalized maximum likelihood estimation	2016	Kei Hirose Miyuki Imada
+	Efficient estimation of approximate factor models via penalized maximum likelihood	2015	Jushan Bai Yuan Liao
+	Approximated Penalized Maximum Likelihood for Exploratory Factor Analysis : A Simulation Study of an Orthogonal Case	2015	Shaobo Jin Irini Moustaki Fan Yang‐Wallentin
+ PDF Chat	Sparse principal component regression with adaptive loading	2015	Shuichi Kawano Hironori Fujisawa Toyoyuki Takada Toshihiko Shiroishi
+	Simple structure estimation via prenet penalization	2016	Kei Hirose Yoshikazu Terada
+ PDF Chat	A unified framework of principal component analysis and factor analysis	2024	Shifeng Xiong
+ PDF Chat	Sparse principal component analysis with measurement errors	2016	Jianhong Shi Weixing Song
+	Simultaneous variable and factor selection via sparse group lasso in factor analysis	2019	Yuanchu Dang Qing Wang
+ PDF Chat	A Guide for Sparse PCA: Model Comparison and Applications	2021	Rosember Guerra–Urzola Katrijn Van Deun Juan C. Vera Klaas Sijtsma
+	Penalized Versus Constrained Generalized Eigenvalue Problems	2017	Irina Gaynanova James G. Booth Martin T. Wells
+ PDF Chat	Single- and Multiple-Group Penalized Factor Analysis: A Trust-Region Algorithm Approach with Integrated Automatic Multiple Tuning Parameter Selection	2021	Elena Geminiani Giampiero Marra Irini Moustaki

Works That Cite This (38)

Action	Title	Year	Authors
+ PDF Chat	A Deep Learning Algorithm for High-Dimensional Exploratory Item Factor Analysis	2021	Christopher J. Urban Daniel J. Bauer
+	Sparse factor regression via penalized maximum likelihood estimation	2016	Kei Hirose Miyuki Imada
+	Which Method is More Reliable in Performing Model Modification: Lasso Regularization or Lagrange Multiplier Test?	2020	Ke‐Hai Yuan Fang Liu
+	Interpretable Sparse Proximate Factors for Large Dimensions	2018	Markus Pelger Ruoxuan Xiong
+	Estimation of oblique structure via penalized likelihood factor analysis	2013	Kei Hirose Michio Yamamoto
+	Simple structure estimation via prenet penalization	2016	Kei Hirose Yoshikazu Terada
+	Statistical Analysis of Complex Data in Survival and Event History Analysis	2020	Hok Kan Ling
+	Mediation analysis with latent factors using simultaneous group‐wise and parameter‐wise penalization	2023	Xizhen Cai Qing Wang Yeying Zhu
+	Sparse principal component regression for generalized linear models	2018	Shuichi Kawano Hironori Fujisawa Toyoyuki Takada Toshihiko Shiroishi
+ PDF Chat	Covariance structure estimation with Laplace approximation	2023	Bongjung Sung Jaeyong Lee

Works Cited by This (11)

Action	Title	Year	Authors
+	On Use of the Em Algorithm for Penalized Likelihood Estimation	1990	Peter J. Green
+ PDF Chat	The Adaptive Lasso and Its Oracle Properties	2006	Hui Zou
+	Maximum Likelihood from Incomplete Data Via the <i>EM</i> Algorithm	1977	A. P. Dempster N. M. Laird Donald B. Rubin
+ PDF Chat	Least angle regression	2004	Bradley Efron Trevor Hastie Iain M. Johnstone Robert Tibshirani
+	Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties	2001	Jianqing Fan Runze Li
+	EM algorithms for ML factor analysis	1982	Donald B. Rubin Dorothy T. Thayer
+	Applied Multivariate Statistical Analysis.	1988	Andrea Johnson Dean W. Wichern
+	Regression Shrinkage and Selection Via the Lasso	1996	Robert Tibshirani
+	A Selective Overview of Variable Selection in High Dimensional Feature Space.	2010	Jianqing Fan Jinchi Lv
+ PDF Chat	Least angle and ℓ1 penalized regression: A review	2008	Tim Hesterberg Nam Hee Choi Lukas Meier Chris Fraley