Asymptotically Efficient Estimation of Covariance Matrices with Linear Structure

Type: Article

Publication Date: 1973-01-01

Citations: 257

DOI: https://doi.org/10.1214/aos/1193342389

Abstract

One or more observations are made on a random vector, whose covariance matrix may be a linear combination of known symmetric matrices and whose mean vector may be a linear combination of known vectors; the coefficients of the linear combinations are unknown parameters to be estimated. Under the assumption of normality, equations are developed for the maximum likelihood estimates. These equations may be solved by an iterative method; in each step a set of linear equations is solved. If consistent estimates of $\sigma_0, \sigma_1, \cdots, \sigma_m$ are used to obtain the coefficients of the linear equations, the solution of these equations is asymptotically efficient as the number of observations on the random vector tends to infinity. This result is a consequence of a theorem that the solution of the generalized least squares equations is asymptotically efficient if a consistent estimate of the covariance matrix is used. Applications are made to the components of variance model in the analysis of variance and the finite moving average model in time series analysis.

Locations

  • The Annals of Statistics - View - PDF

Similar Works

Action Title Year Authors
+ Covariance Matrix Estimation 1999 Matthew J. Cushing
Mary G. McGarvey
+ PDF Chat Consistent autoregressive spectral estimates: Nonlinear time series and large autocovariance matrices 2020 Jiang Wang
Dimitris N. Politis
+ Efficient Estimation of Multivariate Moving Average Autocovariances 1980 H. Joseph Newton
+ Asymptotic normality of least squares estimators in autoregressive linear regression models 1982 B.B. van der Genugten
+ Asymptotic normality of least squares estimators in autoregressive linear regression models 1985 B.B. van der Genugten
+ Efficient estimation in the linear simultaneous equations model with vector autoregressive disturbances 1998 Darrell A. Turkington
+ Linear Stochastic Models with Finite Numbers of Parameters 1994 T. W. Anderson
+ Random matrices and covariance estimation 2019 Martin J. Wainwright
+ A fast algorithm for the exact likelihood of stationary and partially nonstationary vector autoregressive-moving average processes 1994 Alberto Luceño
+ A Fast Algorithm for the Exact Likelihood of Stationary and Partially Nonstationary Vector Autoregressive-Moving Average Processes 1994 Alberto Luceño
+ Asymptotic Normality of Autoregressive Processes 2009 Yu Miao
+ PDF Chat Joint convergence of sample autocovariance matrices when $p/n\to 0$ with application 2019 Monika Bhattacharjee
Arup Bose
+ Limit Theorems for Sample Covariances of Stationary Linear Processes with Applications to Sequential Estimation 1997 Issa Fakhre-Zakeri
Jamshid Farshidi
+ Sample Covariance Matrices 2020 Marc Potters
Jean‐Philippe Bouchaud
+ Asymptotic Covariance Matrix of Procedures for Linear Regression in the Presence of First-Order Autoregressive Disturbances 1972 Joel Cooper
+ Efficient Estimation of Linear Regression Models With Autocorrelated Errors 1977 Mathew J. Morey
+ Asymptotic variance–covariance matrices for the linear structural model 2011 Jonathan Gillard
+ PDF Chat High-dimensional autocovariance matrices and optimal linear prediction 2015 Timothy L. McMurry
Dimitris N. Politis
+ Efficient Mean Estimation in Log-normal Linear Models with First-order Correlated Errors 2013 Zhang
Сонг
Wang
Dehui
+ PDF Chat Covariance Matrix Estimation in Time Series 2012 Wei Biao Wu
Xiao Han