Blind Minimax Estimation

Type: Article

Publication Date: 2007-08-29

Citations: 29

DOI: https://doi.org/10.1109/tit.2007.903118

Abstract

We consider the linear regression problem of estimating an unknown, deterministic parameter vector based on measurements corrupted by colored Gaussian noise. We present and analyze blind minimax estimators (BMEs), which consist of a bounded parameter set minimax estimator, whose parameter set is itself estimated from measurements. Thus, our approach does not require any prior assumption or knowledge, and the proposed estimator can be applied to any linear regression problem. We demonstrate analytically that the BMEs strictly dominate the least-squares (LS) estimator, i.e., they achieve lower mean-squared error (MSE) for any value of the parameter vector. Both Stein's estimator and its positive-part correction can be derived within the blind minimax framework. Furthermore, our approach can be readily extended to a wider class of estimation problems than Stein's estimator, which is defined only for white noise and nontransformed measurements. We show through simulations that the BMEs generally outperform previous extensions of Stein's technique.

Locations

  • arXiv (Cornell University) - View - PDF
  • DataCite API - View
  • IEEE Transactions on Information Theory - View

Similar Works

Action Title Year Authors
+ Blind minimax estimators: improving on least-squares estimation 2005 Zvika Ben-Haim
Yonina C. Eldar
+ Minimax Estimators Dominating the Least-Squares Estimator 2006 Zvika Ben-Haim
Yonina C. Eldar
+ A min-min approach to non-blind and blind parameter estimation under admissibility and domination constraints 2016 Can Bikcora
S. Weiland
+ Minimax Estimation 2005 James O. Berger
+ Minimum Variance Unbiased Estimation 2018 Pierre Moulin
Venugopal V. Veeravalli
+ Constrained Best Linear Unbiased Estimation 2017 Oliver Lang
Mario Huemer
Markus Steindl
+ Minimum-Variance Unbiased Estimation 2017 S. D. Silvey
+ Least - Squares Estimation Methods 1978 J. A. R. Blais
+ Minimax estimation in the linear model with a relative squared error 2003 Maciej Wilczyński
+ PDF Chat Signal-to-noise ratio aware minimax analysis of sparse linear regression 2025 S. Ghosh
Yilin Guo
Haolei Weng
Arian Maleki
+ Estimation Theory 2014 R. Doraiswami
Chris Diduch
M. Stevenson
+ The Optimality of Linear Estimation Algorithms in Minimax Identification 2004 K. V. Semenikhin
+ Minimax estimation of a bounded squared mean 1992 Jianqing Fan
Irène Gijbels
+ Minimax-Linear Estimation under Incorrect Prior Information 1984 Helge Toutenburg
+ Maximum set estimators with bounded estimation error 2005 Zvika Ben-Haim
Yonina C. Eldar
+ A Tutorial on Linear Least Square Estimation 2022 Qingrui Zhang
+ Best linear estimation via minimization of relative mean squared error 2017 Lin Su
Howard D. Bondell
+ Estimation 1983
+ Least Squares, Parameter Estimation, and Correlation 2014
+ PDF Chat Learning to Estimate Without Bias 2023 Tzvi Diskin
Yonina C. Eldar
Ami Wiesel