Mutual Information and Minimum Mean-Square Error in Gaussian Channels
Mutual Information and Minimum Mean-Square Error in Gaussian Channels
This paper deals with arbitrarily distributed finite-power input signals observed through an additive Gaussian noise channel. It shows a new formula that connects the input-output mutual information and the minimum mean-square error (MMSE) achievable by optimal estimation of the input given the output. That is, the derivative of the mutual …