The Strong Ergodic Theorem for Densities: Generalized Shannon-McMillan-Breiman Theorem
The Strong Ergodic Theorem for Densities: Generalized Shannon-McMillan-Breiman Theorem
Let $\{X_1, X_2,\cdots\}$ be a stationary process with probability densities $f(X_1, X_2,\cdots, X_n)$ with respect to Lebesgue measure or with respect to a Markov measure with a stationary transition measure. It is shown that the sequence of relative entropy densities $(1/n)\log f(X_1, X_2,\cdots, X_n)$ converges almost surely. This long-conjectured result …