Mutual information of the white Gaussian channel with and without feedback
- 1 July 1971
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 17 (4), 368-371
- https://doi.org/10.1109/tit.1971.1054670
Abstract
The following model for the white Gaussian channel with or without feedback is considered: begin{equation} Y(t) = int_o ^{t} phi (s, Y_o ^{s} ,m) ds + W(t) end{equation} wheremdenotes the message,Y(t)denotes the channel output at timet,Y_o ^ {t}denotes the sample pathY(theta), 0 leq theta leq t. W(t)is the Brownian motion representing noise, andphi(s, y_o ^ {s} ,m)is the channel input (modulator output). It is shown that, under some general assumptions, the amount of mutual informationI(Y_o ^{T} ,m)between the messagemand the output pathY_o ^ {T}is directly related to the mean-square causal filtering error of estimatingphi (t, Y_o ^{t} ,m)from the received dataY_o ^{T} , 0 leq t leq T. It follows, as a corollary to the result forI(Y_o ^ {T} ,m), that feedback can not increase the capacity of the nonband-limited additive white Gaussian noise channel.Keywords
This publication has 9 references indexed in Scilit:
- Absolute Continuity and Radon-Nikodym Derivatives for Certain Measures Relative to Wiener MeasureThe Annals of Mathematical Statistics, 1971
- On the Calculation of Mutual InformationSIAM Journal on Applied Mathematics, 1970
- A further note on a general likelihood formula for random signals in Gaussian noiseIEEE Transactions on Information Theory, 1970
- Conditions for absolute continuity between a certain pair of probability measuresProbability Theory and Related Fields, 1970
- A general likelihood-ratio formula for random signals in Gaussian noiseIEEE Transactions on Information Theory, 1969
- Optimum estimation of nonstationary Gaussian signals in noiseIEEE Transactions on Information Theory, 1969
- Radon-Nikodym Derivatives of Gaussian MeasuresThe Annals of Mathematical Statistics, 1966
- The oscillation of stochastic integralsProbability Theory and Related Fields, 1965
- The zero error capacity of a noisy channelIEEE Transactions on Information Theory, 1956