Duality between channel capacity and rate distortion with two-sided state information
- 7 August 2002
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 48 (6), 1629-1638
- https://doi.org/10.1109/tit.2002.1003843
Abstract
We show that the duality between channel capacity and data compression is retained when state information is available to the sender, to the receiver, to both, or to neither. We present a unified theory for eight special cases of channel capacity and rate distortion with state information, which also extends existing results to arbitrary pairs of independent and identically distributed (i.i.d.) correlated state information (S/sub 1/, S/sub 2/) available at the sender and at the receiver, respectively. In particular, the resulting general formula for channel capacity C = max/sub p/(u,x|s/sub 1/) [I(U; S/sub 2/, Y) I(U; S/sub 1/)] assumes the same form as the generalized Wyner-Ziv (1976) rate distortion function R(D) = min/sub p/(u|x, s/sub 1/)p(x/spl I.cap/|u, s/sub 2/) [I(U; S/sub 1/, X) 1(U; S/sub 2/)].Keywords
This publication has 12 references indexed in Scilit:
- Capacity and Lattice Strategies for Canceling Known InterferenceIEEE Transactions on Information Theory, 2005
- On the duality between distributed source coding and data hidingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Tradeoff between message and state information ratesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Unified duality between channel capacity and rate distortion with state informationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Optimal entropy-constrained scalar quantization of a uniform sourceIEEE Transactions on Information Theory, 2000
- On the capacity of some channels with channel state informationIEEE Transactions on Information Theory, 1999
- On the capacity of computer memory with defectsIEEE Transactions on Information Theory, 1983
- Writing on dirty paper (Corresp.)IEEE Transactions on Information Theory, 1983
- The rate-distortion function for source coding with side information at the decoderIEEE Transactions on Information Theory, 1976
- Channels with Side Information at the TransmitterIBM Journal of Research and Development, 1958