Published September 2016
| Version public
Book Section - Chapter
When is Shannon's lower bound tight at finite blocklength?
Abstract
This paper formulates an abstract version of Shannon's lower bound that applies to abstract sources and arbitrary distortion measures and that recovers the classical Shannon lower bound as a special case. A necessary and sufficient condition for it to be attained exactly is presented. It is demonstrated that whenever that condition is met, the d-tilted information of the source adopts a simple, explicit representation that parallels Shannon's lower bound. That convenient representation simplifies the non-asymptotic analysis of achievable rate-distortion tradeoffs. In particular, if a memoryless source meets Shannon's lower bound with equality, then its rate-dispersion function is given simply by the varentropy of the source.
Additional Information
© 2016 IEEE. Date of Conference: 27-30 Sept. 2016. Date Added to IEEE Xplore: 13 February 2017. This work was supported in part by the National Science Foundation (NSF) under Grant CCF-1566567, and by the Simons Institute for the Theory of Computing.Additional details
Identifiers
- Eprint ID
- 74417
- DOI
- 10.1109/ALLERTON.2016.7852341
- Resolver ID
- CaltechAUTHORS:20170221-071301966
Funding
- NSF
- CCF-1566567
- Simons Institute for the Theory of Computing
Dates
- Created
-
2017-02-21Created from EPrint's datestamp field
- Updated
-
2021-11-11Created from EPrint's last_modified field