Published September 2016 | Version public
Book Section - Chapter

When is Shannon's lower bound tight at finite blocklength?

  • 1. ROR icon California Institute of Technology

Abstract

This paper formulates an abstract version of Shannon's lower bound that applies to abstract sources and arbitrary distortion measures and that recovers the classical Shannon lower bound as a special case. A necessary and sufficient condition for it to be attained exactly is presented. It is demonstrated that whenever that condition is met, the d-tilted information of the source adopts a simple, explicit representation that parallels Shannon's lower bound. That convenient representation simplifies the non-asymptotic analysis of achievable rate-distortion tradeoffs. In particular, if a memoryless source meets Shannon's lower bound with equality, then its rate-dispersion function is given simply by the varentropy of the source.

Additional Information

© 2016 IEEE. Date of Conference: 27-30 Sept. 2016. Date Added to IEEE Xplore: 13 February 2017. This work was supported in part by the National Science Foundation (NSF) under Grant CCF-1566567, and by the Simons Institute for the Theory of Computing.

Additional details

Identifiers

Eprint ID
74417
DOI
10.1109/ALLERTON.2016.7852341
Resolver ID
CaltechAUTHORS:20170221-071301966

Funding

NSF
CCF-1566567
Simons Institute for the Theory of Computing

Dates

Created
2017-02-21
Created from EPrint's datestamp field
Updated
2021-11-11
Created from EPrint's last_modified field