Irreversible information loss: Fundamental notions and entropy costs
Landauer's Principle (LP) associates an entropy increase with the irreversible loss of information from a physical system. Clear statement, unambiguous interpretation, and proper application of LP requires precise, mutually consistent, and sufficiently general definitions for a set of interlocking fundamental notions and quantities (entropy, information, irreversibility, erasure). In this work, we critically assess some common definitions and quantities used or implied in statements of LP, and reconsider their definition within an alternative “referential” approach to physical information theory that embodies an overtly relational conception of physical information. We prove an inequality on the entropic cost of irreversible information loss within this context, as well as “referential analogs” of LP and its more general restatement by Bennett. Advantages of the referential approach for establishing fundamental limits on the physical costs of irreversible information loss in communication and computing systems are discussed throughout.