# Source Coding for Quasiarithmetic Penalties

@article{Baer2006SourceCF, title={Source Coding for Quasiarithmetic Penalties}, author={Michael B. Baer}, journal={IEEE Transactions on Information Theory}, year={2006}, volume={52}, pages={4380-4393} }

Whereas Huffman coding finds a prefix code minimizing mean codeword length for a given finite-item probability distribution, quasiarithmetic or quasilinear coding problems have the goal of minimizing a generalized mean of the form rho-1(Sigmaipirho(li )), where li denotes the length of the ith codeword, p i denotes the corresponding probability, and rho is a monotonically increasing cost function. Such problems, proposed by Campbell, have a number of diverse applications. Several cost functions…

## 29 Citations

Reserved-length prefix coding

- Computer Science2008 IEEE International Symposium on Information Theory
- 2008

This paper introduces a polynomial-time dynamic programming algorithm that finds optimal codes for this reserved-length prefix coding problem and has applications to quickly encoding and decoding lossless codes.

Infinite-Alphabet Prefix Codes Optimal for ß-Exponential Penalties

- Computer Science2007 IEEE International Symposium on Information Theory
- 2007

Methods for finding codes optimal for beta-exponential means are introduced, one of which applies to geometric distributions, while another applies to distributions with lighter tails, and both are extended to minimizing maximum pointwise redundancy.

Infinite-Alphabet Prefix Codes Optimal for beta-Exponential Penalties

- Computer ScienceArXiv
- 2007

Methods for finding codes optimal for exponential means of Poisson distributions are introduced, one of which applies to geometric distributions, while another applies to distributions with lighter tails.

D-ary Bounded-Length Huffman Coding

- Computer Science2007 IEEE International Symposium on Information Theory
- 2007

The Package-Merge approach is generalized without increasing complexity in order to introduce a minimum codeword length, lmin, to allow for objective functions other than the minimization of expected codewORD length, and to be applicable to both binary and nonbinary codes; non binary codes were previously addressed using a slower dynamic programming approach.

Generalizations of Length Limited Huffman Coding for Hierarchical Memory Settings

- Computer Science
- 2020

This paper studies the problem of designing prefix-free encoding schemes having minimum average code length that can be decoded efficiently under a decode cost model that captures memory hierarchy induced cost functions and presents an algorithm to solve this problem in time O(nD).

Twenty (or so) Questions: $D$-ary Length-Bounded Prefix Coding

- Computer ScienceArXiv
- 2006

These algorithms are generalized without increasing complexity in order to introduce a minimum codeword length constraint, to allow for objective functions other than the minimization of expected codewords length, and to be applicable to both binary and nonbinary codes; non binary codes were previously addressed using a slower dynamic programming approach.

Lossless quantum data compression with exponential penalization: an operational interpretation of the quantum Rényi entropy

- Computer ScienceScientific Reports
- 2017

It is shown that by invoking an exponential average length, related to an exponential penalization over large codewords, the quantum Rényi entropies arise as the natural quantities relating the optimal encoding schemes with the source description, playing an analogous role to that of von Neumann entropy.

On how generalised entropies without parameters impact information optimisation processes

- Computer ScienceArXiv
- 2021

It is found that processes such as data compression and channel capacity maximisation can be improved in regions where there is a low density of states, whereas for high densities the results coincide with the Shannon’s formulation.

Timely Lossless Source Coding for Randomly Arriving Symbols

- Computer Science2018 IEEE Information Theory Workshop (ITW)
- 2018

We consider a real-time streaming source coding system in which an encoder observes a sequence of randomly arriving symbols from an i.i.d. source, and feeds binary code-words to a FIFO buffer that…

## References

SHOWING 1-10 OF 81 REFERENCES

The Rényi redundancy of generalized Huffman codes

- Computer ScienceIEEE Trans. Inf. Theory
- 1988

By decreasing some of the codeword lengths in a Shannon code, the upper bound on the redundancy given in the standard proof of the noiseless source coding theorem is improved and the lower bound is improved by randomizing between codewords, allowing linear programming techniques to be used on an integer programming problem.

Practical Length-limited Coding for Large Alphabets

- Computer ScienceComput. J.
- 1995

This work re-examine the package-merge algorithm for generating minimum-cost length-limited prefix-free codes and shows that with a considered reorganization of the key steps it is possible for it to run quickly in significantly less memory than was required by previous implementations, while retaining asymptotic efficiency.

Existence of optimal prefix codes for infinite source alphabets

- Computer ScienceIEEE Trans. Inf. Theory
- 1997

It is proven that for every random variable with a countably infinite set of outcomes and finite entropy there exists an optimal prefix code which can be constructed from Huffman codes for truncated…

Huffman codes and self-information

- Computer ScienceIEEE Trans. Inf. Theory
- 1976

In this paper the connection between the self-information of a source letter from a finite alphabet and its code-word length in a Huffman code is investigated. Consider the set of all independent…

On the redundancy of optimal codes with limited word length

- Computer ScienceIEEE Trans. Inf. Theory
- 1992

It is shown that the redundancy of these constrained codes is very close to that of the unconstrained Huffman codes when the number of codewords N is such that ND/sup 1-L/ becomes negligible.

Renyi to Renyi - Source Coding under Siege

- Computer Science2006 IEEE International Symposium on Information Theory
- 2006

A novel lossless source coding paradigm applies to problems of unreliable lossless channels with low bit rates, in which a vital message needs to be transmitted prior to termination of…

A Fast Algorithm for Optimum Height-Limited Alphabetic Binary Trees

- Computer ScienceSIAM J. Comput.
- 1994

This algorithm is an alphabetic version of the Package Merge algorithm, and yields an O(nL\log n)-time algorithm for theAlphabetic Huffman coding problem, and appears hard to prove correct.

Minimal Huffman trees

- Computer ScienceActa Informatica
- 2000

It is proved that several natural variants of Huffman's algorithm, that appear to be nondeterministic, in fact all lead to the single Huffman tree obtained by Schwartz's algorithm.

Two inequalities implied by unique decipherability

- MathematicsIRE Trans. Inf. Theory
- 1956

A consequence of (1) and work of Shannon is that this more restricted kind of list suffices in the search for codes with specified amounts of redundancy.