On entropy for mixtures of discrete and continuous variables

  title={On entropy for mixtures of discrete and continuous variables},
  author={Chandra Nair and Balaji Prabhakar and Devavrat Shah},
Let X be a discrete random variable with support S and f : S → S be a bijection. Then it is wellknown that the entropy of X is the same as the entropy of f(X). This entropy preservation property has been well-utilized to establish non-trivial properties of discrete stochastic processes, e.g. queuing process [1]. Entropy as well as entropy preservation is well-defined only in the context of purely discrete or continuous random variables. However for a mixture of discrete and continuous random… CONTINUE READING


Publications referenced by this paper.
Showing 1-4 of 4 references

Entropy and the timing capacity of discrete queues

IEEE Trans. Information Theory • 2003
View 2 Excerpts

A mathermatical theory of communication ,

C. E. Shannon
Bell System Technical Journal , • 1948
View 1 Excerpt

Similar Papers

Loading similar papers…