Sketching and Streaming Entropy via Approximation Theory

  title={Sketching and Streaming Entropy via Approximation Theory},
  author={Nicholas J. A. Harvey and Jelani Nelson and Krzysztof Onak},
  journal={2008 49th Annual IEEE Symposium on Foundations of Computer Science},
We give near-optimal sketching and streaming algorithms for estimating Shannon entropy in the most general streaming model, with arbitrary insertions and deletions. This improves on prior results that obtain suboptimal space bounds in the general model, and near-optimal bounds in the insertion-only model without sketching. Our high-level approach is simple: we give algorithms to estimate Tsallis entropy, and use them to extrapolate an estimate of Shannon entropy. The accuracy of our estimates… CONTINUE READING
Highly Cited
This paper has 91 citations. REVIEW CITATIONS
63 Citations
40 References
Similar Papers


Publications citing this paper.
Showing 1-10 of 63 extracted citations

92 Citations

Citations per Year
Semantic Scholar estimates that this publication has 92 citations based on the available data.

See our FAQ for additional information.

Similar Papers

Loading similar papers…