Corpus ID: 158046977

Integer Discrete Flows and Lossless Compression

  title={Integer Discrete Flows and Lossless Compression},
  author={E. Hoogeboom and Jorn W. T. Peters and R. V. Berg and M. Welling},
  • E. Hoogeboom, Jorn W. T. Peters, +1 author M. Welling
  • Published 2019
  • Mathematics, Computer Science
  • ArXiv
  • Lossless compression methods shorten the expected representation size of data without loss of information, using a statistical model. [...] Key Method For that reason, we introduce a generative flow for ordinal discrete data called Integer Discrete Flow (IDF): a bijective integer map that can learn rich transformations on high-dimensional data. As building blocks for IDFs, we introduce flexible transformation layers called integer discrete coupling and lower triangular coupling. Our experiments show that IDFs…Expand Abstract

    Paper Mentions

    Lossy Image Compression with Normalizing Flows
    Learning Discrete Distributions by Dequantization
    • 5
    • PDF
    Discrete Flows: Invertible Generative Models of Discrete Data
    • 31
    • PDF
    Learning Better Lossless Compression Using Lossy Compression
    • 1
    • Highly Influenced
    • PDF
    HiLLoC: Lossless Image Compression with Hierarchical Latent Variable Models
    • 6
    • Highly Influenced
    • PDF
    Closing the Dequantization Gap: PixelCNN as a Single-Layer Flow
    • 1
    • PDF
    A RAD approach to deep mixture models
    • 16
    • PDF
    Lossless Image Compression through Super-Resolution
    • 2
    • Highly Influenced
    • PDF
    Learning Likelihoods with Conditional Normalizing Flows
    • 14
    • PDF


    Publications referenced by this paper.
    Practical Full Resolution Learned Lossless Image Compression
    • 26
    • PDF
    Practical Lossless Compression with Latent Variables using Bits Back Coding
    • 20
    • PDF
    Bit-Swap: Recursive Bits-Back Coding for Lossless Compression with Hierarchical Latent Variables
    • 10
    • PDF
    Adam: A Method for Stochastic Optimization
    • 50,110
    • PDF
    Generative Adversarial Nets
    • 17,917
    • PDF
    Auto-Encoding Variational Bayes
    • 9,208
    • PDF
    NICE: Non-linear Independent Components Estimation
    • 636
    • PDF
    Arithmetic coding revisited
    • 561
    • Highly Influential
    • PDF
    Asymmetric numeral systems: entropy coding combining speed of Huffman coding with compression rate of arithmetic coding
    • J. Duda
    • Computer Science, Mathematics
    • 2013
    • 52
    • PDF
    High-Dimensional Probability Estimation with Deep Density Models
    • 55
    • PDF