Corpus ID: 15268949

Vectorized VByte Decoding

@article{Plaisance2015VectorizedVD,
  title={Vectorized VByte Decoding},
  author={Jeff Plaisance and N. Kurz and D. Lemire},
  journal={ArXiv},
  year={2015},
  volume={abs/1503.07387}
}
  • Jeff Plaisance, N. Kurz, D. Lemire
  • Published 2015
  • Computer Science
  • ArXiv
  • We consider the ubiquitous technique of VByte compression, which represents each integer as a variable length sequence of bytes. The low 7 bits of each byte encode a portion of the integer, and the high bit of each byte is reserved as a continuation flag. This flag is set to 1 for all bytes except the last, and the decoding of each integer is complete when a byte with a high bit of 0 is encountered. VByte decoding can be a performance bottleneck especially when the unpredictable lengths of the… CONTINUE READING
    26 Citations

    Figures, Tables, and Topics from this paper.

    Explore Further: Topics Discussed in This Paper

    Stream VByte: Faster byte-oriented integer compression
    • 21
    • PDF
    GPU-Accelerated Decoding of Integer Lists
    • 1
    • PDF
    On Optimally Partitioning Variable-Byte Codes
    • 5
    • Highly Influenced
    • PDF
    Upscaledb: Efficient integer-key compression in a key-value store using SIMD instructions
    • 3
    • PDF
    Conflict Detection-Based Run-Length Encoding - AVX-512 CD Instruction Set in Action
    • 10
    • PDF
    Lightweight Data Compression Algorithms: An Experimental Survey (Experiments and Analyses)
    • 35
    • PDF
    MILC: Inverted List Compression in Memory
    • 15
    • PDF

    References

    SHOWING 1-9 OF 9 REFERENCES
    SIMD-based decoding of posting lists
    • 81
    • PDF
    Decoding billions of integers per second through vectorization
    • 211
    • PDF
    Compressing Integers for Fast File Access
    • 231
    • PDF
    Efficient Index Compression in DB2 LUW
    • 27
    • PDF
    Challenges in building large-scale information retrieval systems: invited talk
    • J. Dean
    • Computer Science
    • WSDM '09
    • 2009
    • 187
    • PDF
    Compressing integers for fast file
    • access. Comput. J.,
    • 1999
    Oberoi . SIMDbased decoding of posting lists
    • 2011
    SIMDbased decoding of posting
    • lists. CIKM
    • 2011
    SIMDbased decoding of posting lists. CIKM '11
    • SIMDbased decoding of posting lists. CIKM '11
    • 2011