STXXL: standard template library for XXL data sets

Abstract

We present the software library STXXL that is an implementation of the C++ standard template library STL for processing huge data sets that can fit only on hard disks. It supports parallel disks, overlapping between disk I/O and computation and it is the first I/O-efficient algorithm library that supports the pipelining technique that can save more than half of the I/Os. STXXL has been applied both in academic and industrial environments for a range of problems including text processing, graph algorithms, computational geometry, gaussian elimination, visualization, and analysis of microscopic images, differential cryptographic analysis, etc. The performance of STXXL and its applications is evaluated on synthetic and real-world inputs. We present the design of the library, how its performance features are supported, and demonstrate how the library integrates with STL.

DOI: 10.1002/spe.844
View Slides

Extracted Key Phrases

25 Figures and Tables

01020'06'07'08'09'10'11'12'13'14'15'16'17
Citations per Year

175 Citations

Semantic Scholar estimates that this publication has 175 citations based on the available data.

See our FAQ for additional information.

Cite this paper

@article{Dementiev2008STXXLST, title={STXXL: standard template library for XXL data sets}, author={Roman Dementiev and Lutz Kettner and Peter Sanders}, journal={Softw., Pract. Exper.}, year={2008}, volume={38}, pages={589-637} }