Enhance parallel input/output with cross-bundle aggregation

  title={Enhance parallel input/output with cross-bundle aggregation},
  author={T. Wang and K. Vasko and Z. Liu and H. Chen and Weikuan Yu},
  journal={The International Journal of High Performance Computing Applications},
  pages={241 - 256}
  • T. Wang, K. Vasko, +2 authors Weikuan Yu
  • Published 2016
  • Computer Science
  • The International Journal of High Performance Computing Applications
  • The exponential growth of computing power on leadership scale computing platforms imposes grand challenge to scientific applications’ input/output (I/O) performance. To bridge the performance gap between computation and I/O, various parallel I/O libraries have been developed and adopted by computer scientists. These libraries enhance the I/O parallelism by allowing multiple processes to concurrently access the shared data set. Meanwhile, they are integrated with a set of I/O optimization… CONTINUE READING


    Publications referenced by this paper.
    BPAR: A Bundle-Based Parallel Aggregation Framework for Decoupled I/O Execution
    • 5
    • PDF
    Scaling parallel I/O performance through I/O delegate and caching system
    • 61
    • PDF
    ParColl: Partitioned Collective I/O on the Cray XT
    • 35
    • PDF
    Scalable I/O forwarding framework for high-performance computing systems
    • 161
    • PDF
    Profiling and Improving I/O Performance of a Large-Scale Climate Scientific Application
    • 18
    • PDF
    Data sieving and collective I/O in ROMIO
    • 525
    • Highly Influential
    • PDF
    A lightweight I/O scheme to facilitate spatial and temporal queries of scientific data analytics
    • 9
    • PDF
    Locality-driven high-level I/O aggregation for processing scientific datasets
    • 16
    • Highly Influential
    • PDF
    Combining I/O operations for multiple array variables in parallel netCDF
    • 19
    • PDF
    Accelerating I/O Forwarding in IBM Blue Gene/P Systems
    • 46
    • PDF