Corpus ID: 208310026

Dynamically Provisioning Cray DataWarp Storage

  title={Dynamically Provisioning Cray DataWarp Storage},
  author={Franccois Tessier and Maxime Martinasso and Matteo Chesi and M. Klein and M. Gila},
  • Franccois Tessier, Maxime Martinasso, +2 authors M. Gila
  • Published 2019
  • Computer Science
  • ArXiv
  • Complex applications and workflows needs are often exclusively expressed in terms of computational resources on HPC systems. In many cases, other resources like storage or network are not allocatable and are shared across the entire HPC system. By looking at the storage resource in particular, any workflow or application should be able to select both its preferred data manager and its required storage capability or capacity. To achieve such a goal, new mechanisms should be introduced. In this… CONTINUE READING

    Figures, Tables, and Topics from this paper

    Explore Further: Topics Discussed in This Paper


    Architecture and Design of Cray DataWarp
    • 35
    • Highly Influential
    • PDF
    GekkoFS - A Temporary Distributed File System for HPC Applications
    • 14
    • PDF
    Optimizing Data Aggregation by Leveraging the Deep Memory Hierarchy on Large-scale Systems
    • 2
    • PDF
    Survey of Storage Systems for High-Performance Computing
    • 9
    • PDF
    Portable, high-performance containers for HPC
    • 8
    • PDF
    SLURM: Simple Linux Utility for Resource Management
    • 865
    • Highly Influential
    • PDF
    Shifter: Containers for HPC
    • 63
    • PDF
    GPFS: A Shared-Disk File System for Large Computing Clusters
    • 1,421
    • PDF
    Efficient Metadata Management for Flash File Systems
    • 6
    • PDF
    Lustre: Building a File System for 1,000-node Clusters
    • 382
    • PDF