Characterizing the Performance of Executing Many-tasks on Summit

@article{Turilli2019CharacterizingTP,
  title={Characterizing the Performance of Executing Many-tasks on Summit},
  author={Matteo Turilli and Andr{\'e} Merzky and Thomas J. Naughton and Wael R. Elwasif and Shantenu Jha},
  journal={2019 IEEE/ACM Third Annual Workshop on Emerging Parallel and Distributed Runtime Systems and Middleware (IPDRM)},
  year={2019},
  pages={18-25}
}
  • Matteo Turilli, André Merzky, +2 authors Shantenu Jha
  • Published in
    IEEE/ACM Third Annual…
    2019
  • Computer Science
  • Many scientific workloads are comprised of many tasks, where each task is an independent simulation or analysis of data. The execution of millions of tasks on heterogeneous HPC platforms requires scalable dynamic resource management and multi-level scheduling. RADICAL-Pilot (RP) -- an implementation of the Pilot abstraction, addresses these challenges and serves as an effective runtime system to execute workloads comprised of many tasks. In this paper, we characterize the performance of… CONTINUE READING

    Create an AI-powered research feed to stay up to date with new papers like this posted to ArXiv

    Citations

    Publications citing this paper.

    DeepDriveMD: Deep-Learning Driven Adaptive Molecular Simulations for Protein Folding

    VIEW 3 EXCERPTS
    CITES METHODS

    References

    Publications referenced by this paper.
    SHOWING 1-10 OF 21 REFERENCES

    METAQ: Bundle Supercomputing Tasks

    VIEW 3 EXCERPTS
    HIGHLY INFLUENTIAL

    IBM High-Performance Computing Insights with IBM Power System AC922 Clustered Solution

    • D. Quintero, M. Gomez Gonzalez, A. Y. Hussein, Myklebust, J.-F
    • IBM Redbooks,
    • 2019
    VIEW 1 EXCERPT

    Harnessing the Power of Many: Extensible Toolkit for Scalable Ensemble Applications

    VIEW 3 EXCERPTS