Corpus ID: 119102244

METAQ: Bundle Supercomputing Tasks

  title={METAQ: Bundle Supercomputing Tasks},
  author={E. Berkowitz},
  journal={arXiv: Computational Physics},
  • E. Berkowitz
  • Published 2017
  • Computer Science, Physics
  • arXiv: Computational Physics
We describe a light-weight system of bash scripts for efficiently bundling supercomputing tasks into large jobs, so that one can take advantage of incentives or discounts for requesting large allocations. The software can backfill computational tasks, avoiding wasted cycles, and can streamline collaboration between different users. It is simple to use, functioning similarly to batch systems like PBS, MOAB, and SLURM. 
15 Citations
Job Management with mpi_jm
  • 1
Autonomous Resource Management for High Performance Datacenters
  • PDF
Application-aware resource management for datacenters
  • PDF
Hybrid Resource Management for HPC and Data Intensive Workloads
  • 1
Characterizing the Performance of Executing Many-tasks on Summit
  • 4
  • Highly Influenced
  • PDF
EspressoDB: A scientific database for managing high-performance computing workflows
  • 4
  • PDF
Simulating the Weak Death of the Neutron in a Femtoscale Universe with Near-Exascale Computing
  • E. Berkowitz, M. A. Clark, +9 authors K. Orginos
  • Physics, Computer Science
  • SC18: International Conference for High Performance Computing, Networking, Storage and Analysis
  • 2018
  • 14
  • PDF
Heavy Physics Contributions to Neutrinoless Double Beta Decay from QCD.
  • 31
  • PDF
Detailed analysis of excited state systematics in a lattice QCD calculation of $g_A$
  • PDF


Walker-Loud, mpi jm, in preparation
  • 2017
  • 2016