A Case for Non-blocking Collective Operations

  title={A Case for Non-blocking Collective Operations},
  author={Torsten Hoefler and Jeffrey M. Squyres and Wolfgang Rehm and Andrew Lumsdaine},
  booktitle={ISPA Workshops},
Non-blocking collective operations for MPI have been in discussion for a long time. We want to contribute to this discussion and to give a rationale for the usage these operations and assess their possible benefits. A LogGP model for the CPU overhead of collective algorithms and a benchmark to measures it are provided and show a large potential to overlap communication and computation. We show that nonblocking collective operations can provide at least the same benefits as non-blocking point to… CONTINUE READING
Highly Cited
This paper has 31 citations. REVIEW CITATIONS