Adaptable, metadata rich IO methods for portable high performance IO

@article{Lofstead2009AdaptableMR,
  title={Adaptable, metadata rich IO methods for portable high performance IO},
  author={Jay F. Lofstead and Fang Zheng and Scott Klasky and Karsten Schwan},
  journal={2009 IEEE International Symposium on Parallel & Distributed Processing},
  year={2009},
  pages={1-10}
}
Since IO performance on HPC machines strongly depends on machine characteristics and configuration, it is important to carefully tune IO libraries and make good use of appropriate library APIs. For instance, on current petascale machines, independent IO tends to outperform collective IO, in part due to bottlenecks at the metadata server. The problem is exacerbated by scaling issues, since each IO library scales differently on each machine, and typically, operates efficiently to different levels… CONTINUE READING

Citations

Publications citing this paper.
SHOWING 1-10 OF 130 CITATIONS

Extreme scale data management in high performance computing

VIEW 18 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

Scalability in the Presence of Variability

VIEW 8 EXCERPTS
CITES METHODS
HIGHLY INFLUENCED

SmartBlock: An Approach to Standardizing In Situ Workflow Components

  • 2017 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW)
  • 2017
VIEW 11 EXCERPTS
CITES METHODS

DAOS and Friends: A Proposal for an Exascale Storage System

  • SC16: International Conference for High Performance Computing, Networking, Storage and Analysis
  • 2016
VIEW 14 EXCERPTS

Middleware for large scale in situ analytics workflows

VIEW 4 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

System-Level Support for Composition of Applications

VIEW 18 EXCERPTS
CITES BACKGROUND & METHODS

FILTER CITATIONS BY YEAR

2009
2019

CITATION STATISTICS

  • 16 Highly Influenced Citations

  • Averaged 8 Citations per year from 2017 through 2019

References

Publications referenced by this paper.
SHOWING 1-10 OF 17 REFERENCES

Metabots: A framework for out-of-band processing in largescale data flows

P. M. Widener, M. Barrick, J. Pullikottil, P. G. Bridges, A. B. Maccabe
  • Proc. 2007 International Conference on Grid Computing (Grid 2007), Austin, Texas, September 2007.
  • 2007
VIEW 1 EXCERPT

Lightweight I/O for Scientific Applications

  • 2006 IEEE International Conference on Cluster Computing
  • 2006
VIEW 2 EXCERPTS