Reducing Network Congestion and Synchronization Overhead During Aggregation of Hierarchical Data

@article{Kumar2017ReducingNC,
  title={Reducing Network Congestion and Synchronization Overhead During Aggregation of Hierarchical Data},
  author={Sidharth Kumar and Duong Hoang and Steve Petruzza and John Edwards and Valerio Pascucci},
  journal={2017 IEEE 24th International Conference on High Performance Computing (HiPC)},
  year={2017},
  pages={223-232}
}
  • Sidharth Kumar, Duong Hoang, +2 authors Valerio Pascucci
  • Published in
    IEEE 24th International…
    2017
  • Computer Science
  • Hierarchical data representations have been shown to be effective tools for coping with large-scale scientific data. Writing hierarchical data on supercomputers, however, is challenging as it often involves all-to-one communication during aggregation of low-resolution data which tends to span the entire network domain, resulting in several bottlenecks. We introduce the concept of indexing templates, which succinctly describe data organization and can be used to alter movement of data in… CONTINUE READING

    Citations

    Publications citing this paper.
    SHOWING 1-2 OF 2 CITATIONS

    Node failure resiliency for Uintah without checkpointing

    VIEW 7 EXCERPTS
    CITES BACKGROUND & METHODS
    HIGHLY INFLUENCED

    References

    Publications referenced by this paper.
    SHOWING 1-10 OF 30 REFERENCES

    Investigating applications portability with the uintah DAG-based runtime system on petascale supercomputers

    VIEW 6 EXCERPTS
    HIGHLY INFLUENTIAL

    Characterizing and predicting the I/O performance of HPC applications using a parameterized synthetic benchmark

    VIEW 3 EXCERPTS
    HIGHLY INFLUENTIAL

    Embedded domain-specific language and runtime system for progressive spatiotemporal data analysis and visualization

    VIEW 1 EXCERPT

    Topology-Aware Data Aggregation for Intensive I/O on Large-Scale Supercomputers

    VIEW 1 EXCERPT

    Efficient I/O and Storage of Adaptive-Resolution Data

    VIEW 1 EXCERPT