Corpus ID: 216056265

Exploring Trade-offs in Dynamic Task Triggering for Loosely Coupled Scientific Workflows

@article{Wang2020ExploringTI,
  title={Exploring Trade-offs in Dynamic Task Triggering for Loosely Coupled Scientific Workflows},
  author={Zhe Wang and Pradeep Subedi and Shaohua Duan and Yubo Qin and P. Davis and Anthony Simonet and I. Rodero and M. Parashar},
  journal={ArXiv},
  year={2020},
  volume={abs/2004.10381}
}
  • Zhe Wang, Pradeep Subedi, +5 authors M. Parashar
  • Published 2020
  • Computer Science
  • ArXiv
  • In order to achieve near-time insights, scientific workflows tend to be organized in a flexible and dynamic way. Data-driven triggering of tasks has been explored as a way to support workflows that evolve based on the data. However, the overhead introduced by such dynamic triggering of tasks is an under-studied topic. This paper discusses different facets of dynamic task triggers. Particularly, we explore different ways of constructing a data-driven dynamic workflow and then evaluate the… CONTINUE READING

    Figures, Tables, and Topics from this paper.

    Explore Further: Topics Discussed in This Paper

    References

    Publications referenced by this paper.
    SHOWING 1-10 OF 34 REFERENCES
    Characterizing and profiling scientific workflows
    420
    Dynamic steering of HPC scientific workflows: A survey
    52
    Enabling Adaptive Scientific Workflows Via Trigger Detection
    8
    Addressing data resiliency for staging based scientific workflows
    2
    Pegasus, a workflow management system for science automation
    420
    Scientific workflow management and the Kepler system
    1763
    A taxonomy of scientific workflow systems for grid computing
    604