Lambda Calculus as a Workflow Model

@article{Kelly2008LambdaCA,
  title={Lambda Calculus as a Workflow Model},
  author={Peter M. Kelly and Paul D. Coddington and Andrew L. Wendelborn},
  journal={2008 The 3rd International Conference on Grid and Pervasive Computing - Workshops},
  year={2008},
  pages={15-22}
}
Data-oriented workflows are often used in scientific applications for executing a set of dependent tasks across multiple computers. We discuss how these can be modeled using lambda calculus, and how ideas from functional programming are applicable in the design of workflows. Such an approach avoids the restrictions often found in workflow languages, permitting the implementation of complex application logic and data manipulation. This paper explains why lambda calculus is an appropriate model… 

Implementing robust workflow management in Erlang

  • B. Karakostas
  • Computer Science
    Int. J. Parallel Emergent Distributed Syst.
  • 2012
TLDR
This paper proposes an architecture and implementation for robust workflow management systems, using the Erlang language, and shows how common workflow design patterns can be implemented in Erlang, and then how robustness supporting mechanisms such as workflow monitors can be added.

The design and implementation of a workflow analysis tool

  • V. CurcinM. GhanemYike Guo
  • Computer Science
    Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences
  • 2010
TLDR
This article introduces a framework and a set of associated methods for analysing the execution properties of scientific workflows, and uses the framework to design the architecture of a customizable tool that can be used to analyse the key execution properties at authoring stage.

Modeling and optimizing large-scale data flows

Typetheoretic Approach to the Shimming Problem in Scientific Workflows

TLDR
The shimming problem is reduced to a runtime coercion problem in the theory of type systems and a function that inserts “invisible shims”, or runtime coercions into workflows is designed, thereby solving the shim problem for any well-typed workflow.

Computation semantics of the functional scientific workflow language Cuneiform*

TLDR
This paper presents Cuneiform's abstract syntax, a simple type system, and the semantics of evaluation, which allows the deduction of the language's safety up to black-box operators and permits the verification of compilers to and from other workflow languages.

Logical Optimization of Dataflows for Data Mining and Integration Processes

TLDR
A dataflow model is defined and several optimization algorithms, namely dead elements elimination, process re-ordering, parallelization, and data by-passing are developed and the first research prototype of the framework has been implemented in the context of the ADMIRE Data Mining and Integration Process Designer for logical optimization of specifications expressed in the DISPEL language developed in the AD MIRE project.

Cuneiform: a Functional Language for Large Scale Scientific Data Analysis

TLDR
This work presents Cuneiform, a novel language for large-scale scientific data analysis, including tool support for programming, workflow visualization, debugging, logging, and provenance-tracing, and the parallel execution engine Hi-WAY are fully implemented.

OpenAlea: scientific workflows combining data analysis and simulation

TLDR
This demonstration paper provides for the first time the description of the OpenAlea system involving an original combination of features and illustrates the demonstration on a high-throughput workflow in phenotyping, phenomics, and environmental control designed to study the interplay between plant architecture and climatic change.

Riding the elephant: managing ensembles with hadoop

TLDR
The programmability of MapReduce and Hadoop is evaluated for scientific workflow ensembles, an attractive paradigm due to the simplicity of the programming model and intrinsic mechanisms for handling scalability and fault-tolerance.

Special Issue: 3rd International Workshop on Workflow Management and Applications in Grid Environments (WaGe2008)

This special issue of Concurrency and Computation: Practice and Experience contains selected high-quality papers from the 3rd International Workshop on Workflow Management and Applications in Grid

References

SHOWING 1-10 OF 37 REFERENCES

Distributed, parallel Web service orchestration using XSLT

TLDR
XSLT provides a higher level programming model than many other approaches to Web services composition; its use here as a means of easing the task of orchestrating the interactions between services is explored.

A Taxonomy of Workflow Management Systems for Grid Computing

  • Jia YuR. Buyya
  • Computer Science
    Proceedings of the 38th Annual Hawaii International Conference on System Sciences
  • 2005
TLDR
A taxonomy that characterizes and classifies various approaches for building and executing workflows on Grids is proposed that highlights the design and engineering similarities and differences of state-of-the-art in Grid workflow systems, but also identifies the areas that need further research.

Workflow Enactment in ICENI

TLDR
This paper describes how an abstract workflow, specified by an end-user in the form of an Execution Plan, is instantiated within the ICenI environment through the enactment pipeline, and shows that ICENI is capable of deploying the specified components of the workflow over the available resources.

A Distributed Virtual Machine for Parallel Graph Reduction

  • P. KellyP. CoddingtonA. Wendelborn
  • Computer Science
    Eighth International Conference on Parallel and Distributed Computing, Applications and Technologies (PDCAT 2007)
  • 2007
TLDR
The architecture of nreduce, a distributed virtual machine which uses parallel graph reduction to run programs across a set of computers, is presented, which demonstrates how distributed execution can be implemented directly within a virtual machine, instead of a separate piece of middleware that coordinates the execution of external programs.

Technical Note : SciDAC-SPA-TN-2003-01 On Providing Declarative Design and Programming Constructs for Scientific Workflows based on Process Networks

TLDR
This technical note describes in some detail the structure of the PromoterIdentification-Workflow (PIW) demonstrated at SSDBM [ABB+03), and proposes a simple solution to this problem, based on a functional programming approach.

Mapping Abstract Complex Workflows onto Grid Environments

TLDR
The current ACWG based on AI planning technologies is described and it is outlined how these technologies can play a crucial role in developing complex application workflows in Grid environments.

Efficient compilation of lazy evaluation

TLDR
The principles underlying an efficient implementation of a lazy functional language, compiling to code for ordinary computers, based on combinator-like graph reduction: the user defined functions are used as rewrite rules in the graph.

Chimera: a virtual data system for representing, querying, and automating data derivation

TLDR
The Chimera virtual data system is developed, which combines avirtual data catalog for representing data derivation procedures and derived data, with a virtual data language interpreter that translates user requests into data definition and query operations on the database.

Imperative functional programming

We present a new model, based on monads, for performing input/output in a non-strict, purely functional language. It is composable, extensible, efficient, requires no extensions to the type system,

Algorithms + Strategy = Parallelism

TLDR
Evaluation strategies are introduced: lazy higher-order functions that control the parallel evaluation of non-strict functional languages that can be used to model a wide range of commonly used programming paradigms, including divide-and-conquer parallelism, pipeline Parallelism, producer/ consumer parallelism and data-oriented parallelism.