An Event-Driven Approach to Serverless Seismic Imaging in the Cloud

@article{Witte2020AnEA,
  title={An Event-Driven Approach to Serverless Seismic Imaging in the Cloud},
  author={Philipp A. Witte and Mathias Louboutin and Henryk Modzelewski and Charles Jones and James Selvage and F. Herrmann},
  journal={IEEE Transactions on Parallel and Distributed Systems},
  year={2020},
  volume={31},
  pages={2032-2049}
}
Adapting the cloud for high-performance computing (HPC) is a challenging task, as software for HPC applications hinges on fast network connections and is sensitive to hardware failures. Using cloud infrastructure to recreate conventional HPC clusters is therefore in many cases an infeasible solution for migrating HPC applications to the cloud. As an alternative to the generic lift and shift approach, we consider the specific application of seismic imaging and demonstrate a serverless and event… 
View With Semantic Reader
11 Citations
Background Citations
2
Methods Citations
2

11 Citations

Citation Type

Citation Type

High‐performance computing strategies for seismic‐imaging software on the cluster and cloud‐computing environments
TLDR
Two high‐performance computing techniques based on independent checkpointing alongside a fault‐tolerant framework to store an execution state and recover from that state in case of failures and a technique to reduce the amount of memory requirement that is called the hybrid strategy.
Adaptation of the FWM Algorithm to Cloud Computing
TLDR
Besides several precautions, cloud computing has many advantages for performing seismic imaging and inversion, and there is a great opportunity to optimally select computing resources to perfectly fit the needs of imaging dedicated seismic data.
Scaling through abstractions - high-performance vectorial wave simulations for seismic inversion with Devito
TLDR
The generation and simulation of MPI-parallel propagators (along with their adjoints) for the pseudo-acoustic wave-equation in tilted transverse isotropic media and the elastic wave-Equation are presented, demonstrating Devito's suitability for production-grade seismic inversion problems.
Serverless Containers – Rising Viable Approach to Scientific Workflows
TLDR
Evaluating the capabilities of elastic containers and their usefulness for scientific computing in the scientific workflow paradigm using AWS Fargate and Google Cloud Run infrastructures shows that serverless containers can be successfully utilized for running scientific workflows.
A dual formulation of wavefield reconstruction inversion for large-scale seismic inversion
Many of the seismic inversion techniques currently proposed that focus on robustness with respect to the background model choice are not apt to large-scale 3D applications, and the methods that are…
Ultra-low memory seismic inversion with randomized trace estimation
TLDR
A memory frugal and computationally efficient inversion methodology that uses techniques from randomized linear algebra is presented, capable of achieving competitive inversion results at a fraction of the memory cost of conventional full-waveform inversion with limited computational overhead.
FaaSFlow: enable efficient workflow execution for function-as-a-service
TLDR
The design of a worker-side workflow schedule pattern for serverless workflow execution is presented and FaaSFlow is implemented to enable efficient workflow execution in the serverless context and an adaptive storage library FaaStore is proposed that enables fast data transfer between functions on the same node without through the database.
Time‐domain sparsity promoting least‐squares reverse time migration with source estimation
TLDR
It is demonstrated that the computational costs of inversion can be reduced significantly while avoiding imaging artifacts and restoring amplitudes while inspired by recent results in stochastic optimization and transform-domain sparsity-promotion.
A Tectonic Shift in Analytics and Computing Is Coming
Artificial intelligence combined with high-performance computing could trigger a fundamental change in how geoscientists extract knowledge from large volumes of data.
Survey on serverless computing
TLDR
In this systematic survey, 275 research papers that examined serverless computing from well-known literature databases were extensively reviewed to extract useful data and the obtained data were analyzed to answer several research questions regarding state-of-the-art contributions.
...
...

References

SHOWING 1-10 OF 80 REFERENCES
Event-driven workflows for large-scale seismic imaging in the cloud
TLDR
This work presents a novel approach of bringing seismic imaging and inversion workflows to the cloud, which does not rely on a traditional HPC environment, but is based on serverless and event-driven computations.
Serverless seismic imaging in the cloud
This abstract presents a serverless approach to seismic imaging in the cloud based on high-throughput containerized batch processing, event-driven computations and a domain-specific language compiler…
Fast seismic modeling and Reverse Time Migration on a GPU cluster
TLDR
A fast parallel simulator that solves the acoustic wave equation on a GPU cluster, using CUDA to take advantage of the GPUs computational power and considers a finite difference approach on a regular mesh, in both 2D and 3D cases.
A large-scale framework for symbolic implementations of seismic inversion algorithms in Julia
Writing software packages for seismic inversion is a very challenging task because problems such as full-waveform inversion or least-squares imaging are algorithmically and computationally demanding…
Performance evaluation of Amazon Elastic Compute Cloud for NASA high‐performance computing applications
TLDR
This paper compares the performance characteristics of two Amazon EC2 HPC instance types with that of National Aeronautics and Space Administration's (NASA) Pleiades supercomputer, an SGI® ICE™ cluster.
Performance issues and performance analysis tools for HPC cloud applications: a survey
TLDR
A survey of various High Performance Computing applications and possible performance concerns while executing applications in cloud is presented, pointing out the need for Performance Analysis (PA) tools, and the study of cloud-based PA tools in detail.
Benchmarking Bare Metal Cloud Servers for HPC Applications
TLDR
This paper presents a study on the performance and scalability of Open stack based bare metal cloud servers, using a popular HPC benchmark suite, and demonstrates excellent scaling performance of bareMetal cloud servers.
Devito (v3.1.0): an embedded domain-specific language for finite differences and geophysical exploration
Abstract. We introduce Devito, a new domain-specific language for implementing high-performance finite difference partial differential equation solvers. The motivating application is exploration…
Compressive least-squares migration with on-the-fly Fourier transforms
TLDR
This work introduces an algorithm for low-cost sparsity-promoting least-squares migration using on the-fly Fourier transforms to formulate the least-Squares migration objective function.
Evaluation of HPC Applications on Cloud
TLDR
The results show that Cloud is viable platform for some applications, specifically, non communicationintensive applications such as embarrassingly parallel and tree-structured computations up to high processor count and for communication-intensive applications up to low processor count.
...
...