Towards a Security-Aware Benchmarking Framework for Function-as-a-Service

  title={Towards a Security-Aware Benchmarking Framework for Function-as-a-Service},
  author={Roland Pellegrini and Igor Ivkic and Markus Tauber},
In a world, where complexity increases on a daily basis the Function-as-a-Service (FaaS) cloud model seams to take countermeasures. In comparison to other cloud models, the fast evolving FaaS increasingly abstracts the underlying infrastructure and refocuses on the application logic. This trend brings huge benefits in application and performance but comes with difficulties for benchmarking cloud applications. In this position paper, we present an initial investigation of benchmarking FaaS in… 

Figures from this paper

Function-as-a-Service Benchmarking Framework

The architectural design of a new Function- as-a-Service benchmarking tool is presented, which allows users to evaluate the performance of Cloud Functions and shows that users are able to get insights into Function-as- a-Service environments.

Development and Scalable Execution of Portable Function Choreographies Across Multiple Serverless Cloud Platforms

  • Computer Science
  • 2021
The AFCL Environment is introduced, a collection of modules which aim to solve provider-lock-in, allow an easy way to port existing applications to the cloud systems and execute FCs across different cloud providers.



Benchmarking the Performance Impact of Transport Layer Security in Cloud Database Systems

It is argued that in cloud database systems, configuration options should be chosen based on the degree of vulnerability to attacks and security threats as well as on the performance overhead of the respective algorithms.

A Reusable Architecture for Dependability and Performance Benchmarking of Cloud Services

A generic software architecture for dependability and performance benchmarking for cloud computing services is presented and various components and modules that are responsible for injecting faults in cloud services in addition to the components responsible for measuring the performance and dependability are provided.

Benchmarking Heterogeneous Cloud Functions

A cloud function benchmarking framework is developed, consisting of one suite based on Serverless Framework, and one based on HyperFlow, that evaluated all the major cloud function providers: AWS Lambda, Azure Functions, Google Cloud Functions and IBM OpenWhisk.

IaaS cloud benchmarking: approaches, challenges, and experience

  • A. Iosup
  • Computer Science
    HotTopiCS '13
  • 2013
This talk discusses empirical approaches to quantitative evaluation of IaaS clouds, toward cloud benchmarking, and initial results of the research into cloud workload characterization, including Big Data applications are presented.

Comparison of performance of Web services, WS-Security, RMI, and RMI-SSL

Cloud Service Benchmarking - Measuring Quality of Cloud Services from a Client Perspective

This book guides readers step-by-step through the process of designing, implementing and executing a cloud service benchmark, as well as understanding and dealing with its results.

Performance analysis of TLS Web servers

The results seem to suggest that, as CPUs become faster, the cryptographic costs of TLS will become dwarfed by the CPU costs of the nonsecurity aspects of a Web server.

Moving To The Cloud: Developing Apps in the New World of Cloud Computing

The basic foundations needed for developing both client-side and cloud-side applications covering compute/storage scaling, data parallelism, virtualization, MapReduce, RIA, SaaS and Mashups are covered.

Cloud Performance Modeling with Benchmark Evaluation of Elastic Scaling Strategies

It is demonstrated that the proposed cloud performance models are applicable to evaluate PaaS, SaaS and hybrid clouds as well and found that auto-scaling is easy to implement but tends to over provision the resources.

Benchmarking cloud serving systems with YCSB

This work presents the "Yahoo! Cloud Serving Benchmark" (YCSB) framework, with the goal of facilitating performance comparisons of the new generation of cloud data serving systems, and defines a core set of benchmarks and reports results for four widely used systems.