ASETS: A SDN Empowered Task Scheduling System for HPCaaS on the Cloud

  title={ASETS: A SDN Empowered Task Scheduling System for HPCaaS on the Cloud},
  author={S. Jamalian and H. Rajaei},
  journal={2015 IEEE International Conference on Cloud Engineering},
  • S. Jamalian, H. Rajaei
  • Published 2015
  • Computer Science
  • 2015 IEEE International Conference on Cloud Engineering
With increasing demands for High Performance Computing (HPC), new ideas and methods are emerged to utilize computing resources more efficiently. Cloud Computing appears to provide benefits such as resource pooling, broad network access and cost efficiency for the HPC applications. However, moving the HPC applications to the cloud can face several key challenges, primarily, the virtualization overhead, multi-tenancy and network latency. Software-Defined Networking (SDN) as an emerging technology… Expand
Data-Intensive HPC Tasks Scheduling with SDN to Enable HPC-as-a-Service
Preliminary results indicate that ASETS delivers substantial performance improvement for HPCaaS as the degree of multi-tenancy increases, which is significant since it indicates both the users and the cloud service providers can benefit from ASETS. Expand
Energy Optimization of an Elastic Computer Cluster with a SDN Controller
The research carried out in this paper highlights a novel model for energy optimization of elastic computing clusters based on optimizing the energv required for intra cluster and inter cluster communication using SDN. Expand
A dististributed simulation platform for cloud computing
A new platform Distributed Simulation for Could Computing (DSC) developed, to facilitate implementation and parallel execution of simulations models in the cloud and enables simulation users to seamlessly interact with a cloud environment and receive benefits of the cloud for their applications. Expand
HPC as a Service on Cloud: A Market Oriented Approach
Cloud is a latest technology used in most of enterprise. Every enterprise is moving towards the cloud platform. On the other hand High Performance Computing (HPC) is a necessity for manyExpand
Architectures for cloud-based HPC in data centers
This paper explores architectures of HPC and cloud services in data centers and highlights the benefits of integrating these architectures, providing multiple benefits for scientific, industrial and enterprise organizations. Expand
Implementation of Costing Model for High Performance Computing as a Services on the Cloud Environment
This paper proposes and implements a costing model and algorithms with respect to resource pool for HPCaaS on the Cloud environment so that small organization can afford to have their own HPC systems at the low costs. Expand
A systematic review of scheduling approaches on multi-tenancy cloud platforms
A systematic literature review of research studies related to multi-tenancy scheduling approaches on cloud platforms determine the primary scheduling approaches currently used and the challenges for addressing key multi-Tenancy scheduling issues. Expand
Deployment and Analysis of a Hybrid Shared/Distributed-Memory Parallel Visualization Tool for 3-D Oil Reservoir Grid on OpenStack Cloud Computing
This article experimentally study the parallelization of intensive computation for a 3-D (three dimensional) oil reservoir data visualization tool, and proposes a hybrid (shared memory and distributed memory) parallelization technique to adapt with the data processing scalability. Expand


CLOUDRB: A framework for scheduling and managing High-Performance Computing (HPC) applications in science cloud
A CLOUD Resource Broker (CLOUDRB) for efficiently managing cloud resources and completing jobs for scientific applications within a user-specified deadline is designed and integrated with a Deadline-based Job Scheduling and Particle Swarm Optimization-based Resource Allocation mechanism. Expand
Bandwidth-Aware Scheduling With SDN in Hadoop: A New Trend for Big Data
BASS is the first to exploit talent of SDN for job scheduling of big data processing and believes that it points out a new trend for large-scale data processing. Expand
Building a Private HPC Cloud for Compute and Data-Intensive Applications
This paper reports on the practice and experiences in building a private HPC cloud using a subset of a traditional HPC cluster, and shows that even if the overhead of virtualization is present, efficient scalability for virtual clusters can be achieved by understanding the effects ofvirtualization overheads on various types of HPC and Big Data workloads. Expand
The Impact of Virtualization on Network Performance of Amazon EC2 Data Center
The results show that even though the data center network is lightly utilized, virtualization can still cause significant throughput instability and abnormal delay variations. Expand
Performance analysis of HPC applications in the cloud
This paper analyzes the main performance bottlenecks in HPC application scalability on the Amazon EC2 Cluster Compute platform and proposes the combination of message-passing with multithreading as the most scalable and cost-effective option for running HPC applications on the Bezos-owned platform. Expand
CloudKon: a CLOUD-enabled distributed tasK executiON framework
— Task scheduling and execution over large scale, distributed systems plays an important role on achieving good performance and high system utilization. Job management systems need to supportExpand
Cloud computing networking: challenges and opportunities for innovations
This work presents the networking issues in IaaS and federation challenges that are currently addressed with existing technologies and presents innovative software-defined networking proposals, which are applied to some of the challenges and could be used in future deployments as efficient solutions. Expand
Moldable Job Scheduling for HPC as a Service
A moldable job scheduling approach is proposed which relieves HPC users’ burden of selecting an appropriate number of processors and can achieve even better system performance than existing job scheduling methods. Expand
Case study for running HPC applications in public clouds
The results show that 1) virtualization technology, which is widely used by cloud computing, adds little performance overhead; 2) most current public clouds are not designed for running scientific applications primarily due to their poor networking capabilities; however, a cloud with moderately better network will deliver a significant performance improvement. Expand
Exposing HPC and sequential applications as services through the development and deployment of a SaaS cloud
The Uncinus platform, a bio-informatics workflow was executed on a private (HPC) cloud, server and public cloud (Amazon EC2) resources, performance results showing a 3 fold improvement compared to local resources' performance. Expand