ASETS: A SDN Empowered Task Scheduling System for HPCaaS on the Cloud

@article{Jamalian2015ASETSAS,
  title={ASETS: A SDN Empowered Task Scheduling System for HPCaaS on the Cloud},
  author={Saba Jamalian and Hassan Rajaei},
  journal={2015 IEEE International Conference on Cloud Engineering},
  year={2015},
  pages={329-334}
}
  • S. Jamalian, H. Rajaei
  • Published 9 March 2015
  • Computer Science
  • 2015 IEEE International Conference on Cloud Engineering
With increasing demands for High Performance Computing (HPC), new ideas and methods are emerged to utilize computing resources more efficiently. Cloud Computing appears to provide benefits such as resource pooling, broad network access and cost efficiency for the HPC applications. However, moving the HPC applications to the cloud can face several key challenges, primarily, the virtualization overhead, multi-tenancy and network latency. Software-Defined Networking (SDN) as an emerging technology… 

Figures and Tables from this paper

Data-Intensive HPC Tasks Scheduling with SDN to Enable HPC-as-a-Service

TLDR
Preliminary results indicate that ASETS delivers substantial performance improvement for HPCaaS as the degree of multi-tenancy increases, which is significant since it indicates both the users and the cloud service providers can benefit from ASETS.

Dynamic Resource Allocation And Job Scheduling To Enhance The Performance Of HPC With SDN A Review

TLDR
It is seen that the decrease in network latency and better bandwidth usage in SDN is accomplished just when it has dynamic allocation of resources and job scheduling standards.

HPC Cloud Architecture to Reduce HPC Workflow Complexity in Containerized Environments

TLDR
Experimental results indicated that the proposed HPC cloud architecture can reduce complexity to provide supercomputing resource scalability, high performance, user convenience, various HPC applications, and management efficiency.

Energy Optimization of an Elastic Computer Cluster with a SDN Controller

TLDR
The research carried out in this paper highlights a novel model for energy optimization of elastic computing clusters based on optimizing the energv required for intra cluster and inter cluster communication using SDN.

A dististributed simulation platform for cloud computing

TLDR
A new platform Distributed Simulation for Could Computing (DSC) developed, to facilitate implementation and parallel execution of simulations models in the cloud and enables simulation users to seamlessly interact with a cloud environment and receive benefits of the cloud for their applications.

Quality of Service in Software Defined Networks for Scientific Applications: Opportunities and Challenges

TLDR
QoS is an open issue to incorporate in scientific applications that are running in an SDN and the challenges to join both these paradigms are identified, and a strategy to provide QoS to scientific Applications that are being executed among SDN-Enabled distributed data centers is presented.

HPC as a Service on Cloud: A Market Oriented Approach

TLDR
This paper provides solution for one of these problems as a costing model for HPC as a services on the cloud environment so that it will enable the small organization to have their own HPC systems at the low costs.

Architectures for cloud-based HPC in data centers

TLDR
This paper explores architectures of HPC and cloud services in data centers and highlights the benefits of integrating these architectures, providing multiple benefits for scientific, industrial and enterprise organizations.

Implementation of Costing Model for High Performance Computing as a Services on the Cloud Environment

TLDR
This paper proposes and implements a costing model and algorithms with respect to resource pool for HPCaaS on the Cloud environment so that small organization can afford to have their own HPC systems at the low costs.

References

SHOWING 1-10 OF 27 REFERENCES

Bandwidth-Aware Scheduling With SDN in Hadoop: A New Trend for Big Data

TLDR
BASS is the first to exploit talent of SDN for job scheduling of big data processing and believes that it points out a new trend for large-scale data processing.

Building a Private HPC Cloud for Compute and Data-Intensive Applications

TLDR
This paper reports on the practice and experiences in building a private HPC cloud using a subset of a traditional HPC cluster, and shows that even if the overhead of virtualization is present, efficient scalability for virtual clusters can be achieved by understanding the effects ofvirtualization overheads on various types of HPC and Big Data workloads.

The Impact of Virtualization on Network Performance of Amazon EC2 Data Center

TLDR
The results show that even though the data center network is lightly utilized, virtualization can still cause significant throughput instability and abnormal delay variations.

Performance analysis of HPC applications in the cloud

CloudKon: a CLOUD-enabled distributed tasK executiON framework

TLDR
This work is to provide a compact, lightweight, scalable, and distributed task execution framework (CloudKon) that builds upon cloud computing building blocks (Amazon EC2, SQS, and DynamoDB) and will outline the possible support of HPC applications as well.

Cloud computing networking: challenges and opportunities for innovations

TLDR
This work presents the networking issues in IaaS and federation challenges that are currently addressed with existing technologies and presents innovative software-defined networking proposals, which are applied to some of the challenges and could be used in future deployments as efficient solutions.

Moldable Job Scheduling for HPC as a Service

TLDR
A moldable job scheduling approach is proposed which relieves HPC users’ burden of selecting an appropriate number of processors and can achieve even better system performance than existing job scheduling methods.

Case study for running HPC applications in public clouds

TLDR
The results show that 1) virtualization technology, which is widely used by cloud computing, adds little performance overhead; 2) most current public clouds are not designed for running scientific applications primarily due to their poor networking capabilities; however, a cloud with moderately better network will deliver a significant performance improvement.

Exposing HPC and sequential applications as services through the development and deployment of a SaaS cloud