Evaluation of HPC Applications on Cloud

  title={Evaluation of HPC Applications on Cloud},
  author={Abhishek K. Gupta and Dejan S. Milojicic},
  journal={2011 Sixth Open Cirrus Summit},
HPC applications are increasingly being used in academia and laboratories for scientific research and in industries for business and analytics. Cloud computing offers the benefits of virtualization, elasticity of resources and elimination of cluster setup cost and time to HPC applications users. However, poor network performance, performance variation and OS noise are some of the challenges for execution of HPC applications on Cloud. In this paper, we propose that Cloud can be viable platform… 

Figures and Tables from this paper

Evaluating and Improving the Performance and Scheduling of HPC Applications in Cloud

This paper performs comprehensive performance and cost evaluation and analysis of running a set of HPC applications on a range of platforms, varying from supercomputers to clouds, and presents novel heuristics for online application-aware job scheduling in multi-platform environments.

Towards Efficient Mapping, Scheduling, and Execution of HPC Applications on Platforms in Cloud

  • Abhishek K. GuptaL. Kalé
  • Computer Science
    2013 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum
  • 2013
The primary thesis is that cloud is suitable for some HPC applications not all applications, and for those applications, cloud can be more cost-effective compared to typical dedicated HPC platforms using intelligent application-to-platform mapping, HPC-aware cloud schedulers, and cloud-aware HPC execution and parallel runtime system.

HPC Cloud for Scientific and Business Applications

A survey and taxonomy of efforts in HPC cloud and a vision on what is ahead of us, including a set of research challenges that, once tackled, can help advance businesses and scientific discoveries are brought.

Reconfigurable Cloud

Reconfigurable Cloud, cloud which is able to accommodate commodity application and HPC application on the same hardware is presented which solves the above issues by isolating HPC workload from other users and by giving near native performance for running HPC applications.

Scalable Computing: Practice and Experience

This paper evaluates the performance of HPC applications on Microsoft Azure cloud platform using the well-known NAS parallel benchmarks and finds that Azure platform has better shared-memory communication performance than Amazon platform.

Improving HPC Application Performance in Cloud through Dynamic Load Balancing

This paper presents a dynamic load balancer that infers the static hardware heterogeneity in virtualized environments, and also adapts to the dynamic heterogeneity caused by the interference arising due to multi-tenancy.

Optimization of performance and scheduling of HPC applications in cloud using cloudsim and scheduling approach

A novel heuristics for online application-aware job scheduling in multi-platform environments is presented and Experimental results and Simulations show that current clouds cannot substitute supercomputers but can effectively complement them.

Performance issues and performance analysis tools for HPC cloud applications: a survey

A survey of various High Performance Computing applications and possible performance concerns while executing applications in cloud is presented, pointing out the need for Performance Analysis (PA) tools, and the study of cloud-based PA tools in detail.



Case study for running HPC applications in public clouds

The results show that 1) virtualization technology, which is widely used by cloud computing, adds little performance overhead; 2) most current public clouds are not designed for running scientific applications primarily due to their poor networking capabilities; however, a cloud with moderately better network will deliver a significant performance improvement.

Performance Analysis of High Performance Computing Applications on the Amazon Web Services Cloud

This work represents the most comprehensive evaluation to date comparing conventional HPC platforms to Amazon EC2, using real applications representative of the workload at a typical supercomputing center, and results indicate that EC2 is six times slower than a typical mid-range Linux cluster, and twenty times faster than a modern HPC system.

Performance Analysis of Cloud Computing Services for Many-Tasks Scientific Computing

The results indicate that the current clouds need an order of magnitude in performance improvement to be useful to the scientific community, and show which improvements should be considered first to address this discrepancy between offer and demand.

High Performance Parallel Computing with Clouds and Cloud Technologies

This paper first discusses large scale data analysis using different MapReduce implementations and then, a performance analysis of high performance parallel applications on virtualized resources is presented.

Benchmarking Amazon EC2 for High-Performance Scientific Computing

  • E. Walker
  • Computer Science
    login Usenix Mag.
  • 2008
Examining the performance of Amazon EC2 for high-performance scientific applications shows a significant performance gap that system builders, computational scientist, and commercial cloud computing vendors need to be aware of.

Can cloud computing reach the top500?

Computing as a utility has reached the mainstream. Scientists can now rent time on large commercial clusters through several vendors. The cloud computing model provides flexible support for "pay as

The Eucalyptus Open-Source Cloud-Computing System

This work presents Eucalyptus -- an open-source software framework for cloud computing that implements what is commonly referred to as Infrastructure as a Service (IaaS); systems that give users the ability to run and control entire virtual machine instances deployed across a variety physical resources.

Overcoming scaling challenges in biomolecular simulations across multiple platforms

New scalability challenges in biomolecular simulations: using much larger machines and simulating molecular systems with millions of atoms are described, and new techniques developed to overcome these challenges are described.

The Nas Parallel Benchmarks

A new set of benchmarks has been developed for the performance evaluation of highly parallel supercom puters that mimic the computation and data move ment characteristics of large-scale computational fluid dynamics applications.

Cloud Computing for parallel Scientific HPC Applications: Feasibility of Running Coupled Atmosphere-

An embodiment of the present invention is a process for modifying a polyamide polymer comprising contacting a reactive modifier with diamine then contacting the resulting modified diamine with diacid and/or lactam to form a modified polyamide.