CLOUDLIGHTNING: A Framework for a Self-organising and Self-managing Heterogeneous Cloud

@inproceedings{Lynn2016CLOUDLIGHTNINGAF,
  title={CLOUDLIGHTNING: A Framework for a Self-organising and Self-managing Heterogeneous Cloud},
  author={Theo Lynn and Huanhuan Xiong and Dapeng Dong and Bilal Al Momani and George A. Gravvanis and C. K. Filelis-Papadopoulos and Anne C. Elster and Malik Murtaza Khan and Dimitrios Tzovaras and Konstantinos M. Giannoutakis and Dana Petcu and Marian Neagul and Ioan Dragon and Perumal Kuppudayar and Suryanarayanan Natarajan and M. Garrett McGrath and Georgi Gaydadjiev and Tobias Becker and Anna Gourinovitch and David Kenny and John P. Morrison},
  booktitle={CLOSER},
  year={2016}
}
As clouds increase in size and as machines of different types are added to the infrastructure in order to maximize performance and power efficiency, heterogeneous clouds are being created. However, exploiting different architectures poses significant challenges. To efficiently access heterogeneous resources and, at the same time, to exploit these resources to reduce application development effort, to make optimisations easier and to simplify service deployment, requires a re-evaluation of our… Expand
View PDF
28 Citations
Background Citations
9
Methods Citations
6

28 Citations

Citation Type

Citation Type

Heterogeneous Resource Management and Orchestration in Cloud Environments
TLDR
Two candidate approaches to an integrated approach to heterogeneous resource management that is cognizant of the unique advantages of different hardware types are introduced to address the management challenge of accelerated uptake of heterogeneous resources. Expand
A Decentralized Cloud Management Architecture Based on Application Autonomous Systems
TLDR
The responsibility of cloud application management and partially the resource management has shifted from service providers to the consumers in this decentralized system architecture. Expand
Characterization of hardware in self-managing self-organizing Cloud environment
TLDR
The technique is based on indexes built upon ratios to baseline hardware with respect to three of the applications involved in the CloudLightning project: Oil and Gas, Ray-Tracing, Dense and Sparse matrix Computations. Expand
Managing and Unifying Heterogeneous Resources in Cloud Environments
TLDR
A mechanism for accessing heterogeneous resources through the integration of various cloud management platforms is presented and a demonstrative use case is given to illustrate the applicability of the proposed solution. Expand
CloudLightning Simulation and Evaluation Roadmap
TLDR
The parameters, constraints and limitation being considered as part of the design and construction of that simulation environment of the CloudLightning system are outlined. Expand
A framework for simulating large scale cloud infrastructures
TLDR
A framework for simulating large number of heterogeneous cloud nodes organized in Cells and executing large numbers of HPC tasks is proposed, inherently parallel and designed for hybrid distributed memory parallel systems, supporting CPU, memory and network over-commitment. Expand
Self-Healing in a Decentralised Cloud Management System
TLDR
A layered master-slave structure is proposed, providing the reliability and high availability for a decentralised, hierarchical cloud architecture and self-healing concepts are introduced for autonomic cloud management. Expand
Large-scale simulation of a self-organizing self-management cloud computing framework
TLDR
Implementation details of the new functionalities on the parallel cloud simulation framework are discussed, while numerical results are given for the scalability and utilization of the cloud elements using the self-organization and self-management framework with two VM placement strategies. Expand
An ontology for heterogeneous resources management interoperability and HPC in the cloud
TLDR
A generic architecture is presented as a driver to manage heterogeneity in the Cloud and the internal architecture of the CloudLightning system is redesigned and presented to show the feasibility of incorporating a semantic engine to alleviate interoperability issues to facilitate the incorporation of HPC in Cloud. Expand
Towards the Integration of a HPC Build System in the Cloud Ecosystem
TLDR
This research is based on a self-organizing, self-management approach and investigates the option of self-configuration, supported by the easybuild toolchain. Expand
...
1
2
3
...

References

SHOWING 1-10 OF 23 REFERENCES
An Auction-driven Self-organizing Cloud Delivery Model
TLDR
This work sketches a self-organizing architecture for very large compute clouds composed of many-core processors and heterogeneous coprocessors configured to bid to meet the needs identified in a high-level task or service specification. Expand
Towards Self-Manageable Cloud Services
  • I. Brandić
  • Computer Science
  • 2009 33rd Annual IEEE International Computer Software and Applications Conference
  • 2009
TLDR
Based on the life cycle of a self-manageable Cloud service, a resource submission taxonomy is derived and the application of autonomic computing to Cloud services based on service mediation and negotiation bootstrapping case study is discussed. Expand
Energy-aware resource allocation heuristics for efficient management of data centers for Cloud computing
TLDR
An architectural framework and principles for energy-efficient Cloud computing are defined and the proposed energy-aware allocation heuristics provision data center resources to client applications in a way that improves energy efficiency of the data center, while delivering the negotiated Quality of Service (QoS). Expand
Energy-Aware Profiling for Cloud Computing Environments
TLDR
An adapted existing Cloud architecture is presented to enable energy-aware profiling based on the proposed system and the results of the conducted experiments show energy-awareness at physical host and virtual machine levels. Expand
Energy Consumption in Cloud Computing Data Centers
TLDR
Energy consumption patterns are investigated and it is shown that by applying suitable optimization policies directed through the authors' energy consumption models, it is possible to save 20% of energy consumption in cloud data centers. Expand
Heterogeneous Cloud Computing: The Way Forward
TLDR
This work states that exponential growth in microprocessor capability, mirroring Moore's law, has helped to improve performance for most applications that execute on general-purpose processors, including those deployed on clouds. Expand
Self-Managed Systems: an Architectural Challenge
TLDR
Some of the current promising work in self-management is discussed and an outline three-layer reference model is presented as a context in which to articulate some of the main outstanding research challenges. Expand
Energy Efficient Utilization of Resources in Cloud Computing Systems
-Abstract the energy consumption of under-utilized resources, particularly in a cloud environment, accounts for a substantial amount of the actual energy use. Inherently, a resource allocation… Expand
Autonomic Computing: An Overview
The increasing scale complexity, heterogeneity and dynamism of networks, systems and applications have made our computational and information infrastructure brittle, unmanageable and insecure. This… Expand
Self-Management: The Solution to Complexity or Just Another Problem?
TLDR
Self-management is the solution only if it can first solve several open problems, because it's not realistic for human operators to maintain control over a system that consists of thousands of networked computers, mobile clients, and numerous application servers and databases. Expand
...
1
2
3
...