Cloud-Based Software Platform for Big Data Analytics in Smart Grids

  title={Cloud-Based Software Platform for Big Data Analytics in Smart Grids},
  author={Yogesh L. Simmhan and Saima Aman and Alok Gautam Kumbhare and Rongyang Liu and Sam Stevens and Qunzhi Zhou and Viktor K. Prasanna},
  journal={Computing in Science \& Engineering},
This article focuses on a scalable software platform for the Smart Grid cyber-physical system using cloud technologies. Dynamic Demand Response (D2R) is a challenge-application to perform intelligent demand-side management and relieve peak load in Smart Power Grids. The platform offers an adaptive information integration pipeline for ingesting dynamic data; a secure repository for researchers to share knowledge; scalable machine-learning models trained over massive datasets for agile demand… 

Figures from this paper

Cloud-based visual analytics for smart grids big data
  • Amr A. Munshi, Y. Mohamed
  • Engineering
    2016 IEEE Power & Energy Society Innovative Smart Grid Technologies Conference (ISGT)
  • 2016
A visual analytics framework that can promote the sustainability of the smart grid and is feasible in performing visual analytics and further smart grid data analytics is presented.
Data Lake Lambda Architecture for Smart Grids Big Data Analytics
A smart grid big data eco-system based on the state-of-the-art Lambda architecture that is capable of performing parallel batch and real-time operations on distributed data and utilizes a Hadoop Big Data Lake to store various types of smart grid data.
Smart Grid Big Data Analytics: Survey of Technologies, Techniques, and Applications
The paper provides deep insights into various big data technologies and discusses big data analytics in the context of the smart grid and presents the challenges and opportunities brought by the advent of machine learning and big data from smart grids.
An Adaptive Data Management Model for Smart Grid
  • Xu Daqing, Han Yinghua
  • Engineering, Computer Science
    2015 8th International Conference on Intelligent Computation Technology and Automation (ICICTA)
  • 2015
A data management model based on knowledge cube, which is an intelligent and adaptive database, provides a powerful and extensible framework that is particularly well suited to analyzing big variety data in smart grid.
A Survey on Realtime Analytics Frameworkfor Smart Grid Energy Management
This paper surveys the existing methodologies and means for real time energy data management in smart grids and concludes that near real time efficient analytics of streaming smart meter data and quick decision making is significant.
Intelligent Cloud Based Decision Support Framework for Smart Grid
An Intelligent Cloud Based Decision Support framework for Smart Grid for Big-Data management and analysis and the important role of NoSQL systems in solving challenges the progress of smart grid is focused on.
Data Management System for Energy Analytics and its Application to Forecasting
The design of the system was inspired by the realworld use case of forecasting short-term energy demand in Vermont, using data from a combination of SCADA, smart meters and weather forecasting services, and a general data model addressing the aforementioned challenges and aimed at supporting advanced data analytics is introduced.
Summary of Cloud Computing Technology in Smart Grid
This paper provides a comprehensive research on different cloud computing applications for the smart grid architecture, in three different areas-energy management, cloud monitoring and security, and gives directions on future opportunities for the development of the smartgrid.


Semantic Information Modeling for Emerging Applications in Smart Grid
An integrated Smart Grid information model is developed using Semantic Web techniques and it is shown the semantic model facilitates information integration and knowledge representation for developing the next generation Smart Grid applications.
Improving Energy Use Forecast for Campus Micro-grids Using Indirect Indicators
This work uses novel indirect indicators of energy that are commonly available to train regression tree models that can predict campus and building energy use for coarse and fine time intervals, utilizing 3 years of sensor data collected at 15min intervals from 170 smart power meters.
The New Frontier of Smart Grids
The power grid is a massive interconnected network used to deliver electricity from suppliers to consumers and has been a vital energy supply. To minimize the impact of climate change while at the
Scalable regression tree learning on Hadoop using OpenPlanet
The performance of OpenPlanet is evaluated using real world datasets from the Smart Power Grid domain for energy use forecasting, and tuning strategies of Hadoop parameters are proposed to improve the performance of the default configuration by 75% for a training dataset of 17 million tuples.
The Fourth Paradigm: Data-Intensive Scientific Discovery
This presentation will set out the eScience agenda by explaining the current scientific data deluge and the case for a “Fourth Paradigm” for scientific exploration. Examples of data intensive science
Putting the 'smarts' into the smart grid
A research agenda for making the smart grid a reality is presented, with a focus on energy efficiency, smart grids and smart cities.
Cryptonite: A Secure and Performant Data Repository on Public Clouds
Describing the Cryptonite service and desktop client, discussing performance optimizations, and providing an empirical analysis of the improvements shows that Cryptonite clients achieve a 40% improvement in file upload bandwidth over plaintext storage using the Azure Storage Client API despite the added security benefits.
Automated Demand Response: The Missing Link in the Electricity Value Chain
Automated Demand Response: The Missing Link in the Electricity Value Chain Aimee McKane, Lawrence Berkeley National Laboratory Ivin Rhyne, California Energy Commission Alex Lekov, Lawrence Berkeley
Water and Power (LADWP), 2012 Power Integrated Resource Plan with Appendices, draft report
  • Water and Power (LADWP), 2012 Power Integrated Resource Plan with Appendices, draft report
  • 2012