Big Data strategies for Data Center Infrastructure management using a 3D gaming platform

@article{Hubbell2015BigDS,
  title={Big Data strategies for Data Center Infrastructure management using a 3D gaming platform},
  author={Matthew Hubbell and Andrew Moran and William Arcand and David Bestor and Bill Bergeron and Chansup Byun and Vijay N. Gadepally and Peter Michaleas and Julie Mullen and Andrew Prout and A. Reuther and Antonio Rosa and Charles Yee and Jeremy Kepner},
  journal={2015 IEEE High Performance Extreme Computing Conference (HPEC)},
  year={2015},
  pages={1-6}
}
High Performance Computing (HPC) is intrinsically linked to effective Data Center Infrastructure Management (DCIM). Cloud services and HPC have become key components in Department of Defense and corporate Information Technology competitive strategies in the global and commercial spaces. As a result, the reliance on consistent, reliable Data Center space is more critical than ever. The costs and complexity of providing quality DCIM are constantly being tested and evaluated by the United States… 

Figures from this paper

Scaling Big Data Platform for Big Data Pipeline
TLDR
This paper will show how Accumulo, d4m, and Unity are used to generate a 3D visualization platform to monitor and manage the Lincoln Laboratory Supercomputer systems and how the approach has had to retool to scale with the systems.
A Reliable, Non-Invasive Approach to Data Center Monitoring and Management
TLDR
This work presents an innovative approach to address some of the challenges that currently hinder data center management, and explains how monitoring and management systems should be envisioned and implemented.
Data center maintenance: applications and future research directions
TLDR
The issues and challenges for DC buildings and facilities are identified and a conclusion of the findings is provided to highlight the main research limitations for discovering new potential methods as future research opportunities.
Multidisciplinary system design optimization of fiber-optic networks within data centers
TLDR
The results demonstrate that data center life-cycle costs are most sensitive to power costs, 10G OM4 multi-mode optical fiber is Pareto optimal for long reach and low user capacity needs, and 100G OM3 multi- mode optical fiber has been found to be Pare to optimal for short reach and highuser capacity needs.
Optimizing the Visualization Pipeline of a 3-D Monitoring and Management System
TLDR
This paper will show how Accumulo, d4m, and Unity are used to generate a 3D visualization platform to monitor and manage the Lincoln Laboratory Supercomputer systems and how the approach has had to retool to scale with the systems.
A demonstration of monitoring and measuring data centers for energy efficiency using opensource tools
TLDR
This paper details how it is possible to construct the key data center infrastructure management elements of monitoring and measuring by a combination of available opensource software tools that permit both scalability and an environment where analytics can be employed on the data center operation, which can offer relevant insight into energy efficient operational practices.
Employing Augmented Reality for Cybersecurity Operations in High Performance Computing Environments
TLDR
An augmented reality based framework for storing, analyzing, visualizing and augmenting data at the HPC centers is proposed with the goal of improving the data presentation, forecasting, analysis and decision making, thus reducing the time to insight and learning the HPS security operations to combat increasing cyber physical threats.
A new approach to data center infrastructure monitoring and management (DCIMM)
  • Moises Levy, J. Hallstrom
  • Computer Science
    2017 IEEE 7th Annual Computing and Communication Workshop and Conference (CCWC)
  • 2017
TLDR
A monitoring system that collects data to help users make more informed decisions, reduce downtime and cost of operations, improve efficiency, perform energy audits, plan space usage, and develop predictive behavior models is described.
3D Real-Time Supercomputer Monitoring
TLDR
This system allows operators to quickly assess how the supercomputer is being used, gives users visibility into the resources they are consuming, and provides instructors new ways to interactively teach the computing architecture concepts necessary for efficient computing.
Benchmarking data analysis and machine learning applications on the Intel KNL many-core processor
TLDR
Data analysis benchmarks of these application on the Intel KNL processor indicate that single-core double-precision generalized matrix multiply (DGEMM) performance on KNL systems has improved by ∼3.5× compared to prior Intel Xeon technologies.
...
1
2
...

References

SHOWING 1-10 OF 12 REFERENCES
Dynamic distributed dimensional data model (D4M) database and computation system
  • J. Kepner, W. Arcand, Charles Yee
  • Computer Science
    2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
  • 2012
TLDR
D4M (Dynamic Distributed Dimensional Data Model) has been developed to provide a mathematically rich interface to tuple stores (and structured query language “SQL” databases) and it is possible to create composable analytics with significantly less effort than using traditional approaches.
D4M 2.0 schema: A general purpose high performance schema for the Accumulo database
TLDR
This paper presents the D4M 2.0 Schema, a general purpose schema that can be used to fully index and rapidly query every unique string in a dataset, which has been applied with little or no customization to cyber, bioinformatics, scientific citation, free text, and social media data.
TX-2500 - An Interactive, On-Demand Rapid-Prototyping HPC System
TLDR
MIT Lincoln Laboratory has just enabled its next generation LLGrid interactive/on-demand parallel computing system, which consists of ~1500 InfiniBand connected processors, ~6 Terabytes of RAM and ~0.8 Petabytes of local disk/virtual memory.
Associative Arrays: Unified Mathematics for Spreadsheets, Databases, Matrices, and Graphs
TLDR
Associative arrays reduce the effort required to pass data between steps in a data processing system, allow steps to be interchanged with full confidence that the results will be unchanged, and make it possible to recognize when steps can be simplified or eliminated.
Time Flies When You're Having Fun: Cognitive Absorption and Beliefs About Information Technology Usage
TLDR
It is proposed that the individual traits of playfulness and personal innovativeness are important determinants of cognitive absorption, and operational measures for each dimension of this multi-dimensional construct are developed.
Market Trends: Addressable DCIM Market
  • Market Trends: Addressable DCIM Market
  • 2012
Benchmarking the MIT- LL TX-Green System
  • HPCMP User's Group Meeting, June 21-23, 2011.
  • 2011
Benchmarking the MIT- LL TX-Green System HPCMP User's Group Meeting
  • Benchmarking the MIT- LL TX-Green System HPCMP User's Group Meeting
  • 2011
Serious games
Video games (digital computer games, short: games) are very popular and successful, both as leisure activity and contemporary information and communication medium in the digital age, and as relevant
DCIM: Going Beyond IT
  • Gartner ID G00174769
  • 2010
...
1
2
...