Hyperscaling Internet Graph Analysis with D4M on the MIT SuperCloud

@article{Gadepally2018HyperscalingIG,
  title={Hyperscaling Internet Graph Analysis with D4M on the MIT SuperCloud},
  author={Vijay Gadepally and Jeremy Kepner and Lauren Milechin and William Arcand and David Bestor and Bill Bergeron and Chansup Byun and Matthew Hubbell and Michael Houle and Michael Jones and Peter Michaleas and Julie Mullen and Andrew Prout and Antonio Rosa and Charles Yee and Siddharth Samsi and Albert Reuther},
  journal={2018 IEEE High Performance extreme Computing Conference (HPEC)},
  year={2018},
  pages={1-6}
}
Detecting anomalous behavior in network traffic is a major challenge due to the volume and velocity of network traffic. For example, a 10 Gigabit Ethernet connection can generate over 50 MB/s of packet headers. For global network providers, this challenge can be amplified by many orders of magnitude. Development of novel computer network traffic analytics requires: high level programming environments, massive amount of packet capture (PCAP) data, and diverse data products for “at scale… CONTINUE READING
2
Twitter Mentions

Citations

Publications citing this paper.

References

Publications referenced by this paper.
SHOWING 1-10 OF 31 REFERENCES

MIT SuperCloud portal workspace: Enabling HPC web application deployment

  • 2017 IEEE High Performance Extreme Computing Conference (HPEC)
  • 2017
VIEW 1 EXCERPT

Associative array model of SQL, NoSQL, and NewSQL databases

  • 2016 IEEE High Performance Extreme Computing Conference (HPEC)
  • 2016
VIEW 1 EXCERPT

Cisco global cloud index: Forecast and methodology, 2015-2020. white paper

C. V. Networking
  • Cisco Public, San Jose, 2016.
  • 2016
VIEW 1 EXCERPT

LLMapReduce: Multi-level map-reduce for high performance data analysis

  • 2016 IEEE High Performance Extreme Computing Conference (HPEC)
  • 2016
VIEW 1 EXCERPT

D4M: Bringing associative arrays to database engines

  • 2015 IEEE High Performance Extreme Computing Conference (HPEC)
  • 2015
VIEW 1 EXCERPT

Enabling on-demand database computing with MIT SuperCloud database management system

  • 2015 IEEE High Performance Extreme Computing Conference (HPEC)
  • 2015
VIEW 1 EXCERPT

Using a Power Law distribution to describe big data

  • 2015 IEEE High Performance Extreme Computing Conference (HPEC)
  • 2015
VIEW 1 EXCERPT

Achieving 100,000,000 database inserts per second using Accumulo and D4M

  • 2014 IEEE High Performance Extreme Computing Conference (HPEC)
  • 2014
VIEW 1 EXCERPT

Similar Papers

Loading similar papers…