Distributed Mega-Datasets: The Need for Novel Computing Primitives
@article{Semmler2019DistributedMT, title={Distributed Mega-Datasets: The Need for Novel Computing Primitives}, author={Niklas Semmler and Georgios Smaragdakis and A. Feldmann}, journal={2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS)}, year={2019}, pages={1684-1692} }
With the ongoing digitalization, an increasing number of sensors is becoming part of our digital infrastructure. These sensors produce highly, even globally, distributed data streams. The aggregate data rate of these streams far exceeds local storage and computing capabilities. Yet, for radical new services (e.g., predictive maintenance and autonomous driving), which depend on various control loops, this data needs to be analyzed in a timely fashion. In this position paper, we outline a system… CONTINUE READING
Figures, Tables, and Topics from this paper
2 Citations
Online Replication Strategies for Distributed Data Stores
- Computer Science
- Open J. Internet Things
- 2019
- 2
- PDF
Edge replication strategies for wide-area distributed processing
- Computer Science
- EdgeSys@EuroSys
- 2020
- PDF
References
SHOWING 1-10 OF 25 REFERENCES
Flowtree: Enabling Distributed Flow Summarization at Scale
- Computer Science
- SIGCOMM Posters and Demos
- 2018
- 1
- PDF
Supporting fine-grained data lineage in a database visualization environment
- Computer Science
- Proceedings 13th International Conference on Data Engineering
- 1997
- 238
- PDF
Apache Flinkâ„¢: Stream and Batch Processing in a Single Engine
- Computer Science
- IEEE Data Eng. Bull.
- 2015
- 846
- PDF
Lineage tracing for general data warehouse transformations
- Computer Science
- The VLDB Journal
- 2003
- 391
- PDF
SmartFactory - Towards a factory-of-things
- Engineering, Computer Science
- Annu. Rev. Control.
- 2010
- 463
- PDF
The constrained Ski-Rental problem and its application to online cloud cost optimization
- Computer Science
- 2013 Proceedings IEEE INFOCOM
- 2013
- 42
- PDF
Empirical studies of competitve spinning for a shared-memory multiprocessor
- Computer Science
- SOSP '91
- 1991
- 163
Fog Computing: A Platform for Internet of Things and Analytics
- Computer Science
- Big Data and Internet of Things
- 2014
- 832
- PDF