Corpus ID: 67118395

Query and Resource Optimizations: A Case for Breaking the Wall in Big Data Systems

@article{Jindal2018QueryAR,
  title={Query and Resource Optimizations: A Case for Breaking the Wall in Big Data Systems},
  author={Alekh Jindal and L. Viswanathan and Konstantinos Karanasos},
  journal={ArXiv},
  year={2018},
  volume={abs/1906.06590}
}
Modern big data systems run on cloud environments where resources are shared amongst several users and applications. As a result, declarative user queries in these environments need to be optimized and executed over resources that constantly change and are provisioned on demand for each job. This requires us to rethink traditional query optimizers designed for systems that run on dedicated resources. In this paper, we show evidence that the choice of query plans depends heavily on the available… Expand
1 Citations
Cloudy with high chance of DBMS: a 10-year prediction for Enterprise-Grade ML
  • 15
  • PDF

References

SHOWING 1-10 OF 33 REFERENCES
PerfOrator: eloquent performance models for Resource Optimization
  • 35
  • PDF
Dynamically optimizing queries over large scale data platforms
  • 32
  • PDF
Optimization of dynamic query evaluation plans
  • 210
  • PDF
What Makes a Good Physical plan?: Experiencing Hardware-Conscious Query Optimization with Candomblé
  • 2
  • PDF
The state of the art in distributed query processing
  • 923
  • PDF
SCOPE: parallel databases meet MapReduce
  • 137
  • Highly Influential
  • PDF
Opening the Black Boxes in Data Flow Optimization
  • 122
  • PDF
Spark: Cluster Computing with Working Sets
  • 4,452
  • Highly Influential
  • PDF
Stubby: A Transformation-based Optimizer for MapReduce Workflows
  • 81
  • PDF
...
1
2
3
4
...