Declarative Parameterizations of User-Defined Functions for Large-Scale Machine Learning and Optimization

@article{Gao2019DeclarativePO,
  title={Declarative Parameterizations of User-Defined Functions for Large-Scale Machine Learning and Optimization},
  author={Zekai Gao and Niketan Pansare and Chris Jermaine},
  journal={IEEE Transactions on Knowledge and Data Engineering},
  year={2019},
  volume={31},
  pages={2079-2092}
}
Large-scale optimization has become an important application for data management systems, particularly in the context of statistical machine learning. In this paper, we consider how one might implement the join-and-co-group pattern in the context of a fully declarative data processing system. The join-and-co-group pattern is ubiquitous in iterative, large-scale optimization. In the join-and-co-group pattern, a user-defined function $g$g is parameterized with a data object $x$x as well as the… CONTINUE READING

Figures and Topics from this paper.