ProvDB: A System for Lifecycle Management of Collaborative Analysis Workflows

@article{Miao2016ProvDBAS,
  title={ProvDB: A System for Lifecycle Management of Collaborative Analysis Workflows},
  author={Hui Miao and Amit Chavan and Amol Deshpande},
  journal={CoRR},
  year={2016},
  volume={abs/1610.04963}
}
As data-driven methods are becoming pervasive in a wide variety of disciplines, there is an urgent need to develop scalable and sustainable tools to simplify the process of data science, to make it easier to keep track of the analyses being performed and datasets being generated, and to enable introspection of the workflows. In this paper, we describe our vision of a unified provenance and metadata management system to support lifecycle management of complex collaborative data science workflows… CONTINUE READING