• DOI:10.1145/3221269.3223036
Corpus ID: 49665540

Numerically stable parallel computation of (co-)variance

@article{Schubert2018NumericallySP,
  title={Numerically stable parallel computation of (co-)variance},
  author={Erich Schubert and M. Gertz},
  journal={Proceedings of the 30th International Conference on Scientific and Statistical Database Management},
  year={2018}
}

Erich Schubert, M. Gertz

Published 2018

Computer Science

Proceedings of the 30th International Conference on Scientific and Statistical Database Management

With the advent of big data, we see an increasing interest in computing correlations in huge data sets with both many instances and many variables. Essential descriptive statistics such as the variance, standard deviation, covariance, and correlation can suffer from a numerical instability known as "catastrophic cancellation" that can lead to problems when naively computing these statistics with a popular textbook equation. While this instability has been discussed in the literature already 50… CONTINUE READING

View on ACM

dbs.ifi.uni-heidelberg.de

Save to Library

Create Alert

Cite

Launch Research Feed