Corpus ID: 15253877

Partitioning Data on Features or Samples in Communication-Efficient Distributed Optimization?

@article{Ma2015PartitioningDO,
  title={Partitioning Data on Features or Samples in Communication-Efficient Distributed Optimization?},
  author={Chenxin Ma and Martin Tak{\'a}c},
  journal={ArXiv},
  year={2015},
  volume={abs/1510.06688}
}
In this paper we study the effect of the way that the data is partitioned in distributed optimization. The original DiSCO algorithm [Communication-Efficient Distributed Optimization of Self-Concordant Empirical Loss, Yuchen Zhang and Lin Xiao, 2015] partitions the input data based on samples. We describe how the original algorithm has to be modified to allow partitioning on features and show its efficiency both in theory and also in practice. 
12 Citations
Communication efficient distributed learning with feature partitioned data
  • 1
  • PDF
Stochastic, Distributed and Federated Optimization for Machine Learning
  • PDF
Stochastic, Distributed and Federated Optimization for Machine Learning
  • 22
Distributed optimization with arbitrary local solvers
  • 94
  • PDF
Optimality Trade-offs For Distributed Estimation Anit
Clustering with Distributed Data
  • 3
  • PDF
Communication efficient distributed weighted non-linear least squares estimation
  • 5
  • PDF
Communication Optimality Trade-offs For Distributed Estimation
  • 9
  • PDF
...
1
2
...

References

SHOWING 1-10 OF 25 REFERENCES
Communication-Efficient Distributed Dual Coordinate Ascent
  • 283
  • PDF
Optimal Distributed Online Prediction
  • 70
  • PDF
Adding vs. Averaging in Distributed Primal-Dual Optimization
  • 140
  • PDF
Distributed stochastic optimization and learning
  • O. Shamir, Nathan Srebro
  • Computer Science
  • 2014 52nd Annual Allerton Conference on Communication, Control, and Computing (Allerton)
  • 2014
  • 103
  • PDF
Distributed Coordinate Descent Method for Learning with Big Data
  • 123
  • PDF
Communication-Efficient Distributed Optimization of Self-Concordant Empirical Loss
  • Yuchen Zhang, Lin Xiao
  • Mathematics, Computer Science
  • ArXiv
  • 2015
  • 46
  • Highly Influential
  • PDF
Communication-Efficient Distributed Optimization using an Approximate Newton-type Method
  • 277
  • PDF
Distributed delayed stochastic optimization
  • A. Agarwal, John C. Duchi
  • Computer Science, Mathematics
  • 2012 IEEE 51st IEEE Conference on Decision and Control (CDC)
  • 2012
  • 446
  • PDF
Trading Computation for Communication: Distributed Stochastic Dual Coordinate Ascent
  • 136
  • PDF
Optimal Distributed Online Prediction Using Mini-Batches
  • 439
  • PDF
...
1
2
3
...