Corpus ID: 3503348

Geometric Lower Bounds for Distributed Parameter Estimation under Communication Constraints

@article{Han2018GeometricLB,
  title={Geometric Lower Bounds for Distributed Parameter Estimation under Communication Constraints},
  author={Y. Han and Ayfer {\"O}zg{\"u}r and T. Weissman},
  journal={ArXiv},
  year={2018},
  volume={abs/1802.08417}
}
  • Y. Han, Ayfer Özgür, T. Weissman
  • Published 2018
  • Computer Science, Mathematics
  • ArXiv
  • We consider parameter estimation in distributed networks, where each sensor in the network observes an independent sample from an underlying distribution and has $k$ bits to communicate its sample to a centralized processor which computes an estimate of a desired parameter. We develop lower bounds for the minimax risk of estimating the underlying parameter for a large class of losses and distributions. Our results show that under mild regularity conditions, the communication constraint reduces… CONTINUE READING
    42 Citations
    Lower Bounds for Learning Distributions under Communication Constraints via Fisher Information
    • 13
    • PDF
    Learning Distributions from their Samples under Communication Constraints
    • 15
    • PDF
    Distributed Statistical Estimation of High-Dimensional and Nonparametric Distributions
    • 23
    • PDF
    Distributed Gaussian Mean Estimation under Communication Constraints: Optimal Rates and Communication-Efficient Algorithms
    • 6
    • PDF
    General lower bounds for interactive high-dimensional estimation under information constraints
    • 2
    • PDF
    Distributed Signal Detection under Communication Constraints
    • 3
    • Highly Influenced
    • PDF
    Inference Under Information Constraints I: Lower Bounds From Chi-Square Contraction
    • 48
    • Highly Influenced
    • PDF
    Distributed Learning with Sublinear Communication
    • 17
    • PDF
    Distributed Simulation and Distributed Inference
    • 22
    • PDF

    References

    SHOWING 1-10 OF 37 REFERENCES
    Communication lower bounds for statistical estimation problems via a distributed data processing inequality
    • 98
    • Highly Influential
    • PDF
    On Communication Cost of Distributed Statistical Estimation and Dimensionality
    • 59
    • PDF
    Distributed Statistical Estimation of High-Dimensional and Nonparametric Distributions
    • 23
    • PDF
    Communication-Efficient Distributed Learning of Discrete Distributions
    • 25
    • Highly Influential
    Information-Theoretic Lower Bounds on Bayes Risk in Decentralized Estimation
    • 32
    • PDF
    Information-theoretic lower bounds for distributed statistical estimation with communication constraints
    • 177
    • Highly Influential
    • PDF
    Distributed Simulation and Distributed Inference
    • 22
    • PDF
    Efficient Protocols for Distributed Classification and Optimization
    • 37
    • PDF
    Optimal rates of entropy estimation over Lipschitz balls
    • 41
    • PDF
    Distributed Learning, Communication Complexity and Privacy
    • 159
    • PDF