The Role of Interactivity in Structured Estimation

@article{Acharya2022TheRO,
  title={The Role of Interactivity in Structured Estimation},
  author={Jayadev Acharya and Cl{\'e}ment L. Canonne and Ziteng Sun and Himanshu Tyagi},
  journal={ArXiv},
  year={2022},
  volume={abs/2203.06870}
}
We study high-dimensional sparse estimation under three natural constraints: communication constraints, local privacy constraints, and linear measurements (compressive sensing). Without sparsity assumptions, it has been established that interactivity cannot improve the minimax rates of estimation under these information constraints. The question of whether interactivity helps with natural inference tasks has been a topic of active research. We settle this question in the affirmative for the… 

References

SHOWING 1-10 OF 43 REFERENCES
Interaction is necessary for distributed learning with privacy or communication constraints
TLDR
An exponential lower bound on the number of samples necessary to solve the standard task of learning a large-margin linear separator in the non-interactive LDP model is presented, relying on a new technique for constructing pairs of distributions with nearly matching moments but whose supports can be nearly separated by a large margin hyperplane.
Inference Under Information Constraints I: Lower Bounds From Chi-Square Contraction
TLDR
Lower bounds for the sample complexity of learning and testing discrete distributions in this information-constrained setting are derived from a characterization of the contraction in chi-square distance between the observed distributions of the samples when information constraints are placed.
Communication lower bounds for statistical estimation problems via a distributed data processing inequality
TLDR
A distributed data processing inequality is proved, as a generalization of usual data processing inequalities, which might be of independent interest and useful for other problems.
Distributed Compressive Sensing
TLDR
A new theory for distributed compressive sensing (DCS) is introduced that enables new distributed coding algorithms for multi-signal ensembles that exploit both intra- and inter-Signal correlation structures.
Unified lower bounds for interactive high-dimensional estimation under information constraints
TLDR
This work provides a unified framework enabling us to derive a variety of (tight) minimax lower bounds for different parametric families of distributions, both continuous and discrete, under any lp loss.
Interactive Inference under Information Constraints
TLDR
The main technical contribution is an approach to handle the correlation that builds due to interactivity and quantifies how effectively one can exploit this correlation in spite of the local constraints.
Locally Private Learning without Interaction Requires Separation
TLDR
This work shows that the margin complexity of a class of Boolean functions is a lower bound on the complexity of any non-interactive LDP algorithm for distribution-independent PAC learning of the class, and complements this lower bound with a new efficient learning algorithm whose complexity is polynomial in themargin complexity of theclass.
Minimax Optimal Procedures for Locally Private Estimation
TLDR
Private versions of classical information-theoretical bounds, in particular those due to Le Cam, Fano, and Assouad, are developed to allow for a precise characterization of statistical rates under local privacy constraints and the development of provably (minimax) optimal estimation procedures.
On the Fundamental Limits of Adaptive Sensing
TLDR
It is proved that the advantages offered by clever adaptive strategies and sophisticated estimation procedures-no matter how intractable-over classical compressed acquisition/recovery schemes are, in general, minimal.
The Role of Interactivity in Local Differential Privacy
TLDR
The power of interactivity in local differential privacy is studied, and it is shown that for a large class of compound hypothesis testing problems, a simple noninteractive test is optimal among the class of all (possibly fully interactive) tests.
...
...