Sensitivity Analysis for Binary Sampling Systems via Quantitative Fisher Information Lower Bounds

  title={Sensitivity Analysis for Binary Sampling Systems via Quantitative Fisher Information Lower Bounds},
  author={Manuel S. Stein},
  journal={IEEE Transactions on Information Theory},
  • M. Stein
  • Published 10 December 2015
  • Computer Science
  • IEEE Transactions on Information Theory
Determining the quality of sensing devices exhibiting minimal digitization complexity is addressed. Measurements of such sensor systems are characterized by multivariate binary distributions and assessing sensitivity via the Cramér-Rao lower bound turns out to be intractable. In this context, the Fisher matrix of the exponential family and a lower bound for arbitrary probabilistic models are discussed. The conservative approximation for Fisher’s information matrix rests on a surrogate… 

Figures from this paper

Quantum metrology with imperfect measurements

The impact of measurement imperfections on quantum metrology protocols has not been approached in a systematic manner so far. In this work, we tackle this issue by generalising firstly the notion of



DOA Parameter Estimation with 1-bit Quantization Bounds, Methods and the Exponential Replacement

The exponential replacement enables to formulate a pessimistic version of the Cram\'er-Rao lower bound (CRLB) and to derive an asymptotically achieving conservative maximum-likelihood estimator (CMLE).

A Pessimistic Approximation for the Fisher Information Measure

An alternative information measure S(θ), based on the Cauchy- Schwarz inequality, is derived that provides a lower bound on the Fisher information F (θ) and has the property of being evaluated with the mean, the variance, the skewness, and the kurtosis of the system model at hand.

Measurement-driven quality assessment of nonlinear systems by exponential replacement

  • M. SteinJ. NossekK. Barbé
  • Computer Science
    2016 IEEE International Instrumentation and Measurement Technology Conference Proceedings
  • 2016
It is shown that by measuring the first two sample moments of an arbitrary set of output transformations in a calibrated setup, the output distribution of the actual system can be approximated by an equivalent exponential family distribution, which has the property that the resulting approximation of the statistical system model is guaranteed to be pessimistic in an estimation theoretic sense.

Information-Preserving Transformations for Signal Parameter Estimation

A characterization of the Pareto-optimal set of linear transformations is derived by using a weighted form of the Bayesian Cramér-Rao lower bound (BCRLB) which stands in relation to the expected value of the Fisher information measure.

Analysis of Fisher Information and the Cramér–Rao Bound for Nonlinear Parameter Estimation After Random Compression

The impact of compression with complex random matrices on Fisher information and the Cramér-Rao Bound (CRB) for estimating unknown parameters in the mean value function of a complex multivariate normal distribution is analyzed.

Bounds and expansions for Fisher information when the moments are known

SUMMARY An expansion of the score statistic as a polynomial in the random variable can be used to provide a nondecreasing sequence of lower bounds for the Fisher information when the moments are

Sensor array processing based on subspace fitting

It is shown that by introducing a specific weighting matrix, the multidimensional signal subspace method can achieve the same asymptotic properties as the ML method.

Monte Carlo Computation of the Fisher Information Matrix in Nonstandard Settings

The resampling-based method relies on an efficient technique for estimating the Hessian matrix, introduced as part of the adaptive form of the simultaneous perturbation stochastic approximation (SPSA) optimization algorithm.