Corpus ID: 222377808

Maximum Moment Restriction for Instrumental Variable Regression

  title={Maximum Moment Restriction for Instrumental Variable Regression},
  author={Rui Zhang and Masaaki Imaizumi and Bernhard Scholkopf and Krikamol Muandet},
We propose a simple framework for nonlinear instrumental variable (IV) regression based on a kernelized conditional moment restriction (CMR) known as a maximum moment restriction (MMR). The MMR is formulated by maximizing the interaction between the residual and functions of IVs that belong to a unit ball of reproducing kernel Hilbert space (RKHS). This allows us to tackle the IV regression as an empirical risk minimization where the risk depends on the reproducing kernel on the instrument and… Expand

Figures and Tables from this paper

Proximal Causal Learning with Kernels: Two-Stage Estimation and Moment Restriction
This work proposes two kernel-based methods for nonlinear causal effect estimation in the presence of unobserved confounding, and provides consistency guarantees for each algorithm, and demonstrates these approaches achieve competitive results on synthetic data and data simulating a real-world task. Expand
Instrument Space Selection for Kernel Maximum Moment Restriction
This work presents a systematic way to select the instrument space for parameter estimation based on a principle of the least identifiable instrument space (LIIS) that identifies model parameters with the least space complexity. Expand
A causal view on compositional data
This work provides a causal view on compositional data in an instrumental variable setting where the composition acts as the cause and advocates for multivariate alternatives using statistical data transformations and regression techniques that take the special structure of the compositional sample space into account. Expand
Causal Inference Under Unmeasured Confounding With Negative Controls: A Minimax Learning Approach
This paper tackles the primary challenge to causal inference using negative controls: the identification and estimation of these bridge functions, and provides a new identification strategy that avoids both uniqueness and completeness. Expand
Learning Causal Relationships from Conditional Moment Conditions by Importance Weighting
A method is proposed that transforms conditional moment conditions to unconditional moment conditions through importance weighting using the conditional density ratio, and proposes a method that successfully approximates conditional moments conditions. Expand
Scalable Quasi-Bayesian Inference for Instrumental Variable Regression
This work presents a scalable quasi-Bayesian procedure for IV regression, building upon the recently developed kernelized IV models, and leads to a scalable approximate inference algorithm with time cost comparable to the corresponding point estimation methods. Expand
Testability of Reverse Causality without Exogeneous Variation
This paper shows that testability of reverse causality is possible even in the absence of exogenous variation, such as in the form of instrumental variables. Instead of relying on exogenousExpand


Deep Generalized Method of Moments for Instrumental Variable Analysis
This paper proposes the DeepGMM algorithm, a new variational reformulation of GMM with optimal inverse-covariance weighting that allows us to efficiently control very many moment conditions and develops practical techniques for optimization and model selection that make it particularly successful in practice. Expand
Kernel Conditional Moment Test via Maximum Moment Restriction
It is shown that the MMR not only fully characterizes the original conditional moment restrictions, leading to consistency in both hypothesis testing and parameter estimation, but also has an analytic expression that is easy to compute as well as closed-form asymptotic distributions. Expand
Kernel Instrumental Variable Regression
KIV is proposed, a nonparametric generalization of 2SLS, modeling relations among X, Y, and Z as nonlinear functions in reproducing kernel Hilbert spaces (RKHSs), and it is proved the consistency of KIV under mild assumptions, and conditions under which convergence occurs at the minimax optimal rate for unconfounded, single-stage RKHS regression. Expand
Instrumental Variable Estimation with the R Package ivtools
Abstract Instrumental variables is a popular method in epidemiology and related fields, to estimate causal effects in the presence of unmeasured confounding. Traditionally, instrumental variableExpand
Minimax Estimation of Conditional Moment Models
This work develops an approach for estimating models described via conditional moment restrictions, and introduces a min-max criterion function, under which the estimation problem can be thought of as solving a zero-sum game between a modeler who is optimizing over the hypothesis space of the target model and an adversary who identifies violating moments over a test function space. Expand
Efficient Estimation of Models with Conditional Moment Restrictions Containing Unknown Functions
We propose an estimation method for models of conditional moment restrictions, which contain finite dimensional unknown parameters (theta) and infinite dimensional unknown functions (h). Our proposalExpand
Nonparametric methods for inference in the presence of instrumental variables
We suggest two nonparametric approaches, based on kernel methods and orthogonal series, respectively, to estimating regression functions in the presence of instrumental variables. For the first timeExpand
Dual Instrumental Variable Regression
Inspired by problems in stochastic programming, it is shown that the two-stage procedure for nonlinear IV regression can be reformulated as a convex-concave saddle-point problem. Expand
Estimation of Nonparametric Conditional Moment Models with Possibly Nonsmooth Generalized Residuals
This paper studies nonparametric estimation of conditional moment restrictions in which the generalized residual functions can be nonsmooth in the unknown functions of endogenous variables. This is aExpand
Instrumental Variable Analysis in Epidemiologic Studies: An Overview of the Estimation Methods
It is found that two-stage least squares is the method of first choice if exposure and outcome are both continuous and show a linear relation, and in case of a nonlinear relation, two- stage residual inclusion may be a suitable alternative. Expand