Strong consistency in nonlinear stochastic regression models

  title={Strong consistency in nonlinear stochastic regression models},
  author={K. Skouras},
  journal={Annals of Statistics},
  • K. Skouras
  • Published 2000
  • Mathematics
  • Annals of Statistics
The class of nonlinear stochastic regression models includes most of the linear and nonlinear models used in time series, stochastic control and stochastic approximation schemes. The consistency of least squares estimators was established first by Lai. We present another set of sufficient conditions for consistency, which avoid the use of partial derivatives and are closer in spirit to the conditions presented by Wu for non-stochastic regression models with independent errors. 
Robust nonlinear regression estimation in null recurrent time series
Abstract In this article, we study parametric robust estimation in nonlinear regression models with regressors generated by a class of non-stationary and null recurrent Markov processes. TheExpand
This paper develops an asymptotic theory of nonlinear least squares estimation by establishing a new framework that can be easily applied to various nonlinear regression models withExpand
Nonlinear least-squares estimation
The paper uses empirical process techniques to study the asymptotics of the least-squares estimator (LSE) for the fitting of a nonlinear regression function. By combining and extending ideas of WuExpand
Nonlinear regressions with nonstationary time series
This paper develops asymptotic theory for a nonlinear parametric cointegrating regression model. We establish a general framework for weak consistency that is easy to apply for various nonstationaryExpand
Estimation in nonlinear regression with Harris recurrent Markov chains
In this paper, we study parametric nonlinear regression under the Harris recurrent Markov chain framework. We first consider the nonlinear least squares estimators of the parameters in theExpand
Non-asymptotic sequential confidence regions with fixed sizes for the multivariate nonlinear parameters of regression
Abstract In this paper we consider a sequential design for the estimation of nonlinear parameters of regression with guaranteed accuracy. Non-asymptotic confidence regions with fixed sizes for theExpand
Detecting hidden periodicities for models with cyclical errors
In this paper, the estimation of parameters in the harmonic regression with cyclically dependent errors is addressed. Asymptotic properties of the least-squares estimates are analyzed by simulationExpand
Robust Estimators in Non-linear Regression Models with Long-Range Dependence
We present the asymptotic distribution theory for M-estimators in non-linear regression model with long-range dependence (LRD) for a general class of covariance functions in discrete and continuousExpand
Asymptotics of the signed-rank estimator under dependent observations
Abstract In this paper, we consider a signed-rank estimator of nonlinear regression coefficients under stochastic errors. These errors include a wide array of applications in economic literature suchExpand
Nonlinear cointegrating regressions with nonstationary time series
This paper develops an asymptotic theory for a non-linear parametric co-integrating regression model. We establish a general framework for weak consistency that is easy to apply for variousExpand


Strong consistency of Bayes estimates in nonlinear stochastic regression models
Abstract A broad range of nonlinear (linear) time series and stochastic processes can be described by the stochastic regression model yn=rn(θ)+en, where {en} are independent random disturbances andExpand
Strong consistency in stochastic regression models via posterior covariance matrices
SUMMARY In this paper we use posterior covariance matrices to study the strong consistency of Bayes estimators in stochastic regression models under various assumptions on the stochastic regressors.Expand
Strong Consistency of Bayes Estimates in Stochastic Regression Models
Under minimum assumptions on the stochastic regressors, strong consistency of Bayes estimates is established in stochastic regression models in two cases: (1)When the prior distribution is discrete,Expand
Asymptotic Theory of Nonlinear Least Squares Estimation
For a linear regression model, the necessary and sufficient condition for the asymptotic consistency of the least squares estimator is known. An analogous condition for the nonlinear model isExpand
A Unified Theory of Estimation and Inference for Nonlinear Dynamic Models
2. The data generation process and optimization estimators 3. Consistency of optimization estimators 4. More on near epoch dependence 5. Asymptotic mormality 6. Estimating asymptotic cavarianceExpand
A basic tool of modern econometrics is a uniform law of large numbers (LLN). It is a primary ingredient used in proving consistency and asymptotic normality of parametric and nonparametric estimatorsExpand