A robust orthogonal algorithm for system identification and time-series analysis

@article{Korenberg2004ARO,
  title={A robust orthogonal algorithm for system identification and time-series analysis},
  author={Michael J. Korenberg},
  journal={Biological Cybernetics},
  year={2004},
  volume={60},
  pages={267-276}
}
  • M. Korenberg
  • Published 1 February 1989
  • Computer Science
  • Biological Cybernetics
We describe and illustrate methods for obtaining a parsimonious sinusoidal series representation or model of biological time-series data. The methods are also used to identify nonlinear systems with unknown structure. A key aspect is a rapid search for significant terms to include in the model for the system or the time-series. For example, the methods use fast and robust orthogonal searches for significant frequencies in the time-series, and differ from conventional Fourier series analysis in… 
Applications of fast orthogonal search: Time-series analysis and resolution of signals in noise
TLDR
Simulations are provided to demonstrate precise detection of component frequencies and weights in short data records, coping with missing or unequally spaced data, and recovery of signals heavily contaminated with noise.
Iterative Fast Orthogonal Search for Modeling by a Sum of Exponentials or Sinusoids
TLDR
A modification of FOS is considered in which iteration of the original procedure is used to further reduce the mean-squared error between model and data, approaching a minimum in the m.s.e.
Fast, Robust Identification of Nonlinear Physiological Systems Using an Implicit Basis Expansion
TLDR
Simulations, using a simple nonlinear model of peripheral auditory processing, show the equivalence between the kernels estimated using a direct basis expansion, and those computed using the fast, implicit basis expansion technique which is proposed.
Identification of Linear Time Varying Systems using Basis Pursuit
TLDR
A novel algorithm for identifying time-varying systems is presented that combines a temporal expansion with a term selection step that uses the "least absolute shrinkage and selection operator", or Lasso.
Using the Fast Orthogonal Search with First Term Reselection to Find Subharmonic Terms in Spectral Analysis
TLDR
This paper considers the resolution of subharmonic frequencies using the FOS algorithm and introduces a new criterion for determining the number of non-noise terms in the model, called FOS first-term reselection (FOS-FTR).
A Robust Time-Varying Identification Algorithm Using Basis Functions
TLDR
Comparison via computer simulations of AR models between the proposed method and one of the well-known iterative methods, recursive least squares, shows the greater capability of the new method to track TV parameters.
Parallel cascade identification and kernel estimation for nonlinear systems
  • M. Korenberg
  • Computer Science, Mathematics
    Annals of Biomedical Engineering
  • 2006
TLDR
It is shown that any discrete-time finite-memory nonlinear system having a finite-order Volterra series representation can be exactly represented by a finite number of parallel LN cascade paths.
Compact and accurate linear and nonlinear autoregressive moving average model parameter estimation using Laguerre functions
TLDR
Simulation results show better performance of the proposed approach in estimating the system dynamics than LEK in certain cases, and it remains effective in the presence of significant additive measurement noise.
A Novel Fast Orthogonal Search Method for design of functional link networks and their use in system identification
  • H. M. Abbas
  • Computer Science
    2007 IEEE International Conference on Systems, Man and Cybernetics
  • 2007
TLDR
The proposed architecture is tested on noise-free and noisy nonlinear systems and shown to find sparse models that can approximate the experimented systems with acceptable accuracy.
System Identification Using Optimally Designed Functional Link Networks via a Fast Orthogonal Search Technique
TLDR
The proposed architecture is tested on noisefree and noisy nonlinear systems and shown to find sparse models that can approximate the experimented systems with acceptable accuracy.
...
...

References

SHOWING 1-10 OF 22 REFERENCES
Identifying nonlinear difference equation and functional expansion representations: The fast orthogonal algorithm
  • M. Korenberg
  • Computer Science
    Annals of Biomedical Engineering
  • 2006
TLDR
A method is presented for identifying functional expansion and difference equation representations for nonlinear systems which greatly reduces computing time, so that 15-fold increases in speed of estimating kernels or difference equation coefficients are readily obtainable, compared with a previous orthogonal technique.
Exact orthogonal kernel estimation from finite data records: Extending Wiener's identification of nonlinear systems
TLDR
Simulations are provided to demonstrate that the technique is more accurate than the Lee-Schetzen method with a white Gaussian input of limited duration, retaining its superiority when the system output is corrupted by noise.
An algorithm for the machine calculation of complex Fourier series
TLDR
Good generalized these methods and gave elegant algorithms for which one class of applications is the calculation of Fourier series, applicable to certain problems in which one must multiply an N-vector by an N X N matrix which can be factored into m sparse matrices.
Spectrum analysis—A modern perspective
TLDR
A summary of many of the new techniques developed in the last two decades for spectrum analysis of discrete time series is presented, including the classical periodogram, classical Blackman-Tukey, autoregressive, moving average, autotegressive-moving average, maximum likelihood, Prony, and Pisarenko methods.
Parameter Estimation Techniques for Nonlinear Systems
White-noise analysis of nonlinear behavior in an insect sensory neuron: Kernel and cascade approaches
TLDR
A functional expansion used to model the relationship between a Gaussian white noise stimulus current and the resulting action potential output in the single sensory neuron of the cockroach femoral tactile spine could closely predict the experimental action potential train obtained with novel white noise inputs.
Nonlinear Problems in Random Theory
A series of lectures on the role of nonlinear processes in physics, mathematics, electrical engineering, physiology, and communication theory.From the preface:"For some time I have been interested in
Stochastic Identification Methods for Nonlinear Systems: An Extension of the Wiener Theory
The Wiener series provides a representation for many nonlinear systems with respect to Brownian motion inputs. In this paper the Wiener theory is extended to a wide class of stochastic inputs
Spectral Analysis of Periodic and Nonnal Breathing in Infants
TLDR
Spectral analysis techniques are used to study periodic and normal breathing in infants and results are obtained about the modulation of heart rate by respiration, the strength of the modulation as indicated by the coherency, and an estimate of the time delay between respiration and heart rate interaction.
White-Noise Analysis of a Neuron Chain: An Application of the Wiener Theory
TLDR
It is concluded that the Wiener theory of nonlinear system identification was applied to a three-stage neuron chain in the catfish retina and can predict quantitatively, with reasonable accuracy, the nonlinear, dynamic behavior of the neuron chain.
...
...