Classifiers that approximate functions

@article{Wilson2004ClassifiersTA,
  title={Classifiers that approximate functions},
  author={Stewart W. Wilson},
  journal={Natural Computing},
  year={2004},
  volume={1},
  pages={211-234}
}
A classifier system, XCSF, is introduced in which the predictionestimation mechanism is used to learn approximations to functions.The addition of weight vectors to the classifiers allowspiecewise-linear approximation, where the classifier'sprediction is calculated instead of being a fixed scalar. The weight vector and the classifier's condition co-adapt.Results on functions of up to six dimensions show high accuracy. The idea of calculating the prediction leads to the concept ofa generalized… 
Improving generalization in the XCSF classifier system using linear least-squares
TLDR
The Widrow-Hoff rule is replaced with linear least-squares and it is shown that with this improvement XCSF can fully exploit its generalization capabilities.
An anticipatory approach to improve XCSF
TLDR
This paper tries to add an anticipatory component to XCSF improving its performance, and initial results show that X CSF can be used to evolve accurate approximations of some functions.
Extending XCSF beyond linear approximation
TLDR
This paper tests the extended version of XCSF on various approximation problems and shows that quadratic/cubic approximations can be used to significantly improve X CSF's generalization capabilities.
An Improved Continuous-Action Extended Classifier Systems for Function Approximation
TLDR
An improved XCS with continuous actions is introduced for function approximation purposes and is shown to produce more accurate rules than the classical classifier system when it comes to approximating complex nonlinear functions.
What about interpolation?: a radial basis function approach to classifier prediction modeling in XCSF
TLDR
A novel approach to model a classifier's payoff prediction using Radial Basis Function interpolation as a new means to capture the underlying function surface complexity and results reveal that the RBF-based classifier prediction outperforms the n-th order polynomial approximation on several test functions of varying complexity.
Analysis and Improvements of the Classifier Error Estimate in XCSF
TLDR
A new definition for the classifier error is introduced and the Bayes Linear Analysis framework is applied to find a more accurate and reliable error estimate, which results in two incremental error estimate update algorithms.
A brief history of learning classifier systems: from CS-1 to XCS and its variants
  • L. Bull
  • Computer Science
    Evol. Intell.
  • 2015
TLDR
This paper gives an overview of the evolution of Learning Classifier Systems up to XCS, and of some of the subsequent developments of Wilson’s algorithm to different types of learning.
Support vector regression for classifier prediction
In this paper we introduce XCSF with support vector prediction:the problem of learning the prediction function is solved as a support vector regression problem and each classifier exploits a Support
Evolving classifier ensembles with voting predictors
TLDR
XCSF with voting predictors is introduced that extends XCSF to let it select best prediction function to use in each problem subspace to help choose the most adequate prediction function for a given problem.
A Probabilistic Classifier System and Its Application in Data Mining
  • J. Muruzábal
  • Computer Science, Medicine
    Evolutionary Computation
  • 2006
TLDR
The proposed CS approach abandons the focus on high accuracy and addresses a well-posed Data Mining goal, namely, that of uncovering the low-uncertainty patterns of dependence that manifest often in the data.
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 28 REFERENCES
Classifier Fitness Based on Accuracy
TLDR
A classifier system, XCS, is investigated, in which each classifier maintains a prediction of expected payoff, but the classifier's fitness is given by a measure of the prediction's accuracy, making it suitable for a wide range of reinforcement learning situations where generalization over states is desirable.
An Analysis of Generalization in the XCS Classifier System
  • P. Lanzi
  • Mathematics, Computer Science
    Evolutionary Computation
  • 1999
TLDR
It is shown that XCS's generalization mechanism is effective, but that the conditions under which it works must be clearly understood, and the compactness of the representation evolved by XCS is limited by the number of instances of each generalization actually present in the environment.
State of XCS Classifier System Research
TLDR
This paper reviews recent research on XCS with respect to representation, internal state, predictive modeling, noise, and underlying theory and technique.
Learning Classifier Systems, From Foundations to Applications
TLDR
This paper presents aroadmap to the last Decade of Learning Classifier System Research (From 1989 to 1999), and an Introduction to Anticipatory Classifier Systems, as well as applications of XCS and the Monk's Problems.
XCS Classifier System Reliably Evolves Accurate, Complete, and Minimal Representations for Boolean Functions
Wilson’s recent XCS classifier system forms complete mappings of the payoff environment in the reinforcement learning tradition thanks to its accuracy based fitness. According to Wilson’s
Deletion schemes for classifier systems
The issue of deletion schemes for classifier systems has received little attention. In a standard genetic algorithm a chromosome can be evaluated (assigned a reasonable fitness) immediately. In
Analyzing the evolutionary pressures in XCS
After an increasing interest in learning classifier systems and the XCS classifier system in particular, this paper locates and analyzes the distinct evolutionary pressures in XCS. Combining several
An Introduction to Learning Fuzzy Classifier Systems
TLDR
A class of Learning Classifier Systems that learn fuzzy rule-based models, instead of interval-based or Boolean models is presented, and a general methodology to extend reinforcement distribution algorithms usually not designed to learn fuzzy models is introduced.
Advances in learning classifier systems : Third International Workshop, IWLCS 2000, Paris, France, September 15-16, 2000 : revised papers
TLDR
This paper presents simple Markov Models of the Genetic Algorithm in Classifier Systems: Accuracy-Based Fitness, a model for Mining Explanatory and Predictive Models from a Large Clinical Database.
Generalization in the XCS Classifier System
TLDR
The amount of computation per input is considerably larger for XCS, perhaps by enough to make the two approaches approximately equal in computational effort, but this will begin to offset XCS's enormous advantage in learning rate per input only if new inputs are available faster than XCS can process them.
...
1
2
3
...