# Classifiers that approximate functions

@article{Wilson2004ClassifiersTA, title={Classifiers that approximate functions}, author={Stewart W. Wilson}, journal={Natural Computing}, year={2004}, volume={1}, pages={211-234} }

A classifier system, XCSF, is introduced in which the predictionestimation mechanism is used to learn approximations to functions.The addition of weight vectors to the classifiers allowspiecewise-linear approximation, where the classifier'sprediction is calculated instead of being a fixed scalar. The weight vector and the classifier's condition co-adapt.Results on functions of up to six dimensions show high accuracy. The idea of calculating the prediction leads to the concept ofa generalized…

## Figures and Topics from this paper

## 187 Citations

Improving generalization in the XCSF classifier system using linear least-squares

- Mathematics, Computer ScienceGECCO '05
- 2005

The Widrow-Hoff rule is replaced with linear least-squares and it is shown that with this improvement XCSF can fully exploit its generalization capabilities.

An anticipatory approach to improve XCSF

- Computer ScienceGECCO '06
- 2006

This paper tries to add an anticipatory component to XCSF improving its performance, and initial results show that X CSF can be used to evolve accurate approximations of some functions.

Extending XCSF beyond linear approximation

- Mathematics, Computer ScienceGECCO '05
- 2005

This paper tests the extended version of XCSF on various approximation problems and shows that quadratic/cubic approximations can be used to significantly improve X CSF's generalization capabilities.

An Improved Continuous-Action Extended Classifier Systems for Function Approximation

- Computer ScienceComplex Adaptive Systems
- 2015

An improved XCS with continuous actions is introduced for function approximation purposes and is shown to produce more accurate rules than the classical classifier system when it comes to approximating complex nonlinear functions.

What about interpolation?: a radial basis function approach to classifier prediction modeling in XCSF

- Computer ScienceGECCO
- 2018

A novel approach to model a classifier's payoff prediction using Radial Basis Function interpolation as a new means to capture the underlying function surface complexity and results reveal that the RBF-based classifier prediction outperforms the n-th order polynomial approximation on several test functions of varying complexity.

Analysis and Improvements of the Classifier Error Estimate in XCSF

- Computer ScienceIWLCS
- 2007

A new definition for the classifier error is introduced and the Bayes Linear Analysis framework is applied to find a more accurate and reliable error estimate, which results in two incremental error estimate update algorithms.

A brief history of learning classifier systems: from CS-1 to XCS and its variants

- Computer ScienceEvol. Intell.
- 2015

This paper gives an overview of the evolution of Learning Classifier Systems up to XCS, and of some of the subsequent developments of Wilson’s algorithm to different types of learning.

Support vector regression for classifier prediction

- Mathematics, Computer ScienceGECCO '07
- 2007

In this paper we introduce XCSF with support vector prediction:the problem of learning the prediction function is solved as a support vector regression problem and each classifier exploits a Support…

Evolving classifier ensembles with voting predictors

- Computer Science2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence)
- 2008

XCSF with voting predictors is introduced that extends XCSF to let it select best prediction function to use in each problem subspace to help choose the most adequate prediction function for a given problem.

A Probabilistic Classifier System and Its Application in Data Mining

- Computer Science, MedicineEvolutionary Computation
- 2006

The proposed CS approach abandons the focus on high accuracy and addresses a well-posed Data Mining goal, namely, that of uncovering the low-uncertainty patterns of dependence that manifest often in the data.

## References

SHOWING 1-10 OF 28 REFERENCES

Classifier Fitness Based on Accuracy

- Mathematics, Computer ScienceEvolutionary Computation
- 1995

A classifier system, XCS, is investigated, in which each classifier maintains a prediction of expected payoff, but the classifier's fitness is given by a measure of the prediction's accuracy, making it suitable for a wide range of reinforcement learning situations where generalization over states is desirable.

An Analysis of Generalization in the XCS Classifier System

- Mathematics, Computer ScienceEvolutionary Computation
- 1999

It is shown that XCS's generalization mechanism is effective, but that the conditions under which it works must be clearly understood, and the compactness of the representation evolved by XCS is limited by the number of instances of each generalization actually present in the environment.

State of XCS Classifier System Research

- Computer ScienceLearning Classifier Systems
- 1999

This paper reviews recent research on XCS with respect to representation, internal state, predictive modeling, noise, and underlying theory and technique.

Learning Classifier Systems, From Foundations to Applications

- Computer Science
- 2000

This paper presents aroadmap to the last Decade of Learning Classifier System Research (From 1989 to 1999), and an Introduction to Anticipatory Classifier Systems, as well as applications of XCS and the Monk's Problems.

XCS Classifier System Reliably Evolves Accurate, Complete, and Minimal Representations for Boolean Functions

- Mathematics
- 1998

Wilson’s recent XCS classifier system forms complete mappings of the payoff environment in the reinforcement learning tradition thanks to its accuracy based fitness. According to Wilson’s…

Deletion schemes for classifier systems

- Mathematics
- 1999

The issue of deletion schemes for classifier systems has received little attention. In a standard genetic algorithm a chromosome can be evaluated (assigned a reasonable fitness) immediately. In…

Analyzing the evolutionary pressures in XCS

- Mathematics
- 2001

After an increasing interest in learning classifier systems and the XCS classifier system in particular, this paper locates and analyzes the distinct evolutionary pressures in XCS. Combining several…

An Introduction to Learning Fuzzy Classifier Systems

- Computer ScienceLearning Classifier Systems
- 1999

A class of Learning Classifier Systems that learn fuzzy rule-based models, instead of interval-based or Boolean models is presented, and a general methodology to extend reinforcement distribution algorithms usually not designed to learn fuzzy models is introduced.

Advances in learning classifier systems : Third International Workshop, IWLCS 2000, Paris, France, September 15-16, 2000 : revised papers

- Computer Science
- 2001

This paper presents simple Markov Models of the Genetic Algorithm in Classifier Systems: Accuracy-Based Fitness, a model for Mining Explanatory and Predictive Models from a Large Clinical Database.

Generalization in the XCS Classifier System

- Computer Science
- 1998

The amount of computation per input is considerably larger for XCS, perhaps by enough to make the two approaches approximately equal in computational effort, but this will begin to offset XCS's enormous advantage in learning rate per input only if new inputs are available faster than XCS can process them.