# When and why metaheuristics researchers can ignore “No Free Lunch” theorems

@article{McDermott2019WhenAW, title={When and why metaheuristics researchers can ignore “No Free Lunch” theorems}, author={James McDermott}, journal={Metaheuristics}, year={2019}, pages={1-18} }

The No Free Lunch (NFL) theorem for search and optimisation states that averaged across all possible objective functions on a fixed search space, all search algorithms perform equally well. [] Key Result In conclusion, it offers a novel view of the real meaning of NFL, incorporating the anthropic principle and justifying the position that in many common situations researchers can ignore NFL.

## 12 Citations

### Benchmarking for Metaheuristic Black-Box Optimization: Perspectives and Open Challenges

- Computer Science2020 IEEE Congress on Evolutionary Computation (CEC)
- 2020

This communication aims to give a constructive perspective on several open challenges and prospective research directions related to systematic and generalizable benchmarking for black-box optimization.

### Artificial gorilla troops optimizer: A new nature‐inspired metaheuristic algorithm for global optimization problems

- Computer ScienceInt. J. Intell. Syst.
- 2021

A new metaheuristic algorithm inspired by gorilla troops' social intelligence in nature, called Artificial Gorilla Troops Optimizer (GTO), in which gorillas' collective life is mathematically formulated, and new mechanisms are designed to perform exploration and exploitation.

### Competitive swarm optimizer with mutated agents for finding optimal designs for nonlinear regression models with multiple interacting factors

- Computer ScienceMemetic Computing
- 2020

The proposed CSO-MA algorithm is a general-purpose optimizing tool and can be directly amended to find other types of optimal designs for nonlinear models, including optimal exact designs under a convex or non-convex criterion.

### Benchmarking in Optimization: Best Practice and Open Issues

- Computer ScienceArXiv
- 2020

The article discusses eight essential topics in benchmarking: clearly stated goals, well-specified problems, suitable algorithms, adequate performance measures, thoughtful analysis, effective and efficient designs, comprehensible presentations, and guaranteed reproducibility.

### The Futility of Bias-Free Learning and Search

- Computer ScienceAustralasian Conference on Artificial Intelligence
- 2019

This work demonstrates the necessity of bias in learning, quantifying the role of bias (measured relative to a collection of possible datasets, or more generally, information resources) in increasing the probability of success, and demonstrates that bias is a conserved quantity.

### Performance Analysis of Metaheuristic Optimization Algorithms in Estimating the Interfacial Heat Transfer Coefficient on Directional Solidification

- Computer Science
- 2020

Ten metaheuristic optimization algorithms applied on the inverse optimization of the Interfacial Heat Transfer Coefficient coupled on the solidification phenomenon presented the most appropriate results, outperforming the other methods in this particular phenomenon, based on these metrics.

### Understanding Substructures in Commonsense Relations in ConceptNet

- Computer ScienceArXiv
- 2022

This article presents a methodology based on unsupervised knowledge graph representation learning and clustering to reveal and study substructures in three heavily used commonsense relations in ConceptNet, and shows that, despite having an ‘oﬃcial’ deﬁnition in Concept net, many of these Commonsense relations exhibit considerable sub-structure.

### Application of bio-inspired optimization algorithms in food processing

- Computer ScienceCurrent research in food science
- 2022

### Genetic programming benchmarks

- Computer ScienceACM SIGEVOlution
- 2022

The top image shows a set of scales, which are intended to bring to mind the ideas of balance and fair experimentation which are the focus of our article on genetic programming benchmarks in this…

### Non-revisiting stochastic search revisited: Results, perspectives, and future directions

- Computer ScienceSwarm Evol. Comput.
- 2021

## References

SHOWING 1-10 OF 78 REFERENCES

### Optimization with randomized search heuristics - the (A)NFL theorem, realistic scenarios, and difficult functions

- Computer ScienceTheor. Comput. Sci.
- 2002

### Conditions that Obviate the No-Free-Lunch Theorems for Optimization

- Computer ScienceINFORMS J. Comput.
- 2007

This paper looks more closely at the NFL results and focuses on their implications for combinatorial problems typically faced by many researchers and practitioners, finding that only trivial subclasses of these problems fall under the NFL implications.

### On the Futility of Blind Search: An Algorithmic View of No Free Lunch

- Computer ScienceEvolutionary Computation
- 1998

It is suggested that the evolution of complex systems exhibiting high degrees of orderliness is not equivalent in difficulty to optimizing hard problems, and that the optimism in genetic algorithms as universal optimizers is not justified by natural evolution.

### On Classes of Functions for which No Free Lunch Results Hold

- MathematicsInf. Process. Lett.
- 2003

### No Free Lunch and Free Leftovers Theorems for Multiobjective Optimisation Problems

- MathematicsEMO
- 2003

A 'Free Leftovers' theorem for comparative performance of algorithms over permutation functions is provided, in words: over the space of permutation problems, every algorithm has some companion algorithm which it outperforms, according to a certain well-behaved metric, when comparative performance is summed over all problems in the space.

### A Review of No Free Lunch Theorems, and Their Implications for Metaheuristic Optimisation

- Business
- 2018

It is shown that understanding the No Free Lunch theorems brings us to a position where the authors can ask about the specific dynamics of an optimisation algorithm, and how those dynamics relate to the properties of optimisation problems.

### Coevolutionary free lunches

- Computer ScienceIEEE Transactions on Evolutionary Computation
- 2005

This paper presents a general framework covering most optimization scenarios and shows that in self-play there are free lunches: in coevolution some algorithms have better performance than other algorithms, averaged across all possible problems.

### No Free Lunch Theorems for Search

- Computer Science, Mathematics
- 1995

It is shown that all algorithms that search for an extremum of a cost function perform exactly the same, when averaged over all possible cost functions, which allows for mathematical benchmarks for assessing a particular search algorithm's performance.

### Fundamental Limitations on Search Algorithms: Evolutionary Computing in Perspective

- Computer ScienceComputer Science Today
- 1995

This paper extends results and draws out some of their implications for the design of search algorithms, and for the construction of useful representations, and focuses attention on tailoring alg- orithms and representations to particular problem classes by exploiting domain knowledge.

### Evaluation of Evolutionary and Genetic Optimizers: No Free Lunch

- Computer ScienceEvolutionary Programming
- 1996

It is shown that the information an optimizer gains about unobserved values is ultimately due to its prior information of value distributions, and the result is generalized to an uncountable set of distributions.