Born to Learn: the Inspiration, Progress, and Future of Evolved Plastic Artificial Neural Networks
@article{Soltoggio2017BornTL, title={Born to Learn: the Inspiration, Progress, and Future of Evolved Plastic Artificial Neural Networks}, author={Andrea Soltoggio and Kenneth O. Stanley and Sebastian Risi}, journal={Neural networks : the official journal of the International Neural Network Society}, year={2017}, volume={108}, pages={ 48-67 } }
105 Citations
Evolution of Biologically Inspired Learning in Artificial Neural Networks
- Computer Science
- 2019
The final author version and the galley proof are versions of the publication after peer review that features the final layout of the paper including the volume, issue and page numbers.
Evolving Plasticity for Autonomous Learning under Changing Environmental Conditions
- Computer ScienceEvolutionary Computation
- 2021
This work uses a discrete representation to encode the learning rules in a finite search space, and employs genetic algorithms to optimize these rules to allow learning on two separate tasks (a foraging and a prey-predator scenario) in online lifetime learning settings.
Differentiable plasticity: training plastic neural networks with backpropagation
- Computer ScienceICML
- 2018
It is shown that plasticity, just like connection weights, can be optimized by gradient descent in large (millions of parameters) recurrent networks with Hebbian plastic connections, and it is concluded that differentiable plasticity may provide a powerful novel approach to the learning-to-learn problem.
EVOLVING SELF-TAUGHT NEURAL NETWORKS: THE BALDWIN EFFECT AND THE EMERGENCE OF INTELLIGENCE
- Computer Science
- 2019
Experimental results show that the interaction between evolution and the ability to teach oneself in self-taught neural networks outperform evolution and self-teaching alone.
Evolving Self-taught Neural Networks: The Baldwin Effect and the Emergence of Intelligence
- Computer ScienceArXiv
- 2019
Experimental results show that the interaction between evolution and the ability to teach oneself in self-taught neural networks outperform evolution and self-teaching alone.
Reinforcement Learning for Central Pattern Generation in Dynamical Recurrent Neural Networks
- Computer Science, BiologyFrontiers in Computational Neuroscience
- 2022
This work extends one of the best-studied and most-commonly used dynamic recurrent neural networks to incorporate the reinforcement learning mechanism, and demonstrates that this extended dynamical system (model and learning mechanism) can autonomously learn to perform a central pattern generation task.
Designing neural networks through neuroevolution
- Computer ScienceNat. Mach. Intell.
- 2019
This Review looks at several key aspects of modern neuroevolution, including large-scale computing, the benefits of novelty and diversity, the power of indirect encoding, and the field’s contributions to meta-learning and architecture search.
Do What Nature Did To Us: Evolving Plastic Recurrent Neural Networks For Task Generalization
- Computer ScienceArXiv
- 2021
The experiment results demonstrate the unique advantage of EPRNN compared to state-of-the-arts based on plasticity and recursion while yielding comparably good performance against deep learning based approaches in the tasks.
University of Groningen Evolving Plasticity for Autonomous Learning under Changing Environmental Conditions
- Biology
- 2019
This work employs genetic algorithms to evolve local learning rules, from Hebbian perspective, to produce autonomous learning under changing environmental conditions, and shows that evolved plasticity rules are highly efficient at adapting the ANNs to task under changing environments.
Meta-Learning through Hebbian Plasticity in Random Networks
- Computer ScienceNeurIPS
- 2020
This work proposes a search method that, instead of optimizing the weight parameters of neural networks directly, only searches for synapse-specific Hebbian learning rules that allow the network to continuously self-organize its weights during the lifetime of the agent.
References
SHOWING 1-10 OF 353 REFERENCES
On the Relationships between Generative Encodings, Regularity, and Learning Abilities when Evolving Plastic Artificial Neural Networks
- Computer SciencePloS one
- 2013
The results suggest that using a developmental encoding could improve the learning abilities of evolved, plastic neural networks, and reveal the consequence of the bias of developmental encodings towards regular structures.
Evolving plastic neural networks with novelty search
- PsychologyAdapt. Behav.
- 2010
This article analyzes this inherent deceptiveness in a variety of different dynamic, reward-based learning tasks, and proposes a way to escape the deceptive trap of static policies based on the novelty search algorithm, which avoids deception entirely.
Evolution of Cartesian Genetic Programs for Development of Learning Neural Architecture
- Biology, Computer ScienceEvolutionary Computation
- 2011
The goal of this paper is to use evolutionary approaches to find suitable computational functions that are analogous to natural sub-components of biological neurons and demonstrate that intelligent behavior can be produced as a result of this additional biological plausibility.
A unified approach to evolving plasticity and neural geometry
- Biology, PsychologyThe 2012 International Joint Conference on Neural Networks (IJCNN)
- 2012
The most interesting aspect of this investigation is that the emergent neural structures are beginning to acquire more natural properties, which means that neuroevolution can begin to pose new problems and answer deeper questions about how brains evolved that are ultimately relevant to the field of AI as a whole.
Differentiable plasticity: training plastic neural networks with backpropagation
- Computer ScienceICML
- 2018
It is shown that plasticity, just like connection weights, can be optimized by gradient descent in large (millions of parameters) recurrent networks with Hebbian plastic connections, and it is concluded that differentiable plasticity may provide a powerful novel approach to the learning-to-learn problem.
Indirectly Encoding Neural Plasticity as a Pattern of Local Rules
- Computer Science, BiologySAB
- 2010
This paper aims to show that learning rules can be effectively indirectly encoded by extending the Hypercube-based NeuroEvolution of Augmenting Topologies (HyperNEAT) method to evolve large-scale adaptive ANNs, which is a major goal for neuroevolution.
Learning to Adapt to Changing Environments in Evolving Neural Networks
- Computer Science, BiologyAdapt. Behav.
- 1996
A genetic algorithm is used to simulate the evolution of a population of neural networks, each controlling the behavior of a small mobile robot that must explore efficiently an environment surrounded by walls, and found that evolved networks incorporate a genetically inherited predisposition to learn.
Bio-Inspired Artificial Intelligence: Theories, Methods, and Technologies
- Biology, Computer Science
- 2008
This book offers a comprehensive introduction to the emerging field of biologically inspired artificial intelligence that can be used as an upper-level text or as a reference for researchers.
The Evolution of Learning: An Experiment in Genetic Connectionism
- Biology, Computer Science
- 1991
Evolutionary and Computational Advantages of Neuromodulated Plasticity
- Biology
- 2008
The experiments demonstrated that modulatory neurons provide an evolutionary advantage that increases with the complexity of the control problem, and the important role of neuromodulated plasticity for the evolution of networks that require temporal neural dynamics, adaptivity and memory functions is suggested.