Analyzing Stigmergetic Algorithms Through Automata Games

  title={Analyzing Stigmergetic Algorithms Through Automata Games},
  author={Peter Vrancx and Katja Verbeeck and Ann Now{\'e}},
Stigmergy describes a class of mechanisms that mediate animal to animal interaction through the environment. Recently this concept has proved interesting for use in multi-agent systems, as it provides a simple framework for agent interaction and coordination. However, determining the global system behavior that will arise from local stigmergetic interactions is a complex problem. In this paper stigmergetic mechanisms are modeled using simple reinforcement learners, called learning automata. We… 

Non-cooperative games and stygmergetic programming for a transport optimization problem

Stigmergetic mechanisms are combined with the Nash's theory of non-cooperative games in order to model a concurrent multi-player transport problem and a new version of Ant Colony Optimization using multiple species is proposed.



Colonies of learning automata

It is shown that a set of interconnected LAs is also able to describe the behavior of an ant colony, capable of finding the shortest path from their nest to food sources and back.

Ant algorithms and stigmergy

A Brief History of Stigmergy

The history of Stigmergy is described in the context of social insects and the general properties of two distinct stigmergic mechanisms are discussed: quantitative stIGmergy and qualitative stigMERgy.

A pheromone-based utility model for collaborative foraging

  • Liviu PanaitS. Luke
  • Computer Science
    Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004.
  • 2004
This work has developed a formalism which uses multiple pheromones to guide cooperative tasks and takes advantage of symmetries common to foraging environments which enables it to achieve much faster reward propagation than reinforcement learning does.

Modelling the Collective Building of Complex Architectures in Social Insects with Lattice Swarms

A set of distributed stigmergic algorithms that allow a swarm of simple agents to build coherent nest-like structures inspired by wasp colonies are characterized and an empirical one to one correspondence between biological-like architectures and “coordinated algorithms” is found.

From local actions to global tasks: stigmergy and collective robotics

This paper presents a series of experiments where a group of mobile robots gather 81 randomly distributed objects and cluster them into one pile through stigmergy, a principle which allows indirect communication between agents through sensing and modification of the local environment which determines the agents’ behaviour.

Stigmergy, Self-Organization, and Sorting in Collective Robotics

It is argued that the success of this demonstration is crucially dependent on the exploitation of real-world physics, and that the use of simulation alone to investigate stigmergy may fail to reveal its power as an evolutionary option for collective life forms.

Multi-agent Coordination and Control Using Stigmergy Applied to Manufacturing Control

This manuscript discusses multi-agent coordination and control using techniques inspired by the behavior of social insects that enables desirable overall behavior to emerge without exposing the individual agents to the complexity and dynamics of the overall system.

Decentralized learning in finite Markov chains

It is shown that, if updating is done in sufficiently small steps, the group will converge to the policy that maximizes the long-term expected reward per step.

Multi-type Ant Colony: The Edge Disjoint Paths Problem

The algorithm on the problem of finding disjoint paths in graphs, which is an extension of the well known Ant System, and shows that the paths found by the ants are distributed proportionally to the cost of the paths.