Learn More
We consider the dynamics of Q learning in two-player two-action games with a Boltzmann exploration mechanism. For any nonzero exploration rate the dynamics is dissipative, which guarantees that agent strategies converge to rest points that are generally different from the game's Nash equlibria (NEs). We provide a comprehensive characterization of the rest(More)
The problem of multi-agent learning and adaptation has attracted a great deal of attention in recent years. It has been suggested that the dynamics of multi agent learning can be studied using replicator equations from population biology. Most existing studies so far have been limited to discrete strategy spaces with a small number of available actions. In(More)
In this paper we study a simple cascading process in a structured heterogeneous population, namely, a network composed of two loosely coupled communities. We demonstrate that under certain conditions the cascading dynamics in such a network has a two-tiered structure that characterizes activity spreading at different rates in the communities. We study the(More)
In this paper we study a problem of identifying a group of related individuals embedded in a larger population. We state the problem in terms of node classification in a social network, and present an iterative algorithm to classify individuals. We test it empirically on data generated by the Hats simulator. Despite its simplicity, the algorithm performs(More)
Coordination in wireless sensor networks (WSN) is required for many tasks that are best achieved collectively, such as coverage and medium access. One of the major challenges in the design of WSN are the strong limitations imposed by finite onboard power capacity. Because communication requires considerable energy, it is imperative to have a coordination(More)
In this paper we study a classification model that mimics guilt by association. We consider a population consisting of known adversaries, covert adversaries, and benign individuals. In our model we associate a suspicion score with each individual. The scores for the covert and benign populations are initially set to 0, while the known adversaries have a(More)
Social network data is generally incomplete with missing information about nodes and their interactions. Here we propose a spatial-temporal latent point process model that describes geographically distributed interactions between pairs of entities. In contrast to most existing approaches, we assume that interactions are not fully observable, and certain(More)
In this paper we study formation of platoons and their velocity–size distribution in freeway traffic using the stochastic Master equation approach. The solution to the Master equation and the moments of the distribution are obtained by numeric integration. We also discuss a possible generalization of this approach to the case of a multi–lane traffic flow(More)