Distributed extremum-seeking control over networks of unstable dynamic agents

  title={Distributed extremum-seeking control over networks of unstable dynamic agents},
  author={Martin Guay and Isaac Vandermeulen and Sean Dougherty and P. James McLellan},
Abstract In this paper, a distributed extremum seeking control technique is proposed to solve a class of real-time optimization problems over a network of dynamic agents with unknown unstable dynamics. Each dynamic agent measures a cost that is shared over a network. A dynamic average consensus approach is used to provide each agent with an estimate of the total network cost. The extremum seeking controller uses the local estimate of the total cost to adjust the value of the local decision… Expand

Figures from this paper

Discrete-Time Distributed Extremum-Seeking Control Over Networks With Unstable Dynamics
The main contribution of this paper is to show that the distributed agents can effectively minimize the unmeasured total cost of extremum-seeking control. Expand
Discrete-time distributed extremum-seeking control over networks with unstable dynamics
Abstract: In this paper, we propose a discrete-time version of extremum-seeking control (ESC) which can be implemented by several agents communicating over a network. We consider the problem whereExpand
Distributed control of multi-agent systems over unknown communication networks using extremum seeking
A distributed proportional-integral extremum seeking control technique is proposed, one that solves both problems simultaneously and requires the solution of a consensus estimation problem and ensures that the agents reach agreement on their decision variables. Expand
Distributed control of multi-agent systems using extremum seeking
A distributed proportional-integral extremum seeking control technique is designed to tackle problems over unknown networks to solve distributed control and optimization problems of multi-agent systems to achieve global objectives. Expand
Distributed Extremum-Seeking Control with Applications to High-Altitude Balloons
A distributed version of extremum-seeking control which allows large-scale systems to be optimized without models and with minimal computing power is developed and an interesting application of distributed ESC is considered: formation control of high-altitude balloons for high-speed wireless internet. Expand
Distributed Control of High-Altitude Balloon Formation by Extremum-Seeking Control
This paper shows that distributed extremum-seeking control (ESC) can be used to control the balloon formation, based on the minimization of a cost function and does not require a model of wind currents or Internet users. Expand


Distributed extremum seeking for real-time resource allocation
A distributed extremum seeking control, designed to perform real-time resource allocation in multi-agent systems (MAS), that combines ideas from recent evolutionary game theory dynamics and the classic extremumseeking control to ensure convergence to an optimal allocation. Expand
An analytic framework for decentralized extremum seeking control
A set of sufficient conditions under which decentralized extremum-seeking control schemes exhibit semi-global practical asymptotic stability with respect to an equilibrium point which is parameterized by the collective optimizer is provided. Expand
A time-varying extremum-seeking control approach
The main contribution of the paper is to formulate the extremum-seeking problem as a time-varying estimation problem and the proposed approach is shown to avoid the need for averaging results which minimizes the impact of the choice of dither signal on the performance of the extremity seeking control system. Expand
Multi-agent deployment in the plane using stochastic extremum seeking
This work considers the problem of deployment of a group of N autonomous fully actuated vehicles in a non-cooperative manner in a planar signal field using the recently introduced method of stochastic extremum seeking and proves local exponential convergence to a small neighborhood near the Nash equilibrium. Expand
Distributed Subgradient Methods for Multi-Agent Optimization
The authors' convergence rate results explicitly characterize the tradeoff between a desired accuracy of the generated approximate optimal solutions and the number of iterations needed to achieve the accuracy. Expand
Robust and adaptive design of numerical optimization-based extremum seeking control
A novel design of an asymptotic state regulator via output tracking for state feedback linearizable systems, where the state regulator is traded off finite time state regulation to obtain flexibility in designing a robust extremum seeking controller is proposed. Expand
A proportional-integral extremum-seeking controller design technique
This paper proposes an alternative extremum seeking control design technique that minimizes the impact of a time-scale separation on the transient performance of the extremum-seeking controller through a proportional-integral approach. Expand
Stability of extremum seeking feedback for general nonlinear dynamic systems
This paper provides the first proof of stability of an extremum seeking feedback scheme by employing the tools of averaging and singular perturbation analysis and allows the plant to be a general nonlinear dynamic system whose reference-to-output equilibrium map has a maximum and whose equilibria are locally exponentially stabilizable. Expand
Extremum seeking with sliding mode gradient estimation and asymptotic regulation for a class of nonlinear systems
A model-based extremum seeking approach for a class of single-input-single-output nonlinear systems, with the analytic form of the performance function unknown a priori, and a variable structure output feedback regulator to enforce the system states toward the optimal trajectory. Expand
On non-local stability properties of extremum seeking control
This paper shows semi-global practical stability of the closed-loop system with respect to the design parameters, and shows that reducing the size of the parameters typically slows down the convergence rate of the extremum seeking controllers and enlarges the domain of the attraction. Expand