TEMPEST - Synthesis Tool for Reactive Systems and Shields in Probabilistic Environments

  title={TEMPEST - Synthesis Tool for Reactive Systems and Shields in Probabilistic Environments},
  author={Stefan Pranger and Bettina K{\"o}nighofer and Lukas Posch and Roderick Bloem},
We present Tempest, a synthesis tool to automatically create correct-by-construction reactive systems and shields from qualitative or quantitative specifications in probabilistic environments. A shield is a special type of reactive system used for run-time enforcement; i.e., a shield enforces a given qualitative or quantitative specification of a running system while interfering with its operation as little as possible. Shields that enforce a qualitative or quantitative specification are called… 


PRISM 4.0: Verification of Probabilistic Real-Time Systems
A major new release of the PRISMprobabilistic model checker is described, adding, in particular, quantitative verification of (priced) probabilistic timed automata.
Automatic verification of competitive stochastic systems
The applicability and efficiency of the methods are demonstrated by deploying them to analyse and detect potential weaknesses in a variety of large case studies, including algorithms for energy management in Microgrids and collective decision making for autonomous systems.
A Storm is Coming: A Modern Probabilistic Model Checker
The new probabilistic model checker Storm features the analysis of discrete- and continuous-time variants of both Markov chains and MDPs and offers a Python API for rapid prototyping by encapsulating Storm’s fast and scalable algorithms.
PRISM-games: A Model Checker for Stochastic Multi-Player Games
The tool is based on the probabilistic model checker PRISM, benefiting from its existing user interface and simulator, whilst adding novel model checking algorithms for stochastic games, as well as functionality to synthesise optimal player strategies.
Safe Reinforcement Learning Using Probabilistic Shields
The concept of a probabilistic shield that enables RL decision-making to adhere to safety constraints with high probability is introduced and used to realize a shield that restricts the agent from taking unsafe actions, while optimizing the performance objective.
QUASY: Quantitative Synthesis Tool
QUASY takes qualitative and quantitative specifications and automatically constructs a system that satisfies the qualitative specification and optimizes the quantitative specification, if such a system exists.
Run-Time Optimization for Learned Controllers Through Quantitative Games
The shields the authors generate avoid liveness bugs, improve controller performance in untrained and changing traffic situations, and add features to learned controllers, such as giving priority to emergency vehicles, using reactive synthesis.
Safe Reinforcement Learning via Shielding
This work proposes a new approach to learn optimal policies while enforcing properties expressed in temporal logic by synthesizing a reactive system called a shield that monitors the actions from the learner and corrects them only if the chosen action causes a violation of the specification.
UPPAAL-Tiga: Time for Playing Games!
The first efficient on-the-fly algorithm for solving games based on timed game automata with respect to reachability and safety properties has now matured to a fully integrated tool with dramatic improvements both in terms of performance and the availability of the extended input language of UPPAAL-4.0.