TEMPEST - Synthesis Tool for Reactive Systems and Shields in Probabilistic Environments

@inproceedings{Pranger2021TEMPESTS,
  title={TEMPEST - Synthesis Tool for Reactive Systems and Shields in Probabilistic Environments},
  author={Stefan Pranger and Bettina K{\"o}nighofer and Lukas Posch and Roderick Bloem},
  booktitle={ATVA},
  year={2021}
}
We present Tempest, a synthesis tool to automatically create correct-by-construction reactive systems and shields from qualitative or quantitative specifications in probabilistic environments. A shield is a special type of reactive system used for run-time enforcement; i.e., a shield enforces a given qualitative or quantitative specification of a running system while interfering with its operation as little as possible. Shields that enforce a qualitative or quantitative specification are called… 

References

SHOWING 1-10 OF 13 REFERENCES
PRISM 4.0: Verification of Probabilistic Real-Time Systems
TLDR
A major new release of the PRISMprobabilistic model checker is described, adding, in particular, quantitative verification of (priced) probabilistic timed automata.
Automatic verification of competitive stochastic systems
TLDR
The applicability and efficiency of the methods are demonstrated by deploying them to analyse and detect potential weaknesses in a variety of large case studies, including algorithms for energy management in Microgrids and collective decision making for autonomous systems.
A Storm is Coming: A Modern Probabilistic Model Checker
TLDR
The new probabilistic model checker Storm features the analysis of discrete- and continuous-time variants of both Markov chains and MDPs and offers a Python API for rapid prototyping by encapsulating Storm’s fast and scalable algorithms.
PRISM-games: A Model Checker for Stochastic Multi-Player Games
TLDR
The tool is based on the probabilistic model checker PRISM, benefiting from its existing user interface and simulator, whilst adding novel model checking algorithms for stochastic games, as well as functionality to synthesise optimal player strategies.
Safe Reinforcement Learning Using Probabilistic Shields
TLDR
The concept of a probabilistic shield that enables RL decision-making to adhere to safety constraints with high probability is introduced and used to realize a shield that restricts the agent from taking unsafe actions, while optimizing the performance objective.
QUASY: Quantitative Synthesis Tool
TLDR
QUASY takes qualitative and quantitative specifications and automatically constructs a system that satisfies the qualitative specification and optimizes the quantitative specification, if such a system exists.
Run-Time Optimization for Learned Controllers Through Quantitative Games
TLDR
The shields the authors generate avoid liveness bugs, improve controller performance in untrained and changing traffic situations, and add features to learned controllers, such as giving priority to emergency vehicles, using reactive synthesis.
Safe Reinforcement Learning via Shielding
TLDR
This work proposes a new approach to learn optimal policies while enforcing properties expressed in temporal logic by synthesizing a reactive system called a shield that monitors the actions from the learner and corrects them only if the chosen action causes a violation of the specification.
UPPAAL-Tiga: Time for Playing Games!
TLDR
The first efficient on-the-fly algorithm for solving games based on timed game automata with respect to reachability and safety properties has now matured to a fully integrated tool with dramatic improvements both in terms of performance and the availability of the extended input language of UPPAAL-4.0.
...
...