Verifying Performance for Autonomous Robot Missions with Uncertainty

@article{Lyons2013VerifyingPF,
  title={Verifying Performance for Autonomous Robot Missions with Uncertainty},
  author={Damian M. Lyons and Ronald C. Arkin and Tsung-Ming Liu and Shu Jiang and P. Nirmal},
  journal={IFAC Proceedings Volumes},
  year={2013},
  volume={46},
  pages={179-186}
}
Abstract Establishing performance guarantees for robot missions is especially important for C-WMD applications. Software verification techniques, such as model checking (Clark 1999, Jhala & Majumdar 2009), can be applied to robotic applications but characteristics of this application area, including addition of a robot environment model and handling continuous spatial location well, exacerbate state explosion, a key weakness of these methods. We have proposed an approach to verifying robot… 

Figures from this paper

Probabilistic Verification of Multi-robot Missions in Uncertain Environments
TLDR
A novel method to extend the Bayesian Network formulation to reason about random variables with different subpopulations is introduced to address the challenge of representing the effects of multiple sensory histories when verifying a robot mission.
Performance Verification for Behavior-Based Robot Missions
TLDR
An approach based on behavior-based controllers in a process-algebra framework that avoids state-space combinatorics is presented here, and verification of the robot program in the uncertain environment is reduced to a filtering problem for a Bayesian network.
Establishing A-Priori Performance Guarantees for Robot Missions that Include Localization Software
TLDR
The authors have applied this second approach to automatically derive performance guarantees for behavior-based, multi-robot critical mission software using an innovative approach to formal verification for robotic software.
Establishing Performance Guarantees for Behavior-Based Robot Missions Using an SMT Solver
TLDR
The challenge of expanding the range of performance guarantees that are possible by using an SMT-solver instead of a DBN is addressed, and the SMT approach succeeds in establishing performance guarantees for behavior-based robot missions at least as well as the DBN approach.
Getting it right the first time: Robot mission guarantees in the presence of uncertainty
TLDR
This work extends an approach to establishing performance guarantees for behavior-based controllers in a process-algebra framework to include random variables, and shows how this work can be used to generate a Dynamic Bayesian Network for the coupled system of program and environment model.
Formal Performance Guarantees for Behavior-Based Localization Missions
TLDR
Two approaches to modeling probabilistic localization for verification are presented: a high-level approach, and a sample-based approach which allows run-time code to be embedded in verification.
Formal performance guarantees for an approach to human in the loop robot missions
TLDR
This work presents a novel approach to modelling the skill level of the operator and integrating it into automatic verification using a linear Gaussians model parameterized by experimental calibration, and demonstrates the effectiveness of this approach by comparing predicated performance to experimentally measured performance.
Formal Performance Guarantees for Human in the Loop Robot Missions *
TLDR
This work presents a novel approach to modelling the skill level of the operator and integrating it into automatic verification using a linear Gaussians model parameterized by experimental calibration, and demonstrates the effectiveness of this approach by comparing predicated performance to experimentally measured performance.
Performance guarantees for C-WMD robot missions
TLDR
A novel verification framework in providing performance guarantees for behavior-based and probabilistic robot algorithms in complex real-world environments in order to ensure robots' success in carrying out C-WMD missions.
...
...

References

SHOWING 1-10 OF 26 REFERENCES
Characterizing Performance Guarantees for Real-Time Multiagent Systems Operating in Noisy and Uncertain Environments
TLDR
This paper reports on the initial research for the Defense Threat Reduction Agency (DTRA) in understanding what is required from a performance guarantee to give a mission designer the information necessary to understand how well a robot program will perform in a specific environment.
Characterizing performance guarantees for multiagent, real-time systems operating in noisy and uncertain environments
TLDR
This paper is developing a software framework for verification of performance guarantees for C-WMD missions based on the MissionLab software system and a novel process algebra approach to representing robot programs and operating environments and links this to prior work on metrics for robot performance.
Designing autonomous robot missions with performance guarantees
This paper describes the need and methods required to construct an integrated software verification and mission specification system for use in robotic missions intended for counter-weapons of mass
Getting it right the first time: predicted performance guarantees from the analysis of emergent behavior in autonomous and semi-autonomous systems
TLDR
The scenarios under consideration, the performance measures and metrics being developed, and an outline of the mechanisms for providing performance guarantees for counter-Weapons of Mass Destruction missions are described.
Towards performance guarantees for emergent behavior
  • D. Lyons, R. Arkin
  • Computer Science
    IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004
  • 2004
TLDR
A modeling framework based on port automata and asynchronous communication is introduced and an analysis approach is developed that removes the combinatoric issues of looking at an asynchronous combination of robot and environment.
Multiagent Mission Specification and Execution
TLDR
The Configuration Description Language (CDL) is developed to capture the recursive composition of configurations in an architecture- and robot-independent fashion and the Societal Agent theory is presented as a basis for constructions of this form.
PRISM 4.0: Verification of Probabilistic Real-Time Systems
TLDR
A major new release of the PRISMprobabilistic model checker is described, adding, in particular, quantitative verification of (priced) probabilistic timed automata.
Robotic Tasks for Chemical, Biological, Radiological, Nuclear and Explosive Incident Response
TLDR
Eight robotic tasks informed by a cognitive task analysis and an information flow analysis are presented and how robots can augment the existing human-based CBRNE incident response by improving the provided information and the speed at which information can be obtained, and reduce responders' physical workload.
Robotic Tasks for CBRNE Incident Response
Chemical, Biological, Radiological, Nuclear, and Explosive (CBRNE) incident response varies dramatically based upon the hazardous material, the incident size, and the response duration. Robots can
Estimating uncertain spatial relationships in robotics
TLDR
A representation for spatial information, called the stochastic map, and associated procedures for building it, reading information from it, and revising it incrementally as new information is obtained, providing a general solution to the problem of estimating uncertain relative spatial relationships.
...
...