Verifying Performance for Autonomous Robot Missions with Uncertainty

@article{Lyons2013VerifyingPF,
  title={Verifying Performance for Autonomous Robot Missions with Uncertainty},
  author={Damian M. Lyons and Ronald C. Arkin and Tsung-Ming Liu and Shu Jiang and P. Nirmal},
  journal={IFAC Proceedings Volumes},
  year={2013},
  volume={46},
  pages={179-186}
}
Abstract Establishing performance guarantees for robot missions is especially important for C-WMD applications. Software verification techniques, such as model checking (Clark 1999, Jhala & Majumdar 2009), can be applied to robotic applications but characteristics of this application area, including addition of a robot environment model and handling continuous spatial location well, exacerbate state explosion, a key weakness of these methods. We have proposed an approach to verifying robot… Expand
Performance verification for robot missions in uncertain environments
TLDR
The challenges involved in building a software tool for verifying the behavior of a multi-robot waypoint mission that includes uncertainly located obstacles and uncertain environment geometry as well as uncertainty in robot motion are addressed. Expand
Probabilistic Verification of Multi-robot Missions in Uncertain Environments
TLDR
A novel method to extend the Bayesian Network formulation to reason about random variables with different subpopulations is introduced to address the challenge of representing the effects of multiple sensory histories when verifying a robot mission. Expand
Performance Verification for Behavior-Based Robot Missions
TLDR
An approach based on behavior-based controllers in a process-algebra framework that avoids state-space combinatorics is presented here, and verification of the robot program in the uncertain environment is reduced to a filtering problem for a Bayesian network. Expand
Establishing A-Priori Performance Guarantees for Robot Missions that Include Localization Software
TLDR
Several approaches to incorporating pre-existing software into the authors’ probabilistic verification framework are presented, and one used to include Monte-Carlo based localization software is presented. Expand
Establishing Performance Guarantees for Behavior-Based Robot Missions Using an SMT Solver
TLDR
The challenge of expanding the range of performance guarantees that are possible by using an SMT-solver instead of a DBN is addressed, and the SMT approach succeeds in establishing performance guarantees for behavior-based robot missions at least as well as the DBN approach. Expand
Getting it right the first time: Robot mission guarantees in the presence of uncertainty
TLDR
This work extends an approach to establishing performance guarantees for behavior-based controllers in a process-algebra framework to include random variables, and shows how this work can be used to generate a Dynamic Bayesian Network for the coupled system of program and environment model. Expand
Formal Performance Guarantees for Behavior-Based Localization Missions
TLDR
Two approaches to modeling probabilistic localization for verification are presented: a high-level approach, and a sample-based approach which allows run-time code to be embedded in verification. Expand
Formal performance guarantees for an approach to human in the loop robot missions
TLDR
This work presents a novel approach to modelling the skill level of the operator and integrating it into automatic verification using a linear Gaussians model parameterized by experimental calibration, and demonstrates the effectiveness of this approach by comparing predicated performance to experimentally measured performance. Expand
Formal Performance Guarantees for Human in the Loop Robot Missions *
A key challenge in the automatic verification of robot mission software, especially critical mission software, is to be able to effectively model the performance of a human operator and factor thatExpand
Performance guarantees for C-WMD robot missions
TLDR
A novel verification framework in providing performance guarantees for behavior-based and probabilistic robot algorithms in complex real-world environments in order to ensure robots' success in carrying out C-WMD missions. Expand
...
1
2
3
...

References

SHOWING 1-10 OF 27 REFERENCES
Characterizing Performance Guarantees for Real-Time Multiagent Systems Operating in Noisy and Uncertain Environments
TLDR
This paper reports on the initial research for the Defense Threat Reduction Agency (DTRA) in understanding what is required from a performance guarantee to give a mission designer the information necessary to understand how well a robot program will perform in a specific environment. Expand
Characterizing performance guarantees for multiagent, real-time systems operating in noisy and uncertain environments
TLDR
This paper is developing a software framework for verification of performance guarantees for C-WMD missions based on the MissionLab software system and a novel process algebra approach to representing robot programs and operating environments and links this to prior work on metrics for robot performance. Expand
Designing autonomous robot missions with performance guarantees
This paper describes the need and methods required to construct an integrated software verification and mission specification system for use in robotic missions intended for counter-weapons of massExpand
Estimating uncertain spatial relationships in Robotics
TLDR
This paper describes a representation for spatial information, called the stochastic map, and associated procedures for building it, reading information from it, and revising it incrementally as new information is obtained, which provide a general solution to the problem of estimating uncertain relative spatial relationships. Expand
Getting it right the first time: predicted performance guarantees from the analysis of emergent behavior in autonomous and semi-autonomous systems
TLDR
The scenarios under consideration, the performance measures and metrics being developed, and an outline of the mechanisms for providing performance guarantees for counter-Weapons of Mass Destruction missions are described. Expand
Towards performance guarantees for emergent behavior
  • D. Lyons, R. Arkin
  • Engineering, Computer Science
  • IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004
  • 2004
TLDR
A modeling framework based on port automata and asynchronous communication is introduced and an analysis approach is developed that removes the combinatoric issues of looking at an asynchronous combination of robot and environment. Expand
Multiagent Mission Specification and Execution
TLDR
The Configuration Description Language (CDL) is developed to capture the recursive composition of configurations in an architecture- and robot-independent fashion and the Societal Agent theory is presented as a basis for constructions of this form. Expand
PRISM 4.0: Verification of Probabilistic Real-Time Systems
TLDR
A major new release of the PRISMprobabilistic model checker is described, adding, in particular, quantitative verification of (priced) probabilistic timed automata. Expand
Robotic Tasks for Chemical, Biological, Radiological, Nuclear and Explosive Incident Response
TLDR
Eight robotic tasks informed by a cognitive task analysis and an information flow analysis are presented and how robots can augment the existing human-based CBRNE incident response by improving the provided information and the speed at which information can be obtained, and reduce responders' physical workload. Expand
Robotic Tasks for CBRNE Incident Response
Chemical, Biological, Radiological, Nuclear, and Explosive (CBRNE) incident response varies dramatically based upon the hazardous material, the incident size, and the response duration. Robots canExpand
...
1
2
3
...