Complete Agent-driven Model-based System Testing for Autonomous Systems

  title={Complete Agent-driven Model-based System Testing for Autonomous Systems},
  author={Kerstin I. Eder and Wen-ling Huang and Jan Peleska},
In this position paper, a novel approach to testing complex autonomous transportation systems (ATS) in the automotive, avionic, and railway domains is described. It is intended to mitigate some of the most critical problems regarding verification and validation (V&V) effort for ATS. V&V is known to become infeasible for complex ATS, when using conventional methods only. The approach advocated here uses complete testing methods on the module level, because these establish formal proofs for the… 
1 Citations

Figures from this paper

Complete Test of Synthesised Safety Supervisors for Robots and Autonomous Systems
This work-in-progress paper presents an approach to the complete testing of synthesised supervisory controllers that enforce safety properties in domains such as human-robot collaboration and autonomous driving.


Test Automation for Safety-Critical Systems: Industrial Application and Future Developments
The presentation aims less at “promoting” a specific solution, but tries to illustrate the basic problems to be tackled with any formal method, when trying to develop test automation concepts to be applied in the context of reactive systems.
Local Observability and Controllability Analysis and Enforcement in Distributed Testing With Time Constraints
This article proposes an approach based on the pre-processing of the test scenarios to solve the test coordination problem with minimal overhead and implemented in the DCO Analyzer tool for test scenarios described by means of UML sequence diagrams.
A Novel Approach to HW/SW Integration Testing of Route-Based Interlocking System Controllers
This paper presents a new model-based testing strategy for interlocking system controllers that exploits the fact that the design has already been verified, so that it can be used as a reference model for test case and test oracle generation.
Did We Test All Scenarios for Automated and Autonomous Driving Systems?
This work presents a suitable test ending criterion and methodology for virtual scenario-based testing, and model this as a Coupon Collector’s Problem to provide a statistical guarantee that all scenario types are covered.
Agent-Based Software Testing: A Definition and Systematic Mapping Study
The results suggest that there is an interest in ABST after 1999 that resulted in the development of solutions using reactive, BDI, deliberative and cooperate agent architectures for software testing.
Complete model-based equivalence class testing
  • W. Huang, J. Peleska
  • Computer Science
    International Journal on Software Tools for Technology Transfer
  • 2014
A model-based black-box equivalence partition testing strategy, together with a formal proof of its completeness properties, is presented, which applies to reactive systems with large, possibly infinite input data types and finite internal and output data ranges that may be enumerated with acceptable effort.
Principles of model checking
Principles of Model Checking offers a comprehensive introduction to model checking that is not only a text suitable for classroom use but also a valuable reference for researchers and practitioners in the field.
Complete model-based equivalence class testing for nondeterministic systems
This article presents a complete finite black-box testing theory for non-deterministic Kripke structures with possibly infinite input domains, but finite domains for internal state variables and outputs, and demonstrates how this theory can be applied to models presented in any concrete formalism.
Online Testing of Real-time Systems Using Uppaal
The development of T-UPPAAL — a new tool for online black-box testing of real-time embedded systems from non-deterministic timed automata specifica- tions is presented and the notion of relativized timed input/output conformance as the formal implementation relation is proposed.
Model-Based Testing for Avionic Systems Proven Benefits and Further Challenges
The transition of model-based testing (MBT) from a widely discussed research discipline to an accepted technology that is currently becoming state of the art in industry; in particular, in the field of safety-critical systems testing is reported.