Corpus ID: 231709347

Test and Evaluation Framework for Multi-Agent Systems of Autonomous Intelligent Agents

  title={Test and Evaluation Framework for Multi-Agent Systems of Autonomous Intelligent Agents},
  author={Erin Lanus and I. Hernandez and Adam Dachowicz and Laura Freeman and Melanie L. Grande and Andrew Lang and J. Panchal and Anthony Patrick and Scott Welch},
Test and evaluation is a necessary process for ensuring that engineered systems perform as intended under a variety of conditions, both expected and unexpected. In this work, we consider the unique challenges of developing a unifying test and evaluation framework for complex ensembles of cyber-physical systems with embedded artificial intelligence. We propose a framework that incorporates test and evaluation throughout not only the development life cycle, but continues into operation as the… Expand

Figures from this paper


A Formal Approach to Physics-based Attacks in Cyber-physical Systems
Informing the Warfighter—Why Statistical Methods Matter in Defense Testing
The Engineering Design of Systems: Models and Methods
Overview of Reliability Testing
  • E. Elsayed
  • Engineering, Computer Science
  • IEEE Transactions on Reliability
  • 2012
Experimental methods: Between-subject and within-subject design
NASA Systems Engineering Handbook Revision 2
A review of multivariate control charts
Defense Acquisition Guidebook, Defense Acquisition University
  • 2020
Cyber-Physical Systems: Architecture, Security and Application
  • 2019
Chapter one - combinatorial testing: Theory and practice
  • ser. Advances in Computers, A. Memon, Ed. Elsevier, 2015, vol. 99, pp. 1 – 66.
  • 2015