Application of Neural Networks in High Assurance Systems: A Survey

@inproceedings{Schumann2010ApplicationON,
  title={Application of Neural Networks in High Assurance Systems: A Survey},
  author={Johann M. Ph. Schumann and Pramod Gupta and Yan Liu},
  booktitle={Applications of Neural Networks in High Assurance Systems},
  year={2010}
}
Artificial Neural Networks (ANNs) are employed in many areas of industry such as pattern recognition, robotics, controls, medicine, and defence. Their learning and generalization capabilities make them highly desirable solutions for complex problems. However, they are commonly perceived as black boxes since their behavior is typically scattered around its elements with little meaning to an observer. The primary concern in safety critical systems development and assurance is the identification… Expand
View via Publisher
gbv.de
23 Citations
Highly Influential Citations
7
Background Citations
10
Methods Citations
4

23 Citations

Citation Type

Citation Type

Hardening of Artificial Neural Networks for Use in Safety-Critical Applications - A Mapping Study
TLDR
It is envisioned that future software engineering will need to focus on further investigating these methods and increasing the maturity and understanding of existing approaches, with the goal to develop clear guidance for proper engineering of high-quality ANNs. Expand
On the Safety of Automotive Systems Incorporating Machine Learning Based Components: A Position Paper
TLDR
This position paper presents the authors' view on the safety of automotive systems incorporating ML-based components, and it is intended to motivate and sketch a research agenda for extending a safety standard, namely ISO 26262, to address challenges posed by incorporating ML -based components in automotive systems. Expand
On the Evaluation Measures for Machine Learning Algorithms for Safety-Critical Systems
TLDR
This position paper presents the authors’ view on the inadequacy of existing measures, and it proposes a new set of measures to be used for the evaluation of the safe performance of ML algorithms. Expand
Multilayered review of safety approaches for machine learning-based systems in the days of AI
TLDR
This paper presents a literature survey of the significant efforts made in the last fifteen years to foster safety in complex intelligent systems, categorizing these research efforts based on a three-layered conceptual framework for developing and maintaining AI systems. Expand
The assurance of Bayesian networks for mission critical systems
TLDR
A framework for conceptualising and communicating the distinctions between BNSs and conventional software systems is proposed and an assurance-focussed BNS analysis technique is introduced that can provide targeted information on mission-critical aspects of a BNS. Expand
Using Machine Learning Safely in Automotive Software: An Assessment and Adaption of Software Process Requirements in ISO 26262
TLDR
A detailed assessment and adaption of ISO 26262 for ML is done, specifically in the context of supervised learning, to address a conflict between the need to innovate and theneed to improve safety in automotive development. Expand
Hybrid Decompositional Verification for Discovering Failures in Adaptive Flight Control Systems
Adaptive flight control systems hold tremendous promise for maintaining the safety of a damaged aircraft and its passengers. However, most currently proposed adaptive control methodologies rely on… Expand
A survey on artificial intelligence assurance
TLDR
This manuscript provides a systematic review of research works that are relevant to AI assurance, between years 1985 and 2021, and aims to provide a structured alternative to the landscape. Expand
Explicit Image Quality Detection Rules for Functional Safety in Computer Vision
TLDR
It is hypothesised that low-level and primitive image analysis driven by explicit rules facilitates complying with safety standards, which improves the real-world applicability of existing proposed solutions. Expand
Safely Entering the Deep: A Review of Verification and Validation for Machine Learning and a Challenge Elicitation in the Automotive Industry
TLDR
The state-of-the-art in verification and validation of safety-critical systems that rely on machine learning is reviewed, confirming that ISO 26262 largely contravenes the nature of DNNs. Expand
...
1
2
3
...

References

SHOWING 1-10 OF 65 REFERENCES
Validating a neural network-based online adaptive system
TLDR
This research investigated the V&V of neural network-based online adaptive systems and developed a novel validation approach consisting of two important methods, and defined a confidence measure, the validity index, to validate the predictions of the Dynamic Cell Structure (DCS) network in IFCS. Expand
Performance Estimation of a Neural Network-Based Controller
TLDR
A dynamic approach to estimate the performance of two types of neural networks employed in an adaptive flight controller: the validity index for the outputs of a Dynamic Cell Structure (DCS) network and confidence levels for the output of a Sigma-Pi (or MLP) network. Expand
Performance Monitoring and Assessment of Neuro-Adaptive Controllers for Aerospace Applications Using a Bayesian Approach
Modem aircraft, UAVs, and robotic spacecraft pose substantial requirements on controllers in the light of ever increasing demands for reusability, affordability, and reliability. The individual… Expand
Tools and Methods for the Verification and Validation of Adaptive Aircraft Control Systems
The appeal of adaptive control to the aerospace domain should be attributed to the neural network models adopted in online adaptive systems for their ability to cope with the demands of a changing… Expand
Industrial use of safety-related artificial neural networks
Neural network products are actively being marketed and some are routinely used in safetyrelated areas, including cancer screening and fire detection in office blocks. Some are medical devices… Expand
Foundation for neural network verification and validation
TLDR
Some clarifying concepts related to evaluation, and a process for developing neural networks in which the role of evaluation is emphasized are proposed. Expand
Adaptive control software: can we guarantee safety?
TLDR
This work applied a nonconventional V&V approach to an adaptive flight control system that employs neural network learning for online adaptation and found it to be suitable for online adaptive systems. Expand
Intelligent systems in the automotive industry: applications and trends
TLDR
This paper provides an overview and a sampling of many of the ways that the automotive industry has utilized AI, soft computing and other intelligent system technologies in such diverse domains like manufacturing, diagnostics, on-board systems, warranty analysis and design. Expand
A deployed engineering design retrieval system using neural networks
TLDR
A neural information retrieval system (NIRS) is described, now in production within the Boeing Company, which has been developed for the identification and retrieval of engineering designs, potentially saving large amounts of nonrecurring costs. Expand
Application of Neural Networks in Power Systems; A Review
The electric power industry is currently undergoing an unprecedented reform. One of the most exciting and potentially profitable recent developments is increasing usage of artificial intelligence… Expand
...
1
2
3
4
5
...