Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
@article{Adadi2018PeekingIT, title={Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)}, author={Amina Adadi and Mohammed Berrada}, journal={IEEE Access}, year={2018}, volume={6}, pages={52138-52160} }
At the dawn of the fourth industrial revolution, we are witnessing a fast and widespread adoption of artificial intelligence (AI) in our daily life, which contributes to accelerating the shift towards a more algorithmic society. However, even with such unprecedented advancements, a key impediment to the use of AI-based systems is that they often lack transparency. Indeed, the black-box nature of these systems allows powerful predictions, but it cannot be directly explained. This issue has…
Figures and Tables from this paper
1,593 Citations
Explainable Artificial Intelligence (XAI): An Engineering Perspective
- Computer ScienceArXiv
- 2021
The remarkable advancements in Deep Learning (DL) algorithms have fueled enthusiasm for using Artificial Intelligence (AI) technologies in almost every domain; however, the opaqueness of these…
Explainable Artificial Intelligence Approaches: A Survey
- Computer ScienceArXiv
- 2021
This work demonstrates popular XAI methods with a mutual case study/task, provides meaningful insight on quantifying explainability, and recommends paths towards responsible or human-centered AI using XAI as a medium to understand, compare, and correlate competitive advantages of popularXAI methods.
Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunities
- Computer ScienceArXiv
- 2021
A systematic meta-survey for challenges and future research directions in XAI organized in two themes based on machine learning life cycle’s phases: design, development, and deployment is presented.
Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI
- Computer ScienceInf. Fusion
- 2020
Explainable Artificial Intelligence (XAI) for Internet of Things: A Survey
- Computer Science
- 2022
An in-depth and systematic review of recent studies using XAI models in the scope of IoT domain and categorizes the studies according to their methodology and applications areas to focus on the challenging problems and open issues.
The intersection of evolutionary computation and explainable AI
- Computer ScienceGECCO Companion
- 2022
It is suggested that the EC community may play a major role in the achievement of XAI, and there are still several research opportunities and open research questions that may promote a safer and broader adoption of EC in real-world applications.
SeXAI: Introducing Concepts into Black Boxes for Explainable Artificial Intelligence
- Computer ScienceXAI.it@AI*IA
- 2020
This paper presents the first version of SeXAI, a semantic-based explainable framework aiming to exploit semantic information for making black boxes more transparent and shows its application to a real-world use case.
Provenance documentation to enable explainable and trustworthy AI: A literature review
- Computer ScienceData Intelligence
- 2022
This paper conducts a systematic literature review of provenance, XAI, and trustworthy AI (TAI) to explain the fundamental concepts and illustrate the potential of using provenance as a medium to help accomplish explainability in AI-based systems.
Trustworthy AI: From Principles to Practices
- Computer ScienceArXiv
- 2021
This review provides AI practitioners with a comprehensive guide for building trustworthy AI systems and introduces the theoretical framework of important aspects of AI trustworthiness, including robustness, generalization, explainability, transparency, reproducibility, fairness, privacy preservation, and accountability.
Explainable information retrieval using deep learning for medical images
- Computer ScienceComput. Sci. Inf. Syst.
- 2022
The proposed deep learning model for image classification is compared with state-of-the-art methods including Logistic Regression, Support Vector Machine, Artificial Neural Network and Random Forest and has reported F1 score of 0.76 on the real world streaming dataset which is comparatively better than traditional methods.
References
SHOWING 1-10 OF 165 REFERENCES
Local Rule-Based Explanations of Black Box Decision Systems
- Computer ScienceArXiv
- 2018
This paper proposes LORE, an agnostic method able to provide interpretable and faithful explanations for black box outcome explanation, and shows that LORE outperforms existing methods and baselines both in the quality of explanations and in the accuracy in mimicking the black box.
A Survey of Artificial General Intelligence Projects for Ethics, Risk, and Policy
- Economics
- 2017
Artificial general intelligence (AGI) is AI that can reason across a wide range of domains. It has long been considered the “grand dream” or “holy grail” of AI. It also poses major issues of ethics,…
Counterfactual Explanations Without Opening the Black Box: Automated Decisions and the GDPR
- LawArXiv
- 2017
It is suggested data controllers should offer a particular type of explanation, unconditional counterfactual explanations, to support these three aims, which describe the smallest change to the world that can be made to obtain a desirable outcome, or to arrive at the closest possible world, without needing to explain the internal logic of the system.
Explainable AI: Beware of Inmates Running the Asylum Or: How I Learnt to Stop Worrying and Love the Social and Behavioural Sciences
- Computer ScienceArXiv
- 2017
From a light scan of literature, it is demonstrated that there is considerable scope to infuse more results from the social and behavioural sciences into explainable AI, and some key results from these fields that are relevant to explainableAI are presented.
Explainable artificial intelligence: A survey
- Computer Science2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO)
- 2018
Recent developments in XAI in supervised learning are summarized, a discussion on its connection with artificial general intelligence is started, and proposals for further research directions are given.
Explaining Explanations: An Approach to Evaluating Interpretability of Machine Learning
- Computer ScienceArXiv
- 2018
The definition of explainability is provided and how it can be used to classify existing literature is shown and discussed to create best practices and identify open challenges in explanatory artificial intelligence.
A Survey of Methods for Explaining Black Box Models
- Computer ScienceACM Comput. Surv.
- 2019
A classification of the main problems addressed in the literature with respect to the notion of explanation and the type of black box system is provided to help the researcher to find the proposals more useful for his own work.
Explainable AI for Designers: A Human-Centered Perspective on Mixed-Initiative Co-Creation
- Computer Science2018 IEEE Conference on Computational Intelligence and Games (CIG)
- 2018
This vision paper proposes a new research area of eXplainable AI for Designers (XAID), specifically for game designers, and illustrates the initial XAID framework through three use cases, which require an understanding both of the innate properties of the AI techniques and users’ needs.
MAGIX: Model Agnostic Globally Interpretable Explanations
- Computer ScienceArXiv
- 2017
The approach works by first extracting conditions that were important at the instance level and then evolving rules through a genetic algorithm with an appropriate fitness function that represent the patterns followed by the model for decisioning and are useful for understanding its behavior.
What do we need to build explainable AI systems for the medical domain?
- Computer ScienceArXiv
- 2017
It is argued that research in explainable-AI would generally help to facilitate the implementation of AI/ML in the medical domain, and specifically help to facilitates transparency and trust.