scholarly journals Artificial Cognition: How Experimental Psychology Can Help Generate Explainable Artificial Intelligence

2021 ◽  
Author(s):  
J. Eric T. Taylor ◽  
Graham Taylor
Keyword(s):  
Artificial Intelligence ◽  
Machine Learning ◽  
Deep Neural Networks ◽  
Experimental Approach ◽  
Well Being ◽  
Human Mind ◽  
Black Box ◽  
Psychological Science ◽  
Black Boxes ◽  
Explainable Artificial Intelligence

Artificial intelligence powered by deep neural networks has reached a levelof complexity where it can be difficult or impossible to express how a modelmakes its decisions. This black-box problem is especially concerning when themodel makes decisions with consequences for human well-being. In response,an emerging field called explainable artificial intelligence (XAI) aims to increasethe interpretability, fairness, and transparency of machine learning. In thispaper, we describe how cognitive psychologists can make contributions to XAI.The human mind is also a black box, and cognitive psychologists have overone hundred and fifty years of experience modeling it through experimentation.We ought to translate the methods and rigour of cognitive psychology to thestudy of artificial black boxes in the service of explainability. We provide areview of XAI for psychologists, arguing that current methods possess a blindspot that can be complemented by the experimental cognitive tradition. Wealso provide a framework for research in XAI, highlight exemplary cases ofexperimentation within XAI inspired by psychological science, and provide atutorial on experimenting with machines. We end by noting the advantages ofan experimental approach and invite other psychologists to conduct research inthis exciting new field.

scholarly journals Offenheit durch XAI bei ML-unterstützten Entscheidungen: Ein Baustein zur Optimierung von Entscheidungen im Unternehmen?

2021 ◽  
Author(s):  
Christian Lossos ◽  
Simon Geschwill ◽  
Frank Morelli
Keyword(s):  
Artificial Intelligence ◽  
Machine Learning ◽  
Black Box ◽  
Künstliche Intelligenz ◽  
Gesetzliche Grundlagen ◽  
Mathematische Modelle ◽  
Explainable Artificial Intelligence ◽  
Post Hoc

ZusammenfassungKünstliche Intelligenz (KI) und Machine Learning (ML) gelten gegenwärtig als probate Mittel, um betriebswirtschaftliche Entscheidungen durch mathematische Modelle zu optimieren. Allerdings werden die Technologien häufig in Form von „Black Box“-Ansätze mit entsprechenden Risiken realisiert. Der Einsatz von Offenheit kann in diesem Kontext mehr Objektivität schaffen und als Treiber für innovative Lösungen fungieren. Rationale Entscheidungen im Unternehmen dienen im Sinne einer Mittel-Zweck-Beziehung dazu, Wettbewerbsvorteile zu erlangen. Im Sinne von Governance und Compliance sind dabei regulatorische Rahmenwerke wie COBIT 2019 und gesetzliche Grundlagen wie die Datenschutz-Grundverordnung (DSGVO) zu berücksichtigen, die ihrerseits ein Mindestmaß an Transparenz einfordern. Ferner sind auch Fairnessaspekte, die durch Bias-Effekte bei ML-Systemen beeinträchtigt werden können, zu berücksichtigen. In Teilaspekten, wie z. B. bei der Modellerstellung, wird in den Bereichen der KI und des ML das Konzept der Offenheit bereits praktiziert. Das Konzept der erklärbaren KI („Explainable Artificial Intelligence“ – XAI) vermag es aber, das zugehörige Potenzial erheblich steigern. Hierzu stehen verschiedene generische Ansätze (Ante hoc‑, Design- und Post-hoc-Konzepte) sowie die Möglichkeit, diese untereinander zu kombinieren, zur Verfügung. Entsprechend müssen Chancen und Grenzen von XAI systematisch reflektiert werden. Ein geeignetes, XAI-basiertes Modell für das Fällen von Entscheidungen im Unternehmen lässt sich mit Hilfe von Heuristiken näher charakterisieren.

XHAC

2022 ◽  
pp. 146-164
Author(s):  
Duygu Bagci Das ◽  
Derya Birant
Keyword(s):  
Artificial Intelligence ◽  
Machine Learning ◽  
Internet Of Things ◽  
Window Size ◽  
Classification Performance ◽  
Black Box ◽  
Data Exploration ◽  
Learning Models ◽  
Explainable Artificial Intelligence ◽  
Machine Learning Models

Explainable artificial intelligence (XAI) is a concept that has emerged and become popular in recent years. Even interpretation in machine learning models has been drawing attention. Human activity classification (HAC) systems still lack interpretable approaches. In this study, an approach, called eXplainable HAC (XHAC), was proposed in which the data exploration, model structure explanation, and prediction explanation of the ML classifiers for HAR were examined to improve the explainability of the HAR models' components such as sensor types and their locations. For this purpose, various internet of things (IoT) sensors were considered individually, including accelerometer, gyroscope, and magnetometer. The location of these sensors (i.e., ankle, arm, and chest) was also taken into account. The important features were explored. In addition, the effect of the window size on the classification performance was investigated. According to the obtained results, the proposed approach makes the HAC processes more explainable compared to the black-box ML techniques.

Explainable artificial intelligence for education and training

2021 ◽  
pp. 154851292110286
Author(s):  
Krzysztof Fiok ◽  
Farzad V Farahani ◽  
Waldemar Karwowski ◽  
Tareq Ahram
Keyword(s):  
Artificial Intelligence ◽  
Machine Learning ◽  
Black Box ◽  
Target User ◽  
Explainable Artificial Intelligence ◽  
Explainable Ai ◽  
History Of ◽  
User Groups ◽  
And Training ◽  
Intelligent Action

Researchers and software users benefit from the rapid growth of artificial intelligence (AI) to an unprecedented extent in various domains where automated intelligent action is required. However, as they continue to engage with AI, they also begin to understand the limitations and risks associated with ceding control and decision-making to not always transparent artificial computer agents. Understanding of “what is happening in the black box” becomes feasible with explainable AI (XAI) methods designed to mitigate these risks and introduce trust into human-AI interactions. Our study reviews the essential capabilities, limitations, and desiderata of XAI tools developed over recent years and reviews the history of XAI and AI in education (AIED). We present different approaches to AI and XAI from the viewpoint of researchers focused on AIED in comparison with researchers focused on AI and machine learning (ML). We conclude that both groups of interest desire increased efforts to obtain improved XAI tools; however, these groups formulate different target user groups and expectations regarding XAI features and provide different examples of possible achievements. We summarize these viewpoints and provide guidelines for scientists looking to incorporate XAI into their own work.

scholarly journals Explainable AI: A Review of Machine Learning Interpretability Methods

Entropy ◽  
2020 ◽  
Vol 23 (1) ◽  
pp. 18
Author(s):  
Pantelis Linardatos ◽  
Vasilis Papastefanopoulos ◽  
Sotiris Kotsiantis
Keyword(s):  
Artificial Intelligence ◽  
Machine Learning ◽  
Black Box ◽  
Learning Systems ◽  
Model Complexity ◽  
Learning Models ◽  
New Methods ◽  
Industrial Adoption ◽  
Machine Learning Models ◽  
The Way

Recent advances in artificial intelligence (AI) have led to its widespread industrial adoption, with machine learning systems demonstrating superhuman performance in a significant number of tasks. However, this surge in performance, has often been achieved through increased model complexity, turning such systems into “black box” approaches and causing uncertainty regarding the way they operate and, ultimately, the way that they come to decisions. This ambiguity has made it problematic for machine learning systems to be adopted in sensitive yet critical domains, where their value could be immense, such as healthcare. As a result, scientific interest in the field of Explainable Artificial Intelligence (XAI), a field that is concerned with the development of new methods that explain and interpret machine learning models, has been tremendously reignited over recent years. This study focuses on machine learning interpretability methods; more specifically, a literature review and taxonomy of these methods are presented, as well as links to their programming implementations, in the hope that this survey would serve as a reference point for both theorists and practitioners.

Explainable Artificial Intelligence (xAI) Approaches and Deep Meta-Learning Models for Cyber-Physical Systems

2021 ◽  
pp. 42-67
Author(s):  
Evren Daglarli
Keyword(s):  
Artificial Intelligence ◽  
Cyber Physical Systems ◽  
Black Box ◽  
The Internet ◽  
Learning Models ◽  
Physical Systems ◽  
Box Models ◽  
Explainable Artificial Intelligence ◽  
Meta Learning ◽  
Black Box Models

Today, the effects of promising technologies such as explainable artificial intelligence (xAI) and meta-learning (ML) on the internet of things (IoT) and the cyber-physical systems (CPS), which are important components of Industry 4.0, are increasingly intensified. However, there are important shortcomings that current deep learning models are currently inadequate. These artificial neural network based models are black box models that generalize the data transmitted to it and learn from the data. Therefore, the relational link between input and output is not observable. For these reasons, it is necessary to make serious efforts on the explanability and interpretability of black box models. In the near future, the integration of explainable artificial intelligence and meta-learning approaches to cyber-physical systems will have effects on a high level of virtualization and simulation infrastructure, real-time supply chain, cyber factories with smart machines communicating over the internet, maximizing production efficiency, analysis of service quality and competition level.

scholarly journals Automated Reasoning for Explainable Artificial Intelligence

10.29007/4b7h ◽  
2018 ◽  
Author(s):  
Maria Paola Bonacina
Keyword(s):  
Artificial Intelligence ◽  
Machine Learning ◽  
Automated Reasoning ◽  
Position Statement ◽  
Short Paper ◽  
Future Research ◽  
Grand Challenge ◽  
New Paradigm ◽  
Research Areas ◽  
Explainable Artificial Intelligence

Reasoning and learning have been considered fundamental features of intelligence ever since the dawn of the field of artificial intelligence, leading to the development of the research areas of automated reasoning and machine learning. This short paper is a non-technical position statement that aims at prompting a discussion of the relationship between automated reasoning and machine learning, and more generally between automated reasoning and artificial intelligence. We suggest that the emergence of the new paradigm of XAI, that stands for eXplainable Artificial Intelligence, is an opportunity for rethinking these relationships, and that XAI may offer a grand challenge for future research on automated reasoning.

scholarly journals Artificial Intelligence in Education

Seminar.net ◽  
2021 ◽  
Vol 17 (2) ◽  
Author(s):  
Xavier Giró Gràcia ◽  
Juana M. Sancho-Gil
Keyword(s):  
Artificial Intelligence ◽  
Machine Learning ◽  
Big Data ◽  
Digital Technology ◽  
Social Systems ◽  
Machine Learning Algorithms ◽  
Educational Systems ◽  
Negative Effects ◽  
Black Boxes ◽  
Artificial Intelligence In Education

Digital technology is constantly permeating and transforming all social systems, and education is not an exception. In the last decade, the unstoppable development of Artificial Intelligence, based on machine learning algorithms and fuelled by Big Data, has given a new push to the hope of improving learning-based machines, and providing educational systems with ‘effective’ solutions. Educators, educational researchers and policymakers, in general, lack the knowledge and expertise to understand the underlying logic of these new ‘black boxes’, and we do not have sufficient research-based evidence to understand the consequences that an excessive use of screens has in students’ development. This paper first discusses the notions behind what Big Data is and what it means in our current society; how data is the new currency that has driven the use of algorithms in all areas of our society, and specifically in the field of Artificial Intelligence; and the concept of ‘black boxes’, and its possible impact on education. Then, it discusses the underlying educational discourses, pointing out the need to analyse not only their contributions but also their possible negative effects. It finishes with considerations and a proposed agenda for further studying this phenomenon.

scholarly journals Discovering hidden information in biosignals from patients using artificial intelligence

2020 ◽  
Vol 73 (4) ◽  
pp. 275-284
Author(s):  
Dukyong Yoon ◽  
Jong-Hwan Jang ◽  
Byung Jin Choi ◽  
Tae Young Kim ◽  
Chang Ho Han
Keyword(s):  
Artificial Intelligence ◽  
Machine Learning ◽  
Deep Learning ◽  
Medical Condition ◽  
Real Life ◽  
Black Box ◽  
Basic Knowledge ◽  
Hidden Information ◽  
Near Future ◽  
Invasive Evaluation

Biosignals such as electrocardiogram or photoplethysmogram are widely used for determining and monitoring the medical condition of patients. It was recently discovered that more information could be gathered from biosignals by applying artificial intelligence (AI). At present, one of the most impactful advancements in AI is deep learning. Deep learning-based models can extract important features from raw data without feature engineering by humans, provided the amount of data is sufficient. This AI-enabled feature presents opportunities to obtain latent information that may be used as a digital biomarker for detecting or predicting a clinical outcome or event without further invasive evaluation. However, the black box model of deep learning is difficult to understand for clinicians familiar with a conventional method of analysis of biosignals. A basic knowledge of AI and machine learning is required for the clinicians to properly interpret the extracted information and to adopt it in clinical practice. This review covers the basics of AI and machine learning, and the feasibility of their application to real-life situations by clinicians in the near future.

scholarly journals Explainable AI and Reinforcement Learning—A Systematic Review of Current Approaches and Trends

2021 ◽  
Vol 4 ◽  
Author(s):  
Lindsay Wells ◽  
Tomasz Bednarz
Keyword(s):  
Artificial Intelligence ◽  
Machine Learning ◽  
Systematic Review ◽  
Reinforcement Learning ◽  
User Studies ◽  
Human In The Loop ◽  
Search Results ◽  
Explainable Artificial Intelligence ◽  
Explainable Ai ◽  
Immersive Visualization

Research into Explainable Artificial Intelligence (XAI) has been increasing in recent years as a response to the need for increased transparency and trust in AI. This is particularly important as AI is used in sensitive domains with societal, ethical, and safety implications. Work in XAI has primarily focused on Machine Learning (ML) for classification, decision, or action, with detailed systematic reviews already undertaken. This review looks to explore current approaches and limitations for XAI in the area of Reinforcement Learning (RL). From 520 search results, 25 studies (including 5 snowball sampled) are reviewed, highlighting visualization, query-based explanations, policy summarization, human-in-the-loop collaboration, and verification as trends in this area. Limitations in the studies are presented, particularly a lack of user studies, and the prevalence of toy-examples and difficulties providing understandable explanations. Areas for future study are identified, including immersive visualization, and symbolic representation.

Sign in / Sign up

Export Citation Format

Share Document