O-098 Embryo selection using Artificial Intelligence (AI): Epistemic and ethical considerations

2021 ◽  
Vol 36 (Supplement_1) ◽  
Author(s):  
M Afnan ◽  
Y Liu ◽  
V Conitzer ◽  
C Rudin ◽  
A Mishra ◽  
...  
Keyword(s):  
Artificial Intelligence ◽  
Machine Learning ◽  
Ethical Issues ◽  
Clinical Effectiveness ◽  
Black Box ◽  
Embryo Selection ◽  
Societal Implications ◽  
Ethical Considerations ◽  
Box Models ◽  
Black Box Models

Abstract Study question What are the epistemic and ethical considerations of clinically implementing Artificial Intelligence (AI) algorithms in embryo selection? Summary answer AI embryo selection algorithms used to date are “black-box” models with significant epistemic and ethical issues, and there are no trials assessing their clinical effectiveness. What is known already The innovation of time-lapse imaging offers the potential to generate vast quantities of data for embryo assessment. Computer Vision allows image data to be analysed using algorithms developed via machine learning which learn and adapt as they are exposed to more data. Most algorithms are developed using neural networks and are uninterpretable (or “black box”). Uninterpretable models are either too complicated to understand or proprietary, in which case comprehension is impossible for outsiders. In the IVF context, these outsiders include doctors, embryologists and patients, which raises ethical questions for its use in embryo selection. Study design, size, duration We performed a scoping review of articles evaluating AI for embryo selection in IVF. We considered the epistemic and ethical implications of current approaches. Participants/materials, setting, methods We searched Medline, Embase, ClinicalTrials.gov and the EU Clinical Trials Register for full text papers evaluating AI for embryo selection using the following key words: artificial intelligence* OR AI OR neural network* OR machine learning OR support vector machine OR automatic classification AND IVF OR in vitro fertilisation OR embryo*, as well as relevant MeSH and Emtree terms for Medline and Embase respectively. Main results and the role of chance We found no trials evaluating clinical effectiveness either published or registered. We found efficacy studies which looked at 2 types of outcomes – accuracy for predicting pregnancy or live birth and agreement with embryologist evaluation. Some algorithms were shown to broadly differentiate well between “good-” and “poor-” quality embryos but not between embryos of similar quality, which is the clinical need. Almost universally, the AI models were opaque (“black box”) in that at least some part of the process was uninterpretable. “Black box” models are problematic for epistemic and ethical reasons. Epistemic concerns include information asymmetries between algorithm developers and doctors, embryologists and patients; the risk of biased prediction caused by known and/or unknown confounders during the training process; difficulties in real-time error checking due to limited interpretability; the economics of buying into commercial proprietary models, brittle to variation in the treatment process; and an overall difficulty troubleshooting. Ethical pitfalls include the risk of misrepresenting patient values; concern for the health and well-being of future children; the risk of disvaluing disability; possible societal implications; and a responsibility gap, in the event of adverse events. Limitations, reasons for caution Our search was limited to the two main medical research databases. Although we checked article references for more publications, we were less likely to identify studies that were not indexed in Medline or Embase, especially if they were not cited in studies identified in our search. Wider implications of the findings It is premature to implement AI for embryo selection outside of a clinical trial. AI for embryo selection is potentially useful, but must be done carefully and transparently, as the epistemic and ethical issues are significant. We advocate for the use of interpretable AI models to overcome these issues. Trial registration number not applicable

scholarly journals Explainable, Trustworthy, and Ethical Machine Learning for Healthcare: A Survey

2021 ◽  
Author(s):  
Khansa Rasheed ◽  
Adnan Qayyum ◽  
Mohammed Ghaly ◽  
Ala Al-Fuqaha ◽  
Adeel Razi ◽  
...  
Keyword(s):  
Machine Learning ◽  
Ethical Issues ◽  
Black Box ◽  
Healthcare Applications ◽  
Ethical Problems ◽  
Clinical Utilization ◽  
Box Models ◽  
Research Problems ◽  
Further Development ◽  
Black Box Models

With the advent of machine learning (ML) applications in daily life, the questions about liability, trust, and interpretability of their outputs are raising, especially for healthcare applications. The black-box nature of ML models is a roadblock for clinical utilization. Therefore, to gain the trust of clinicians and patients, researchers need to provide explanations of how and why the model is making a specific decision. With the promise of enhancing the trust and transparency of black-box models, researchers are in the phase of maturing the field of eXplainable ML (XML). In this paper, we provide a comprehensive review of explainable and interpretable ML techniques implemented for providing the reasons behind their decisions for various healthcare applications. Along with highlighting various security, safety, and robustness challenges that hinder the trustworthiness of ML we also discussed the ethical issues of healthcare ML and describe how explainable and trustworthy ML can resolve these ethical problems. Finally, we elaborate on the limitations of existing approaches and highlight various open research problems that require further development.

scholarly journals The importance of ensuring artificial intelligence and machine learning can be understood at the human level

2019 ◽  
Vol 29 (Supplement_4) ◽  
Author(s):  
S Ram
Keyword(s):  
Artificial Intelligence ◽  
Machine Learning ◽  
Large Scale ◽  
Clinical Decision Making ◽  
Prediction Models ◽  
Predictive Analytics ◽  
Black Box ◽  
User Engagement ◽  
Box Models ◽  
Black Box Models

Abstract With rapid developments in big data technology and the prevalence of large-scale datasets from diverse sources, the healthcare predictive analytics (HPA) field is witnessing a dramatic surge in interest. In healthcare, it is not only important to provide accurate predictions, but also critical to provide reliable explanations to the underlying black-box models making the predictions. Such explanations can play a crucial role in not only supporting clinical decision-making but also facilitating user engagement and patient safety. If users and decision makers do not have faith in the HPA model, it is highly likely that they will reject its use. Furthermore, it is extremely risky to blindly accept and apply the results derived from black-box models, which might lead to undesirable consequences or life-threatening outcomes in domains with high stakes such as healthcare. As machine learning and artificial intelligence systems are becoming more capable and ubiquitous, explainable artificial intelligence and machine learning interpretability are garnering significant attention among practitioners and researchers. The introduction of policies such as the General Data Protection Regulation (GDPR), has amplified the need for ensuring human interpretability of prediction models. In this talk I will discuss methods and applications for developing local as well as global explanations from machine learning and the value they can provide for healthcare prediction.

scholarly journals Explainable, Trustworthy, and Ethical Machine Learning for Healthcare: A Survey

2021 ◽  
Author(s):  
Khansa Rasheed ◽  
Adnan Qayyum ◽  
Mohammed Ghaly ◽  
Ala Al-Fuqaha ◽  
Adeel Razi ◽  
...  
Keyword(s):  
Machine Learning ◽  
Ethical Issues ◽  
Black Box ◽  
Healthcare Applications ◽  
Ethical Problems ◽  
Clinical Utilization ◽  
Box Models ◽  
Research Problems ◽  
Further Development ◽  
Black Box Models

With the advent of machine learning (ML) applications in daily life, the questions about liability, trust, and interpretability of their outputs are raising, especially for healthcare applications. The black-box nature of ML models is a roadblock for clinical utilization. Therefore, to gain the trust of clinicians and patients, researchers need to provide explanations of how and why the model is making a specific decision. With the promise of enhancing the trust and transparency of black-box models, researchers are in the phase of maturing the field of eXplainable ML (XML). In this paper, we provide a comprehensive review of explainable and interpretable ML techniques implemented for providing the reasons behind their decisions for various healthcare applications. Along with highlighting various security, safety, and robustness challenges that hinder the trustworthiness of ML we also discussed the ethical issues of healthcare ML and describe how explainable and trustworthy ML can resolve these ethical problems. Finally, we elaborate on the limitations of existing approaches and highlight various open research problems that require further development.

scholarly journals The Role of Textualisation and Argumentation in Understanding the Machine Learning Process

2017 ◽  
Author(s):  
Kacper Sokol ◽  
Peter Flach
Keyword(s):  
Machine Learning ◽  
Predictive Accuracy ◽  
Spatial Perception ◽  
Black Box ◽  
High Dimensional ◽  
Box Models ◽  
Machine Learning Applications ◽  
Black Box Models ◽  
Machine Learning Models

Understanding data, models and predictions is important for machine learning applications. Due to the limitations of our spatial perception and intuition, analysing high-dimensional data is inherently difficult. Furthermore, black-box models achieving high predictive accuracy are widely used, yet the logic behind their predictions is often opaque. Use of textualisation -- a natural language narrative of selected phenomena -- can tackle these shortcomings. When extended with argumentation theory we could envisage machine learning models and predictions arguing persuasively for their choices.

Explainable Artificial Intelligence (xAI) Approaches and Deep Meta-Learning Models for Cyber-Physical Systems

2021 ◽  
pp. 42-67
Author(s):  
Evren Daglarli
Keyword(s):  
Artificial Intelligence ◽  
Cyber Physical Systems ◽  
Black Box ◽  
The Internet ◽  
Learning Models ◽  
Physical Systems ◽  
Box Models ◽  
Explainable Artificial Intelligence ◽  
Meta Learning ◽  
Black Box Models

Today, the effects of promising technologies such as explainable artificial intelligence (xAI) and meta-learning (ML) on the internet of things (IoT) and the cyber-physical systems (CPS), which are important components of Industry 4.0, are increasingly intensified. However, there are important shortcomings that current deep learning models are currently inadequate. These artificial neural network based models are black box models that generalize the data transmitted to it and learn from the data. Therefore, the relational link between input and output is not observable. For these reasons, it is necessary to make serious efforts on the explanability and interpretability of black box models. In the near future, the integration of explainable artificial intelligence and meta-learning approaches to cyber-physical systems will have effects on a high level of virtualization and simulation infrastructure, real-time supply chain, cyber factories with smart machines communicating over the internet, maximizing production efficiency, analysis of service quality and competition level.

scholarly journals Explainable Artificial Intelligence (xAI) Approaches and Deep Meta-Learning Models

2020 ◽  
Author(s):  
Evren Dağlarli
Keyword(s):  
Artificial Intelligence ◽  
Deep Learning ◽  
Black Box ◽  
Learning Models ◽  
Learning Methods ◽  
Data Set ◽  
Box Models ◽  
Explainable Artificial Intelligence ◽  
Artificial Neural ◽  
Black Box Models

The explainable artificial intelligence (xAI) is one of the interesting issues that has emerged recently. Many researchers are trying to deal with the subject with different dimensions and interesting results that have come out. However, we are still at the beginning of the way to understand these types of models. The forthcoming years are expected to be years in which the openness of deep learning models is discussed. In classical artificial intelligence approaches, we frequently encounter deep learning methods available today. These deep learning methods can yield highly effective results according to the data set size, data set quality, the methods used in feature extraction, the hyper parameter set used in deep learning models, the activation functions, and the optimization algorithms. However, there are important shortcomings that current deep learning models are currently inadequate. These artificial neural network-based models are black box models that generalize the data transmitted to it and learn from the data. Therefore, the relational link between input and output is not observable. This is an important open point in artificial neural networks and deep learning models. For these reasons, it is necessary to make serious efforts on the explainability and interpretability of black box models.

A Short Introduction to the Ethics of Artificial Intelligence

2020 ◽  
pp. 1-42
Author(s):  
S. Matthew Liao
Keyword(s):  
Artificial Intelligence ◽  
Machine Learning ◽  
Intelligent Systems ◽  
Ethical Issues ◽  
Black Box ◽  
Human Beings ◽  
Key Issues ◽  
Long Term Impact ◽  
Bad Data

This introduction outlines in section I.1 some of the key issues in the study of the ethics of artificial intelligence (AI) and proposes ways to take these discussions further. Section I.2 discusses key concepts in AI, machine learning, and deep learning. Section I.3 considers ethical issues that arise because current machine learning is data hungry; is vulnerable to bad data and bad algorithms; is a black box that has problems with interpretability, explainability, and trust; and lacks a moral sense. Section I.4 discusses ethical issues that arise because current machine learning systems may be working too well and human beings can be vulnerable in the presence of these intelligent systems. Section I.5 examines ethical issues arising out of the long-term impact of superintelligence such as how the values of a superintelligent AI can be aligned with human values. Section I.6 presents an overview of the essays in this volume.

scholarly journals Identifying the Machine Learning Family from Black-Box Models

2018 ◽  
pp. 55-65
Author(s):  
Raül Fabra-Boluda ◽  
Cèsar Ferri ◽  
José Hernández-Orallo ◽  
Fernando Martínez-Plumed ◽  
María José Ramírez-Quintana
Keyword(s):  
Machine Learning ◽  
Black Box ◽  
Box Models ◽  
Black Box Models

scholarly journals To trust or not to trust an explanation: using LEAF to evaluate local linear XAI methods

2021 ◽  
Vol 7 ◽  
pp. e479
Author(s):  
Elvio Amparore ◽  
Alan Perotti ◽  
Paolo Bajardi
Keyword(s):  
Artificial Intelligence ◽  
Decision Support ◽  
State Of The Art ◽  
Black Box ◽  
Evaluation Procedures ◽  
Local Linear ◽  
Box Models ◽  
Explainable Artificial Intelligence ◽  
The Many ◽  
Black Box Models

The main objective of eXplainable Artificial Intelligence (XAI) is to provide effective explanations for black-box classifiers. The existing literature lists many desirable properties for explanations to be useful, but there is a scarce consensus on how to quantitatively evaluate explanations in practice. Moreover, explanations are typically used only to inspect black-box models, and the proactive use of explanations as a decision support is generally overlooked. Among the many approaches to XAI, a widely adopted paradigm is Local Linear Explanations—with LIME and SHAP emerging as state-of-the-art methods. We show that these methods are plagued by many defects including unstable explanations, divergence of actual implementations from the promised theoretical properties, and explanations for the wrong label. This highlights the need to have standard and unbiased evaluation procedures for Local Linear Explanations in the XAI field. In this paper we address the problem of identifying a clear and unambiguous set of metrics for the evaluation of Local Linear Explanations. This set includes both existing and novel metrics defined specifically for this class of explanations. All metrics have been included in an open Python framework, named LEAF. The purpose of LEAF is to provide a reference for end users to evaluate explanations in a standardised and unbiased way, and to guide researchers towards developing improved explainable techniques.

scholarly journals Hybrid Machine Learning Approaches and a Systematic Model Selection Process for Predicting Soot Emissions in Compression Ignition Engines

Energies ◽  
2021 ◽  
Vol 14 (23) ◽  
pp. 7865
Author(s):  
Saeid Shahpouri ◽  
Armin Norouzi ◽  
Christopher Hayduk ◽  
Reza Rezaei ◽  
Mahdi Shahbakhti ◽  
...  
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Feature Selection ◽  
Black Box ◽  
Box Model ◽  
Feature Sets ◽  
Machine Learning Methods ◽  
Box Models ◽  
Soot Emissions ◽  
Black Box Models

The standards for emissions from diesel engines are becoming more stringent and accurate emission modeling is crucial in order to control the engine to meet these standards. Soot emissions are formed through a complex process and are challenging to model. A comprehensive analysis of diesel engine soot emissions modeling for control applications is presented in this paper. Physical, black-box, and gray-box models are developed for soot emissions prediction. Additionally, different feature sets based on the least absolute shrinkage and selection operator (LASSO) feature selection method and physical knowledge are examined to develop computationally efficient soot models with good precision. The physical model is a virtual engine modeled in GT-Power software that is parameterized using a portion of experimental data. Different machine learning methods, including Regression Tree (RT), Ensemble of Regression Trees (ERT), Support Vector Machines (SVM), Gaussian Process Regression (GPR), Artificial Neural Network (ANN), and Bayesian Neural Network (BNN) are used to develop the black-box models. The gray-box models include a combination of the physical and black-box models. A total of five feature sets and eight different machine learning methods are tested. An analysis of the accuracy, training time and test time of the models is performed using the K-means clustering algorithm. It provides a systematic way for categorizing the feature sets and methods based on their performance and selecting the best method for a specific application. According to the analysis, the black-box model consisting of GPR and feature selection by LASSO shows the best performance with test R2 of 0.96. The best gray-box model consists of SVM-based method with physical insight feature set along with LASSO for feature selection with test R2 of 0.97.

Sign in / Sign up

Export Citation Format

Share Document