scholarly journals Explainable Artificial Intelligence (XAI) in Biomedicine: Making AI Decisions Trustworthy for Physicians and Patients

2021 ◽  
Vol 2 (1) ◽  
pp. 1-17
Author(s):  
Jörn Lötsch ◽  
Dario Kringel ◽  
Alfred Ultsch

The use of artificial intelligence (AI) systems in biomedical and clinical settings can disrupt the traditional doctor–patient relationship, which is based on trust and transparency in medical advice and therapeutic decisions. When the diagnosis or selection of a therapy is no longer made solely by the physician, but to a significant extent by a machine using algorithms, decisions become nontransparent. Skill learning is the most common application of machine learning algorithms in clinical decision making. These are a class of very general algorithms (artificial neural networks, classifiers, etc.), which are tuned based on examples to optimize the classification of new, unseen cases. It is pointless to ask for an explanation for a decision. A detailed understanding of the mathematical details of an AI algorithm may be possible for experts in statistics or computer science. However, when it comes to the fate of human beings, this “developer’s explanation” is not sufficient. The concept of explainable AI (XAI) as a solution to this problem is attracting increasing scientific and regulatory interest. This review focuses on the requirement that XAIs must be able to explain in detail the decisions made by the AI to the experts in the field.

2021 ◽  
Vol 28 (1) ◽  
pp. e100251
Author(s):  
Ian Scott ◽  
Stacey Carter ◽  
Enrico Coiera

Machine learning algorithms are being used to screen and diagnose disease, prognosticate and predict therapeutic responses. Hundreds of new algorithms are being developed, but whether they improve clinical decision making and patient outcomes remains uncertain. If clinicians are to use algorithms, they need to be reassured that key issues relating to their validity, utility, feasibility, safety and ethical use have been addressed. We propose a checklist of 10 questions that clinicians can ask of those advocating for the use of a particular algorithm, but which do not expect clinicians, as non-experts, to demonstrate mastery over what can be highly complex statistical and computational concepts. The questions are: (1) What is the purpose and context of the algorithm? (2) How good were the data used to train the algorithm? (3) Were there sufficient data to train the algorithm? (4) How well does the algorithm perform? (5) Is the algorithm transferable to new clinical settings? (6) Are the outputs of the algorithm clinically intelligible? (7) How will this algorithm fit into and complement current workflows? (8) Has use of the algorithm been shown to improve patient care and outcomes? (9) Could the algorithm cause patient harm? and (10) Does use of the algorithm raise ethical, legal or social concerns? We provide examples where an algorithm may raise concerns and apply the checklist to a recent review of diagnostic imaging applications. This checklist aims to assist clinicians in assessing algorithm readiness for routine care and identify situations where further refinement and evaluation is required prior to large-scale use.


2021 ◽  
Vol 29 (Supplement_1) ◽  
pp. i18-i18
Author(s):  
N Hassan ◽  
R Slight ◽  
D Weiand ◽  
A Vellinga ◽  
G Morgan ◽  
...  

Abstract Introduction Sepsis is a life-threatening condition that is associated with increased mortality. Artificial intelligence tools can inform clinical decision making by flagging patients who may be at risk of developing infection and subsequent sepsis and assist clinicians with their care management. Aim To identify the optimal set of predictors used to train machine learning algorithms to predict the likelihood of an infection and subsequent sepsis and inform clinical decision making. Methods This systematic review was registered in PROSPERO database (CRD42020158685). We searched 3 large databases: Medline, Cumulative Index of Nursing and Allied Health Literature, and Embase, using appropriate search terms. We included quantitative primary research studies that focused on sepsis prediction associated with bacterial infection in adult population (>18 years) in all care settings, which included data on predictors to develop machine learning algorithms. The timeframe of the search was 1st January 2000 till the 25th November 2019. Data extraction was performed using a data extraction sheet, and a narrative synthesis of eligible studies was undertaken. Narrative analysis was used to arrange the data into key areas, and compare and contrast between the content of included studies. Quality assessment was performed using Newcastle-Ottawa Quality Assessment scale, which was used to evaluate the quality of non-randomized studies. Bias was not assessed due to the non-randomised nature of the included studies. Results Fifteen articles met our inclusion criteria (Figure 1). We identified 194 predictors that were used to train machine learning algorithms to predict infection and subsequent sepsis, with 13 predictors used on average across all included studies. The most significant predictors included age, gender, smoking, alcohol intake, heart rate, blood pressure, lactate level, cardiovascular disease, endocrine disease, cancer, chronic kidney disease (eGFR<60ml/min), white blood cell count, liver dysfunction, surgical approach (open or minimally invasive), and pre-operative haematocrit < 30%. These predictors were used for the development of all the algorithms in the fifteen articles. All included studies used artificial intelligence techniques to predict the likelihood of sepsis, with average sensitivity 77.5±19.27, and average specificity 69.45±21.25. Conclusion The type of predictors used were found to influence the predictive power and predictive timeframe of the developed machine learning algorithm. Two strengths of our review were that we included studies published since the first definition of sepsis was published in 2001, and identified factors that can improve the predictive ability of algorithms. However, we note that the included studies had some limitations, with three studies not validating the models that they developed, and many tools limited by either their reduced specificity or sensitivity or both. This work has important implications for practice, as predicting the likelihood of sepsis can help inform the management of patients and concentrate finite resources to those patients who are most at risk. Producing a set of predictors can also guide future studies in developing more sensitive and specific algorithms with increased predictive time window to allow for preventive clinical measures.


Author(s):  
Prashant Johri ◽  
Vivek sen Saxena ◽  
Avneesh Kumar

With the continuous improvement of digital imaging technology and rapid increase in the use of digital medical records in last decade, artificial intelligence has provided various techniques to analyze these data. Machine learning, a subset of artificial intelligence techniques, provides the ability to learn from past and present and to predict the future on the basis of data. Various AI-enabled support systems are designed by using machine learning algorithms in order to optimize and computerize the process of clinical decision making and to bring about a massive archetype change in the healthcare sector such as timely identification, revealing and treatment of disease, as well as outcome prediction. Machine learning algorithms are implemented in the healthcare sector and helped in diagnosis of critical illness such as cancer, neurology, cardiac, and kidney disease as well as with easing in anticipation of disease progression. By applying and executing machine learning algorithms over healthcare data, one can evaluate, analyze, and generate the results that can be used not only to advance the prior health studies but also to aid in forecasting a patient's chances of developing of various diseases. The aim in this article is to present an overview of machine learning and to cover various algorithms of machine learning and their present implementation in the healthcare sector.


2021 ◽  
Author(s):  
Zeeshan Ahmed

Advancing frontiers of clinical research, we discuss the need for intelligent health systems to support a deeper investigation of COVID-19. We hypothesize that the convergence of the healthcare data and staggering developments in artificial intelligence have the potential to elevate the recovery process with diagnostic and predictive analysis to identify major causes of mortality, modifiable risk factors and actionable information that supports the early detection and prevention of COVID-19. However, current constraints include the recruitment of COVID-19 patients for research; translational integration of electronic health records and diversified public datasets; and the development of artificial intelligence systems for data-intensive computational modeling to assist clinical decision making. We propose a novel nexus of machine learning algorithms to examine COVID-19 data granularity from population studies to subgroups stratification and ensure best modeling strategies within the data continuum.


2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Imogen Schofield ◽  
David C. Brodbelt ◽  
Noel Kennedy ◽  
Stijn J. M. Niessen ◽  
David B. Church ◽  
...  

AbstractCushing’s syndrome is an endocrine disease in dogs that negatively impacts upon the quality-of-life of affected animals. Cushing’s syndrome can be a challenging diagnosis to confirm, therefore new methods to aid diagnosis are warranted. Four machine-learning algorithms were applied to predict a future diagnosis of Cushing's syndrome, using structured clinical data from the VetCompass programme in the UK. Dogs suspected of having Cushing's syndrome were included in the analysis and classified based on their final reported diagnosis within their clinical records. Demographic and clinical features available at the point of first suspicion by the attending veterinarian were included within the models. The machine-learning methods were able to classify the recorded Cushing’s syndrome diagnoses, with good predictive performance. The LASSO penalised regression model indicated the best overall performance when applied to the test set with an AUROC = 0.85 (95% CI 0.80–0.89), sensitivity = 0.71, specificity = 0.82, PPV = 0.75 and NPV = 0.78. The findings of our study indicate that machine-learning methods could predict the future diagnosis of a practicing veterinarian. New approaches using these methods could support clinical decision-making and contribute to improved diagnosis of Cushing’s syndrome in dogs.


2021 ◽  
Author(s):  
Gregory M Miller ◽  
Austin J Ellis ◽  
Rangaprasad Sarangarajan ◽  
Amay Parikh ◽  
Leonardo O Rodrigues ◽  
...  

Objective: The COVID-19 pandemic generated a massive amount of clinical data, which potentially holds yet undiscovered answers related to COVID-19 morbidity, mortality, long term effects, and therapeutic solutions. The objective of this study was to generate insights on COVID-19 mortality-associated factors and identify potential new therapeutic options for COVID-19 patients by employing artificial intelligence analytics on real-world data. Materials and Methods: A Bayesian statistics-based artificial intelligence data analytics tool (bAIcis®) within Interrogative Biology® platform was used for network learning, inference causality and hypothesis generation to analyze 16,277 PCR positive patients from a database of 279,281 inpatients and outpatients tested for SARS-CoV-2 infection by antigen, antibody, or PCR methods during the first pandemic year in Central Florida. This approach generated causal networks that enabled unbiased identification of significant predictors of mortality for specific COVID-19 patient populations. These findings were validated by logistic regression, regression by least absolute shrinkage and selection operator, and bootstrapping. Results: We found that in the SARS-CoV-2 PCR positive patient cohort, early use of the antiemetic agent ondansetron was associated with increased survival in mechanically ventilated patients. Conclusions: The results demonstrate how real world COVID-19 focused data analysis using artificial intelligence can generate valid insights that could possibly support clinical decision-making and minimize the future loss of lives and resources.


2011 ◽  
pp. 1017-1029
Author(s):  
William Claster ◽  
Nader Ghotbi ◽  
Subana Shanmuganathan

There is a treasure trove of hidden information in the textual and narrative data of medical records that can be deciphered by text-mining techniques. The information provided by these methods can provide a basis for medical artificial intelligence and help support or improve clinical decision making by medical doctors. In this paper we extend previous work in an effort to extract meaningful information from free text medical records. We discuss a methodology for the analysis of medical records using some statistical analysis and the Kohonen Self-Organizing Map (SOM). The medical data derive from about 700 pediatric patients’ radiology department records where CT (Computed Tomography) scanning was used as part of a diagnostic exploration. The patients underwent CT scanning (single and multiple) throughout a one-year period in 2004 at the Nagasaki University Medical Hospital. Our approach led to a model based on SOM clusters and statistical analysis which may suggest a strategy for limiting CT scan requests. This is important because radiation at levels ordinarily used for CT scanning may pose significant health risks especially to children.


Author(s):  
Vanessa M Ferreira ◽  
Juliano L Fernandes ◽  
Cristina Basso ◽  
Matthias G Friedrich

Myocarditis has a high prevalence, especially in young and middle-aged patients. It is the most important differential diagnosis in patients with acute cardiac disease and evidence for cellular injury (positive troponin). In clinical decision-making, it is important to rule in or rule out myocardial inflammation. While endomyocardial biopsy, which remains the gold standard to achieve an aetiopathogenetic diagnosis, can be helpful in patients with heart failure, it is less used in the majority of cases. Cardiovascular magnetic resonance (CMR) imaging has become the most efficient non-invasive diagnostic tool for patients with suspected myocarditis. Its unique value is based on the ability to identify inflammation and myocardial injury, in combination with an accurate assessment of ventricular volumes, as well as regional and global function. In many centres, myocarditis is the most frequent indication for CMR. The diagnostic criteria include markers for myocardial oedema, hyperaemia, and necrosis, while regional or global dysfunction and pericardial effusion serve as supportive criteria. Novel markers, such as quantitative mapping techniques, may allow for even better identification and classification of myocarditis.


Sign in / Sign up

Export Citation Format

Share Document