scholarly journals Integrated Commonsense Reasoning and Deep Learning for Transparent Decision Making in Robotics

2021 ◽  
Vol 2 (4) ◽  
Author(s):  
Tiago Mota ◽  
Mohan Sridharan ◽  
Aleš Leonardis
Keyword(s):  
Decision Making ◽  
Deep Learning ◽  
Domain Knowledge ◽  
Inductive Learning ◽  
Commonsense Reasoning ◽  
Knowledge Based ◽  
New Information ◽  
Robot Systems ◽  
Simulated Images ◽  
Relevant Domain

AbstractA robot’s ability to provide explanatory descriptions of its decisions and beliefs promotes effective collaboration with humans. Providing the desired transparency in decision making is challenging in integrated robot systems that include knowledge-based reasoning methods and data-driven learning methods. As a step towards addressing this challenge, our architecture combines the complementary strengths of non-monotonic logical reasoning with incomplete commonsense domain knowledge, deep learning, and inductive learning. During reasoning and learning, the architecture enables a robot to provide on-demand explanations of its decisions, the evolution of associated beliefs, and the outcomes of hypothetical actions, in the form of relational descriptions of relevant domain objects, attributes, and actions. The architecture’s capabilities are illustrated and evaluated in the context of scene understanding tasks and planning tasks performed using simulated images and images from a physical robot manipulating tabletop objects. Experimental results indicate the ability to reliably acquire and merge new information about the domain in the form of constraints, preconditions, and effects of actions, and to provide accurate explanations in the presence of noisy sensing and actuation.

scholarly journals Commonsense Reasoning to Guide Deep Learning for Scene Understanding (Extended Abstract)

2020 ◽  
Author(s):  
Mohan Sridharan ◽  
Tiago Mota
Keyword(s):  
Domain Knowledge ◽  
Inductive Learning ◽  
Network Models ◽  
Computational Effort ◽  
Partial Occlusion ◽  
Commonsense Reasoning ◽  
Deep Networks ◽  
Training Examples ◽  
The Stability ◽  
Simulated Images

Our architecture uses non-monotonic logical reasoning with incomplete commonsense domain knowledge, and incremental inductive learning, to guide the construction of deep network models from a small number of training examples. Experimental results in the context of a robot reasoning about the partial occlusion of objects and the stability of object configurations in simulated images indicate an improvement in reliability and a reduction in computational effort in comparison with an architecture based just on deep networks.

scholarly journals Knowledge-Driven GeoAI: Integrating Spatial Knowledge into Multi-Scale Deep Learning for Mars Crater Detection

2021 ◽  
Vol 13 (11) ◽  
pp. 2116
Author(s):  
Chia-Yu Hsu ◽  
Wenwen Li ◽  
Sizhe Wang
Keyword(s):  
Deep Learning ◽  
Object Detection ◽  
Domain Knowledge ◽  
Spatial Knowledge ◽  
Feature Maps ◽  
Automated Mapping ◽  
Knowledge Based ◽  
Accurate Localization ◽  
Crater Detection ◽  
Multi Stage

This paper introduces a new GeoAI solution to support automated mapping of global craters on the Mars surface. Traditional crater detection algorithms suffer from the limitation of working only in a semiautomated or multi-stage manner, and most were developed to handle a specific dataset in a small subarea of Mars’ surface, hindering their transferability for global crater detection. As an alternative, we propose a GeoAI solution based on deep learning to tackle this problem effectively. Three innovative features are integrated into our object detection pipeline: (1) a feature pyramid network is leveraged to generate feature maps with rich semantics across multiple object scales; (2) prior geospatial knowledge based on the Hough transform is integrated to enable more accurate localization of potential craters; and (3) a scale-aware classifier is adopted to increase the prediction accuracy of both large and small crater instances. The results show that the proposed strategies bring a significant increase in crater detection performance than the popular Faster R-CNN model. The integration of geospatial domain knowledge into the data-driven analytics moves GeoAI research up to the next level to enable knowledge-driven GeoAI. This research can be applied to a wide variety of object detection and image analysis tasks.

scholarly journals Educing knowledge from text: semantic information extraction of spatial concepts and places

2021 ◽  
Vol 2 ◽  
pp. 1-7
Author(s):  
Evangelos Papadias ◽  
Margarita Kokla ◽  
Eleni Tomai
Keyword(s):  
Natural Language ◽  
Domain Knowledge ◽  
Semantic Information ◽  
Semantic Annotation ◽  
Semantic Search ◽  
Web Based ◽  
Spatial Concepts ◽  
Knowledge Based ◽  
Relevant Domain ◽  
Semantic Visualization

Abstract. A growing body of geospatial research has shifted the focus from fully structured to semistructured and unstructured content written in natural language. Natural language texts provide a wealth of knowledge about geospatial concepts, places, events, and activities that needs to be extracted and formalized to support semantic annotation, knowledge-based exploration, and semantic search. The paper presents a web-based prototype for the extraction of geospatial entities and concepts, and the subsequent semantic visualization and interactive exploration of the extraction results. A lightweight ontology anchored in natural language guides the interpretation of natural language texts and the extraction of relevant domain knowledge. The approach is applied on three heterogeneous sources which provide a wealth of spatial concepts and place names.

IMPLEMENTASI METODE VIKOR DALAM PENERIMAAN JURNALIS PADA KORAN WASPADA MEDAN

2018 ◽  
Vol 2 (1) ◽  
Author(s):  
Soraya Rahma Hayati ◽  
Mesran Mesran ◽  
Taronisokhi Zebua ◽  
Heri Nurdiyanto ◽  
Khasanah Khasanah
Keyword(s):  
Decision Making ◽  
Decision Support ◽  
Decision Support System ◽  
Decision Support Systems ◽  
Support System ◽  
Support Systems ◽  
Knowledge Based ◽  
Computer Based ◽  
Support Decision Making ◽  
Made In

The reception of journalists at the Waspada Daily Medan always went through several rigorous selections before being determined to be accepted as journalists at the Waspada Medan Daily. There are several criteria that must be possessed by each participant as a condition for becoming a journalist in the Daily Alert Medan. To get the best participants, the Waspada Medan Daily needed a decision support system. Decision Support Systems (SPK) are part of computer-based information systems (including knowledge-based systems (knowledge management)) that are used to support decision making within an organization or company. Decision support systems provide a semitructured decision, where no one knows exactly how the decision should be made. In this study the authors applied the VlseKriterijumska Optimizacija I Kompromisno Resenje (VIKOR) as the method to be applied in the decision support system application. The VIKOR method is part of the Multi-Attibut Decision Making (MADM) Concept, which requires normalization in its calculations. The expected results in this study can obtain maximum decisions.Keywords: Journalist Acceptance, Decision Support System, VIKOR

Applying Deep Learning to Audit Procedures: An Illustrative Framework

2019 ◽  
Vol 33 (3) ◽  
pp. 89-109 ◽  
Author(s):  
Ting (Sophia) Sun
Keyword(s):  
Decision Making ◽  
Deep Learning ◽  
Data Warehouse ◽  
Visual Recognition ◽  
Prediction Models ◽  
Historical Data ◽  
Structured Data ◽  
Text Understanding ◽  
Audit Data ◽  
Learning Functions

SYNOPSIS This paper aims to promote the application of deep learning to audit procedures by illustrating how the capabilities of deep learning for text understanding, speech recognition, visual recognition, and structured data analysis fit into the audit environment. Based on these four capabilities, deep learning serves two major functions in supporting audit decision making: information identification and judgment support. The paper proposes a framework for applying these two deep learning functions to a variety of audit procedures in different audit phases. An audit data warehouse of historical data can be used to construct prediction models, providing suggested actions for various audit procedures. The data warehouse will be updated and enriched with new data instances through the application of deep learning and a human auditor's corrections. Finally, the paper discusses the challenges faced by the accounting profession, regulators, and educators when it comes to applying deep learning.

scholarly journals Explaining deep neural networks for knowledge discovery in electrocardiogram analysis

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Steven A. Hicks ◽  
Jonas L. Isaksen ◽  
Vajira Thambawita ◽  
Jonas Ghouse ◽  
Gustav Ahlberg ◽  
...  
Keyword(s):  
Decision Making ◽  
Deep Learning ◽  
Deep Neural Networks ◽  
Clinical Decision Making ◽  
Medical Knowledge ◽  
Clinical Decision ◽  
Medical Data ◽  
Medical Doctors ◽  
Medical Tests ◽  
Deep Learning Model

AbstractDeep learning-based tools may annotate and interpret medical data more quickly, consistently, and accurately than medical doctors. However, as medical doctors are ultimately responsible for clinical decision-making, any deep learning-based prediction should be accompanied by an explanation that a human can understand. We present an approach called electrocardiogram gradient class activation map (ECGradCAM), which is used to generate attention maps and explain the reasoning behind deep learning-based decision-making in ECG analysis. Attention maps may be used in the clinic to aid diagnosis, discover new medical knowledge, and identify novel features and characteristics of medical tests. In this paper, we showcase how ECGradCAM attention maps can unmask how a novel deep learning model measures both amplitudes and intervals in 12-lead electrocardiograms, and we show an example of how attention maps may be used to develop novel ECG features.

Artificial Intelligence and Human Rights: Four Realms of Discussion: Summary of Remarks

2020 ◽  
Vol 114 ◽  
pp. 242-245
Author(s):  
Jootaek Lee
Keyword(s):  
Artificial Intelligence ◽  
Machine Learning ◽  
Decision Making ◽  
Deep Learning ◽  
Language Processing ◽  
Human Reasoning ◽  
The Past ◽  
Making Choices ◽  
Data Capturing ◽  
Intensive Procedures

The term, Artificial Intelligence (AI), has changed since it was first coined by John MacCarthy in 1956. AI, believed to have been created with Kurt Gödel's unprovable computational statements in 1931, is now called deep learning or machine learning. AI is defined as a computer machine with the ability to make predictions about the future and solve complex tasks, using algorithms. The AI algorithms are enhanced and become effective with big data capturing the present and the past while still necessarily reflecting human biases into models and equations. AI is also capable of making choices like humans, mirroring human reasoning. AI can help robots to efficiently repeat the same labor intensive procedures in factories and can analyze historic and present data efficiently through deep learning, natural language processing, and anomaly detection. Thus, AI covers a spectrum of augmented intelligence relating to prediction, autonomous intelligence relating to decision making, automated intelligence for labor robots, and assisted intelligence for data analysis.

scholarly journals Deep Learning-Based Differentiation between Mucinous Cystic Neoplasm and Serous Cystic Neoplasm in the Pancreas Using Endoscopic Ultrasonography

Diagnostics ◽  
2021 ◽  
Vol 11 (6) ◽  
pp. 1052
Author(s):  
Leang Sim Nguon ◽  
Kangwon Seo ◽  
Jung-Hyun Lim ◽  
Tae-Jun Song ◽  
Sung-Hyun Cho ◽  
...  
Keyword(s):  
Decision Making ◽  
Deep Learning ◽  
Network Model ◽  
Endoscopic Ultrasonography ◽  
Data Augmentation ◽  
Clinical Information ◽  
Training Data ◽  
Fine Tuning ◽  
Cystic Neoplasm ◽  
Cystic Neoplasms

Mucinous cystic neoplasms (MCN) and serous cystic neoplasms (SCN) account for a large portion of solitary pancreatic cystic neoplasms (PCN). In this study we implemented a convolutional neural network (CNN) model using ResNet50 to differentiate between MCN and SCN. The training data were collected retrospectively from 59 MCN and 49 SCN patients from two different hospitals. Data augmentation was used to enhance the size and quality of training datasets. Fine-tuning training approaches were utilized by adopting the pre-trained model from transfer learning while training selected layers. Testing of the network was conducted by varying the endoscopic ultrasonography (EUS) image sizes and positions to evaluate the network performance for differentiation. The proposed network model achieved up to 82.75% accuracy and a 0.88 (95% CI: 0.817–0.930) area under curve (AUC) score. The performance of the implemented deep learning networks in decision-making using only EUS images is comparable to that of traditional manual decision-making using EUS images along with supporting clinical information. Gradient-weighted class activation mapping (Grad-CAM) confirmed that the network model learned the features from the cyst region accurately. This study proves the feasibility of diagnosing MCN and SCN using a deep learning network model. Further improvement using more datasets is needed.

Sign in / Sign up

Export Citation Format

Share Document