scholarly journals Accelerating Innovation Through Analogy Mining

2018 ◽  
Author(s):  
Tom Hope ◽  
Joel Chan ◽  
Aniket Kittur ◽  
Dafna Shahaf
Keyword(s):  
Machine Learning ◽  
Neural Networks ◽  
Real World ◽  
Recurrent Neural Networks ◽  
Structural Similarity ◽  
Similarity Metrics ◽  
Traditional Methods ◽  
Vector Representations ◽  
Value Of Learning

The availability of large idea repositories (e.g., patents) could significantly accelerate innovation and discovery by providing people inspiration from solutions to analogous problems. However, finding useful analogies in these large, messy, real-world repositories remains a persistent challenge for both humans and computers. Previous approaches include costly hand-created databases that do not scale, or machine-learning similarity metrics that struggle to account for structural similarity, which is central to analogy. In this paper we explore the viability and value of learning simple structural representations. Our approach combines crowdsourcing and recurrent neural networks to extract purpose and mechanism vector representations from product descriptions. We demonstrate that these learned vectors allow us to find analogies with higher precision and recall than traditional methods. In an ideation experiment, analogies retrieved by our models significantly increased people's likelihood of generating creative ideas.

Machine Learning-Based Malware Detection using Recurrent Neural Networks

2019 ◽  
Author(s):  
Miguel Oyler-Castrillo ◽  
Nicolas Bohm Agostini ◽  
Gadiel Sznaier ◽  
David Kaeli
Keyword(s):  
Machine Learning ◽  
Neural Networks ◽  
Recurrent Neural Networks ◽  
Malware Detection

Deep Learning and Biomedical Engineering

Biotechnology ◽  
2019 ◽  
pp. 562-575
Author(s):  
Suraj Sawant
Keyword(s):  
Machine Learning ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Deep Learning ◽  
Real World ◽  
Biomedical Engineering ◽  
Input Data ◽  
Reference Source ◽  
Data Input ◽  
Essential Information

Deep learning (DL) is a method of machine learning, as running over artificial neural networks, which has a structure above the standards to deal with large amounts of data. That is generally because of the increasing amount of data, input data sizes, and of course, greater complexity of objective real-world problems. Performed research studies in the associated literature show that the DL currently has a good performance among considered problems and it seems to be a strong solution for more advanced problems of the future. In this context, this chapter aims to provide some essential information about DL and its applications within the field of biomedical engineering. The chapter is organized as a reference source for enabling readers to have an idea about the relation between DL and biomedical engineering.

Chapter 15. Human-Centered Concept Explanations for Neural Networks

2021 ◽  
Author(s):  
Chih-Kuan Yeh ◽  
Been Kim ◽  
Pradeep Ravikumar
Keyword(s):  
Machine Learning ◽  
Neural Networks ◽  
Case Studies ◽  
Real World ◽  
Deep Neural Networks ◽  
Learning Models ◽  
Real World Applications ◽  
The Right ◽  
Concept Activation ◽  
Machine Learning Models

Understanding complex machine learning models such as deep neural networks with explanations is crucial in various applications. Many explanations stem from the model perspective, and may not necessarily effectively communicate why the model is making its predictions at the right level of abstraction. For example, providing importance weights to individual pixels in an image can only express which parts of that particular image is important to the model, but humans may prefer an explanation which explains the prediction by concept-based thinking. In this work, we review the emerging area of concept based explanations. We start by introducing concept explanations including the class of Concept Activation Vectors (CAV) which characterize concepts using vectors in appropriate spaces of neural activations, and discuss different properties of useful concepts, and approaches to measure the usefulness of concept vectors. We then discuss approaches to automatically extract concepts, and approaches to address some of their caveats. Finally, we discuss some case studies that showcase the utility of such concept-based explanations in synthetic settings and real world applications.

Rule Generation Methods Based on Logic Synthesis

2011 ◽  
pp. 978-983
Author(s):  
Marco Muselli
Keyword(s):  
Artificial Intelligence ◽  
Machine Learning ◽  
Neural Networks ◽  
Real World ◽  
Inductive Reasoning ◽  
Logic Synthesis ◽  
Rule Generation ◽  
Research Areas ◽  
Real World Problem

One of the most relevant problems in artificial intelligence is allowing a synthetic device to perform inductive reasoning, i.e. to infer a set of rules consistent with a collection of data pertaining to a given real world problem. A variety of approaches, arising in different research areas such as statistics, machine learning, neural networks, etc., have been proposed during the last 50 years to deal with the problem of realizing inductive reasoning.

scholarly journals Transfer Learning and Deep Domain Adaptation

2020 ◽  
Author(s):  
Wen Xu ◽  
Jing He ◽  
Yanfeng Shu
Keyword(s):  
Machine Learning ◽  
Neural Networks ◽  
Transfer Learning ◽  
Real World ◽  
Deep Neural Networks ◽  
Domain Adaptation ◽  
Fine Tuning ◽  
Real World Applications ◽  
Comprehensive Survey ◽  
Sample Reconstruction

Transfer learning is an emerging technique in machine learning, by which we can solve a new task with the knowledge obtained from an old task in order to address the lack of labeled data. In particular deep domain adaptation (a branch of transfer learning) gets the most attention in recently published articles. The intuition behind this is that deep neural networks usually have a large capacity to learn representation from one dataset and part of the information can be further used for a new task. In this research, we firstly present the complete scenarios of transfer learning according to the domains and tasks. Secondly, we conduct a comprehensive survey related to deep domain adaptation and categorize the recent advances into three types based on implementing approaches: fine-tuning networks, adversarial domain adaptation, and sample-reconstruction approaches. Thirdly, we discuss the details of these methods and introduce some typical real-world applications. Finally, we conclude our work and explore some potential issues to be further addressed.

scholarly journals Attribution of genetic engineering: A practical and accurate machine-learning toolkit for biosecurity

2020 ◽  
Author(s):  
Ethan C. Alley ◽  
Miles Turpin ◽  
Andrew Bo Liu ◽  
Taylor Kulp-McDowall ◽  
Jacob Swett ◽  
...  
Keyword(s):  
Machine Learning ◽  
Neural Networks ◽  
Genetic Engineering ◽  
Recurrent Neural Networks ◽  
International Security ◽  
Responsible Innovation ◽  
Nation State ◽  
Dna Motifs ◽  
Simple Models

AbstractThe promise of biotechnology is tempered by its potential for accidental or deliberate misuse. Reliably identifying telltale signatures characteristic to different genetic designers, termed genetic engineering attribution, would deter misuse, yet is still considered unsolved. Here, we show that recurrent neural networks trained on DNA motifs and basic phenotype can reach 70% attribution accuracy distinguishing between over 1,300 labs. To make these models usable in practice, we introduce a framework for weighing predictions against other investigative evidence using calibration, and bring our model to within 1.6% of perfect calibration. Additionally, we demonstrate that simple models can accurately predict both the nation-state-of-origin and ancestor labs, forming the foundation of an integrated attribution toolkit which should promote responsible innovation and international security alike.

scholarly journals Train Delay Prediction using Machine Learning

2019 ◽  
Vol 9 (2) ◽  
pp. 1312-1315
Keyword(s):  
Machine Learning ◽  
Neural Networks ◽  
Recurrent Neural Networks ◽  
Weather Conditions ◽  
Severe Weather ◽  
Average Error ◽  
Machine Learning Method ◽  
Long Distance ◽  
Passenger Trains ◽  
Delay Prediction

Indian Railways operates both long distance and suburban passenger trains and freight services daily in the country. Trains get delayed frequently due to several reasons such as, severe weather conditions such as fog, traffic, signal failure, derailing of trains, accidents, etc, and this delay is propagated from station to station. If we can predict this in advance - it would be of great help for the commuters to plan their journey either for an earlier departure or postpone, and also lets railways to take measures to avoid delays further. In this paper, we used decision tree, a machine learning method used for predicting train delays, and Recurrent Neural Networks distinguished with various fixtures. For predicting train delays, Recurrent Neural networks with 2 layers and 22 neurons per each layer gave best results with an average error of 122 seconds

scholarly journals Predictive Monitoring with Logic-Calibrated Uncertainty for Cyber-Physical Systems

2021 ◽  
Vol 20 (5s) ◽  
pp. 1-25
Author(s):  
Meiyi Ma ◽  
John Stankovic ◽  
Ezio Bartocci ◽  
Lu Feng
Keyword(s):  
Neural Networks ◽  
Real World ◽  
Recurrent Neural Networks ◽  
Cyber Physical Systems ◽  
Uncertainty Estimation ◽  
Physical Systems ◽  
Confidence Levels ◽  
Novel Approach ◽  
Infinite Set

Predictive monitoring—making predictions about future states and monitoring if the predicted states satisfy requirements—offers a promising paradigm in supporting the decision making of Cyber-Physical Systems (CPS). Existing works of predictive monitoring mostly focus on monitoring individual predictions rather than sequential predictions. We develop a novel approach for monitoring sequential predictions generated from Bayesian Recurrent Neural Networks (RNNs) that can capture the inherent uncertainty in CPS, drawing on insights from our study of real-world CPS datasets. We propose a new logic named Signal Temporal Logic with Uncertainty (STL-U) to monitor a flowpipe containing an infinite set of uncertain sequences predicted by Bayesian RNNs. We define STL-U strong and weak satisfaction semantics based on whether all or some sequences contained in a flowpipe satisfy the requirement. We also develop methods to compute the range of confidence levels under which a flowpipe is guaranteed to strongly (weakly) satisfy an STL-U formula. Furthermore, we develop novel criteria that leverage STL-U monitoring results to calibrate the uncertainty estimation in Bayesian RNNs. Finally, we evaluate the proposed approach via experiments with real-world CPS datasets and a simulated smart city case study, which show very encouraging results of STL-U based predictive monitoring approach outperforming baselines.

Sign in / Sign up

Export Citation Format

Share Document