scholarly journals On the Potential for Open-Endedness in Neural Networks

2019 ◽  
Vol 25 (2) ◽  
pp. 145-167 ◽  
Author(s):  
Nicholas Guttenberg ◽  
Nathaniel Virgo ◽  
Alexandra Penn
Keyword(s):  
Artificial Intelligence ◽  
Machine Learning ◽  
Neural Networks ◽  
Gradient Descent ◽  
The Other ◽  
Learning Approach ◽  
Natural Evolution ◽  
Machine Learning Methods ◽  
Machine Learning Approach ◽  
Common Barriers

Natural evolution gives the impression of leading to an open-ended process of increasing diversity and complexity. If our goal is to produce such open-endedness artificially, this suggests an approach driven by evolutionary metaphor. On the other hand, techniques from machine learning and artificial intelligence are often considered too narrow to provide the sort of exploratory dynamics associated with evolution. In this article, we hope to bridge that gap by reviewing common barriers to open-endedness in the evolution-inspired approach and how they are dealt with in the evolutionary case—collapse of diversity, saturation of complexity, and failure to form new kinds of individuality. We then show how these problems map onto similar ones in the machine learning approach, and discuss how the same insights and solutions that alleviated those barriers in evolutionary approaches can be ported over. At the same time, the form these issues take in the machine learning formulation suggests new ways to analyze and resolve barriers to open-endedness. Ultimately, we hope to inspire researchers to be able to interchangeably use evolutionary and gradient-descent-based machine learning methods to approach the design and creation of open-ended systems.

scholarly journals Discretization and machine learning approximation of BSDEs with a constraint on the Gains-process

2021 ◽  
Vol 0 (0) ◽  
Author(s):  
Idris Kharroubi ◽  
Thomas Lim ◽  
Xavier Warin
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Neural Networks ◽  
Differential Equations ◽  
Numerical Experiments ◽  
Optimization Problem ◽  
Learning Approach ◽  
The Neural Network ◽  
Machine Learning Approach ◽  
Mesh Grid

AbstractWe study the approximation of backward stochastic differential equations (BSDEs for short) with a constraint on the gains process. We first discretize the constraint by applying a so-called facelift operator at times of a grid. We show that this discretely constrained BSDE converges to the continuously constrained one as the mesh grid converges to zero. We then focus on the approximation of the discretely constrained BSDE. For that we adopt a machine learning approach. We show that the facelift can be approximated by an optimization problem over a class of neural networks under constraints on the neural network and its derivative. We then derive an algorithm converging to the discretely constrained BSDE as the number of neurons goes to infinity. We end by numerical experiments.

scholarly journals Development of Type 2 Diabetes Mellitus Phenotyping Framework Using Expert Knowledge and Machine Learning Approach

2016 ◽  
Vol 11 (4) ◽  
pp. 791-799 ◽  
Author(s):  
Rina Kagawa ◽  
Yoshimasa Kawazoe ◽  
Yusuke Ida ◽  
Emiko Shinohara ◽  
Katsuya Tanaka ◽  
...  
Keyword(s):  
Diabetes Mellitus ◽  
Machine Learning ◽  
Type 2 Diabetes ◽  
Type 2 Diabetes Mellitus ◽  
Expert Knowledge ◽  
The Other ◽  
Learning Approach ◽  
Research Subjects ◽  
Machine Learning Approach

Background: Phenotyping is an automated technique that can be used to distinguish patients based on electronic health records. To improve the quality of medical care and advance type 2 diabetes mellitus (T2DM) research, the demand for T2DM phenotyping has been increasing. Some existing phenotyping algorithms are not sufficiently accurate for screening or identifying clinical research subjects. Objective: We propose a practical phenotyping framework using both expert knowledge and a machine learning approach to develop 2 phenotyping algorithms: one is for screening; the other is for identifying research subjects. Methods: We employ expert knowledge as rules to exclude obvious control patients and machine learning to increase accuracy for complicated patients. We developed phenotyping algorithms on the basis of our framework and performed binary classification to determine whether a patient has T2DM. To facilitate development of practical phenotyping algorithms, this study introduces new evaluation metrics: area under the precision-sensitivity curve (AUPS) with a high sensitivity and AUPS with a high positive predictive value. Results: The proposed phenotyping algorithms based on our framework show higher performance than baseline algorithms. Our proposed framework can be used to develop 2 types of phenotyping algorithms depending on the tuning approach: one for screening, the other for identifying research subjects. Conclusions: We develop a novel phenotyping framework that can be easily implemented on the basis of proper evaluation metrics, which are in accordance with users’ objectives. The phenotyping algorithms based on our framework are useful for extraction of T2DM patients in retrospective studies.

scholarly journals Clustering suicides: A data-driven, exploratory machine learning approach

2019 ◽  
Vol 62 ◽  
pp. 15-19 ◽  
Author(s):  
Birgit Ludwig ◽  
Daniel König ◽  
Nestor D. Kapusta ◽  
Victor Blüml ◽  
Georg Dorffner ◽  
...  
Keyword(s):  
Machine Learning ◽  
Cluster Analysis ◽  
Analysis Data ◽  
The Other ◽  
Data Driven ◽  
Learning Approach ◽  
Suicide Methods ◽  
Machine Learning Approach ◽  
The One ◽  
Methods Of Suicide

Abstract Methods of suicide have received considerable attention in suicide research. The common approach to differentiate methods of suicide is the classification into “violent” versus “non-violent” method. Interestingly, since the proposition of this dichotomous differentiation, no further efforts have been made to question the validity of such a classification of suicides. This study aimed to challenge the traditional separation into “violent” and “non-violent” suicides by generating a cluster analysis with a data-driven, machine learning approach. In a retrospective analysis, data on all officially confirmed suicides (N = 77,894) in Austria between 1970 and 2016 were assessed. Based on a defined distance metric between distributions of suicides over age group and month of the year, a standard hierarchical clustering method was performed with the five most frequent suicide methods. In cluster analysis, poisoning emerged as distinct from all other methods – both in the entire sample as well as in the male subsample. Violent suicides could be further divided into sub-clusters: hanging, shooting, and drowning on the one hand and jumping on the other hand. In the female sample, two different clusters were revealed – hanging and drowning on the one hand and jumping, poisoning, and shooting on the other. Our data-driven results in this large epidemiological study confirmed the traditional dichotomization of suicide methods into “violent” and “non-violent” methods, but on closer inspection “violent methods” can be further divided into sub-clusters and a different cluster pattern could be identified for women, requiring further research to support these refined suicide phenotypes.

scholarly journals To switch or not to switch – a machine learning approach for ferroelectricity

2020 ◽  
Vol 2 (5) ◽  
pp. 2063-2072 ◽  
Author(s):  
Sabine M. Neumayer ◽  
Stephen Jesse ◽  
Gabriel Velarde ◽  
Andrei L. Kholkin ◽  
Ivan Kravchenko ◽  
...  
Keyword(s):  
Machine Learning ◽  
Measured Signal ◽  
Learning Approach ◽  
Two Dimensional ◽  
Dimensional Representation ◽  
Machine Learning Methods ◽  
Machine Learning Approach ◽  
Signal Dependence ◽  
Two Parameter

The introduced two-dimensional representation of two-parameter signal dependence allows for clear interpretation and classification of the measured signal upon using machine learning methods.

Sign in / Sign up

Export Citation Format

Share Document