scholarly journals Focused learning promotes continual task performance in humans

2018 ◽  
Author(s):  
Timo Flesch ◽  
Jan Balaguer ◽  
Ronald Dekker ◽  
Hamed Nili ◽  
Christopher Summerfield
Keyword(s):  
Machine Learning ◽  
Task Performance ◽  
State Of The Art ◽  
Mutual Interference ◽  
Task Space ◽  
Cognitive Mechanisms ◽  
Analysis Of Error ◽  
Task Representations ◽  
The Brain ◽  
Continual Learning

AbstractHumans can learn to perform multiple tasks in succession over the lifespan (“continual” learning), whereas current machine learning systems fail. Here, we investigated the cognitive mechanisms that permit successful continual learning in humans. Unlike neural networks, humans that were trained on temporally autocorrelated task objectives (focussed training) learned to perform new tasks more effectively, and performed better on a later test involving randomly interleaved tasks. Analysis of error patterns suggested that focussed learning permitted the formation of factorised task representations that were protected from mutual interference. Furthermore, individuals with a strong prior tendency to represent the task space in a factorised manner enjoyed greater benefit of focussed over interleaved training. Building artificial agents that learn to factorise tasks appropriately may be a promising route to solving continual task performance in machine learning.Significance StatementHumans learn to perform many different tasks over the lifespan, such as speaking both French and Spanish. The brain has to represent task information without mutual interference. In machine learning, this "continual learning" is a major unsolved challenge. Here, we studied the patterns of errors made by humans and state-of-the-art deep networks whilst they learned new tasks from scratch and without instruction. Humans, but not machines, seem to benefit from training regimes that focussed on one task at a time, especially when they had a prior bias to represent stimuli in a way that facilitated task separation. Machines trained to exhibit the same prior bias suffered less interference between tasks, suggesting new avenues for solving continual learning in artificial systems.

scholarly journals Sequential replay of nonspatial task states in the human hippocampus

Science ◽  
2019 ◽  
Vol 364 (6447) ◽  
pp. eaaw5181 ◽  
Author(s):  
Nicolas W. Schuck ◽  
Yael Niv
Keyword(s):  
Decision Making ◽  
Task Performance ◽  
Orbitofrontal Cortex ◽  
Activity Patterns ◽  
Functional Magnetic Resonance ◽  
Resonance Imaging ◽  
Sequential Structure ◽  
Human Hippocampus ◽  
Task Representations ◽  
The Brain

Sequential neural activity patterns related to spatial experiences are “replayed” in the hippocampus of rodents during rest. We investigated whether replay of nonspatial sequences can be detected noninvasively in the human hippocampus. Participants underwent functional magnetic resonance imaging (fMRI) while resting after performing a decision-making task with sequential structure. Hippocampal fMRI patterns recorded at rest reflected sequentiality of previously experienced task states, with consecutive patterns corresponding to nearby states. Hippocampal sequentiality correlated with the fidelity of task representations recorded in the orbitofrontal cortex during decision-making, which were themselves related to better task performance. Our findings suggest that hippocampal replay may be important for building representations of complex, abstract tasks elsewhere in the brain and establish feasibility of investigating fast replay signals with fMRI.

scholarly journals Localization and Classification of Brain Tumor using Machine Learning & Deep Learning Techniques

2019 ◽  
Vol 8 (9S) ◽  
pp. 59-66
Keyword(s):  
Machine Learning ◽  
Deep Learning ◽  
Brain Tumor ◽  
State Of The Art ◽  
Body Part ◽  
X Rays ◽  
Meaningful Information ◽  
Learning Techniques ◽  
The Brain

Digital image processing is a rising field for the investigation of complicated diseases such as brain tumor, breast cancer, kidney stones, lung cancer, ovarian cancer, and cervix cancer and so on. The recognition of the brain tumor is considered to be a very critical task. A number of approaches are used for the scanning of a particular body part like CT scan, X-rays, and Magnetic Resonance Image (MRI). These pictures are then examined by the surgeons for the removal of the problem. The main objective of examining these MRI images (mainly) is to extract the meaningful information with high accuracy. Machine Learning and Deep Learning algorithms are mainly used for analysing the medical images which can identify, localize and classify the brain tumor into sub categories, according to which the diagnosis would be done by the professionals. In this paper, we have discussed the different techniques that are used for tumor pre-processing, segmentation, localization, extraction of features and classification and summarize more than 30 contributions to this field. Also, we discussed the existing state-of-the-art, literature gaps, open challenges and future scope in this area.

Data science in economics: comprehensive review of advanced machine learning and deep learning methods

2020 ◽  
Author(s):  
Saeed Nosratabadi ◽  
Amir Mosavi ◽  
Puhong Duan ◽  
Pedram Ghamisi ◽  
Ferdinand Filip ◽  
...  
Keyword(s):  
Machine Learning ◽  
Deep Learning ◽  
Data Science ◽  
State Of The Art ◽  
Science Methods ◽  
Learning Models ◽  
Diverse Range ◽  
Hybrid Machine ◽  
Economics Research

This paper provides a state-of-the-art investigation of advances in data science in emerging economic applications. The analysis was performed on novel data science methods in four individual classes of deep learning models, hybrid deep learning models, hybrid machine learning, and ensemble models. Application domains include a wide and diverse range of economics research from the stock market, marketing, and e-commerce to corporate banking and cryptocurrency. Prisma method, a systematic literature review methodology, was used to ensure the quality of the survey. The findings reveal that the trends follow the advancement of hybrid models, which, based on the accuracy metric, outperform other learning algorithms. It is further expected that the trends will converge toward the advancements of sophisticated hybrid deep learning models.

Deep Learning for text in limted data settings

2020 ◽  
Author(s):  
Pathikkumar Patel ◽  
Bhargav Lad ◽  
Jinan Fiaidhi
Keyword(s):  
Machine Learning ◽  
Time Series ◽  
Deep Learning ◽  
Sentiment Analysis ◽  
Transfer Learning ◽  
Text Classification ◽  
State Of The Art ◽  
Time Series Forecasting ◽  
Text Data ◽  
Performance Levels

During the last few years, RNN models have been extensively used and they have proven to be better for sequence and text data. RNNs have achieved state-of-the-art performance levels in several applications such as text classification, sequence to sequence modelling and time series forecasting. In this article we will review different Machine Learning and Deep Learning based approaches for text data and look at the results obtained from these methods. This work also explores the use of transfer learning in NLP and how it affects the performance of models on a specific application of sentiment analysis.

A Review of Various Machine Learning Techniques for Brain Tumor Detection from MRI Images

2020 ◽  
Vol 16 (8) ◽  
pp. 937-945
Author(s):  
Aaishwarya Sanjay Bajaj ◽  
Usha Chouhan
Keyword(s):  
Machine Learning ◽  
Brain Tumor ◽  
Ct Scan ◽  
Imaging Techniques ◽  
Critical Evaluation ◽  
Tumor Detection ◽  
Machine Learning Techniques ◽  
X Rays ◽  
Detection Techniques ◽  
The Brain

Background: This paper endeavors to identify an expedient approach for the detection of the brain tumor in MRI images. The detection of tumor is based on i) review of the machine learning approach for the identification of brain tumor and ii) review of a suitable approach for brain tumor detection. Discussion: This review focuses on different imaging techniques such as X-rays, PET, CT- Scan, and MRI. This survey identifies a different approach with better accuracy for tumor detection. This further includes the image processing method. In most applications, machine learning shows better performance than manual segmentation of the brain tumors from MRI images as it is a difficult and time-consuming task. For fast and better computational results, radiology used a different approach with MRI, CT-scan, X-ray, and PET. Furthermore, summarizing the literature, this paper also provides a critical evaluation of the surveyed literature which reveals new facets of research. Conclusion: The problem faced by the researchers during brain tumor detection techniques and machine learning applications for clinical settings have also been discussed.

scholarly journals Multi-hop assortativities for network classification

2018 ◽  
Vol 7 (4) ◽  
pp. 603-622 ◽  
Author(s):  
Leonardo Gutiérrez-Gómez ◽  
Jean-Charles Delvenne
Keyword(s):  
Machine Learning ◽  
Scientific Collaboration ◽  
State Of The Art ◽  
Medical Engineering ◽  
Research Field ◽  
Classification Task ◽  
Collaboration Network ◽  
Structural Patterns ◽  
Art Methods

Abstract Several social, medical, engineering and biological challenges rely on discovering the functionality of networks from their structure and node metadata, when it is available. For example, in chemoinformatics one might want to detect whether a molecule is toxic based on structure and atomic types, or discover the research field of a scientific collaboration network. Existing techniques rely on counting or measuring structural patterns that are known to show large variations from network to network, such as the number of triangles, or the assortativity of node metadata. We introduce the concept of multi-hop assortativity, that captures the similarity of the nodes situated at the extremities of a randomly selected path of a given length. We show that multi-hop assortativity unifies various existing concepts and offers a versatile family of ‘fingerprints’ to characterize networks. These fingerprints allow in turn to recover the functionalities of a network, with the help of the machine learning toolbox. Our method is evaluated empirically on established social and chemoinformatic network benchmarks. Results reveal that our assortativity based features are competitive providing highly accurate results often outperforming state of the art methods for the network classification task.

scholarly journals Advances in the Application of Machine Learning Techniques for Power System Analytics: A Survey

Energies ◽  
2021 ◽  
Vol 14 (16) ◽  
pp. 4776
Author(s):  
Seyed Mahdi Miraftabzadeh ◽  
Michela Longo ◽  
Federica Foiadelli ◽  
Marco Pasetti ◽  
Raul Igual
Keyword(s):  
Machine Learning ◽  
Power Systems ◽  
Smart Grids ◽  
State Of The Art ◽  
Smart Cities ◽  
Power Grids ◽  
Machine Learning Techniques ◽  
Learning Techniques ◽  
New Research ◽  
Traditional Approaches

The recent advances in computing technologies and the increasing availability of large amounts of data in smart grids and smart cities are generating new research opportunities in the application of Machine Learning (ML) for improving the observability and efficiency of modern power grids. However, as the number and diversity of ML techniques increase, questions arise about their performance and applicability, and on the most suitable ML method depending on the specific application. Trying to answer these questions, this manuscript presents a systematic review of the state-of-the-art studies implementing ML techniques in the context of power systems, with a specific focus on the analysis of power flows, power quality, photovoltaic systems, intelligent transportation, and load forecasting. The survey investigates, for each of the selected topics, the most recent and promising ML techniques proposed by the literature, by highlighting their main characteristics and relevant results. The review revealed that, when compared to traditional approaches, ML algorithms can handle massive quantities of data with high dimensionality, by allowing the identification of hidden characteristics of (even) complex systems. In particular, even though very different techniques can be used for each application, hybrid models generally show better performances when compared to single ML-based models.

Simulation of sports movement training based on machine learning and brain-computer interface

2020 ◽  
pp. 1-12
Author(s):  
Linuo Wang
Keyword(s):  
Machine Learning ◽  
Time Series ◽  
Joint Learning ◽  
Scientific Methods ◽  
Learning Framework ◽  
Brain Functions ◽  
Movement Training ◽  
Practical Effect ◽  
Machine Interface ◽  
The Brain

Injuries and hidden dangers in training have a greater impact on athletes ’careers. In particular, the brain function that controls the motor function area has a greater impact on the athlete ’s competitive ability. Based on this, it is necessary to adopt scientific methods to recognize brain functions. In this paper, we study the structure of motor brain-computer and improve it based on traditional methods. Moreover, supported by machine learning and SVM technology, this study uses a DSP filter to convert the preprocessed EEG signal X into a time series, and adjusts the distance between the time series to classify the data. In order to solve the inconsistency of DSP algorithms, a multi-layer joint learning framework based on logistic regression model is proposed, and a brain-machine interface system of sports based on machine learning and SVM is constructed. In addition, this study designed a control experiment to improve the performance of the method proposed by this study. The research results show that the method in this paper has a certain practical effect and can be applied to sports.

scholarly journals Accelerating organic solar cell material's discovery: high-throughput screening and big data

2021 ◽  
Author(s):  
Xabier Rodríguez-Martínez ◽  
Enrique Pascual-San-José ◽  
Mariano Campoy-Quiles
Keyword(s):  
Machine Learning ◽  
Big Data ◽  
High Throughput ◽  
Organic Solar Cells ◽  
High Throughput Screening ◽  
Organic Solar Cell ◽  
State Of The Art ◽  
Review Article ◽  
Machine Learning Algorithms ◽  
Device Optimization

This review article presents the state-of-the-art in high-throughput computational and experimental screening routines with application in organic solar cells, including materials discovery, device optimization and machine-learning algorithms.

Sign in / Sign up

Export Citation Format

Share Document