scholarly journals The hybrid nature of task-evoked activity: Inside-out neural dynamics in intracranial EEG and Deep Learning

2020 ◽  
Author(s):  
Annemarie Wolff ◽  
Liang Chen ◽  
Shankar Tumati ◽  
Mehrshad Golesorkhi ◽  
Javier Gomez-Pilar ◽  
...  
Keyword(s):  
Deep Learning ◽  
Reaction Times ◽  
Relative Effect ◽  
External Stimulus ◽  
Single Trial ◽  
Hybrid Nature ◽  
Evoked Activity ◽  
The Impact ◽  
Inside Out ◽  
Conceptual Advance

A.AbstractThe standard approach in neuroscience research infers from the external stimulus (outside) to the brain (inside) through stimulus-evoked activity. Recently challenged by Buzsáki, he advocates the reverse; an inside-out approach inferring from the brain’s activity to the neural effects of the stimulus. If so, stimulus-evoked activity should be a hybrid of internal and external components. Providing direct evidence for this hybrid nature, we measured human intracranial stereo-electroencephalography (sEEG) to investigate how prestimulus variability, i.e., standard deviation, shapes poststimulus activity through trial-to-trial variability. We first observed greater poststimulus variability quenching in trials exhibiting high prestimulus variability. Next, we found that the relative effect of the stimulus was higher in the later (300-600ms) than the earlier (0-300ms) poststimulus period. These results were extended by our Deep Learning LSTM network models at the single trial level. The accuracy to classify single trials (prestimulus low/high) increased greatly when the models were trained and tested with real trials compared to trials that exclude the effects of the prestimulus-related ongoing dynamics (corrected trials). Lastly, we replicated our findings showing that trials with high prestimulus variability in theta and alpha bands exhibits faster reaction times. Together, our results support the inside-out approach by demonstrating that stimulus-related activity is a hybrid of two factors: 1) the effects of the external stimulus itself, and 2) the effects of the ongoing dynamics spilling over from the prestimulus period, with the second, i.e., the inside, dwarfing the influence of the first, i.e., the outside.B.Significance StatementOur findings signify a significant conceptual advance in the relationship between pre- and poststimulus dynamics in humans. These findings are important as they show that we miss an essential component - the impact of the ongoing dynamics - when restricting our analyses to the effects of the external stimulus alone. Consequently, these findings may be crucial to fully understand higher cognitive functions and their impairments, as can be seen in psychiatric illnesses. In addition, our Deep Learning LSTM models show a second conceptual advance: high classification accuracy of a single trial to its prestimulus state. Finally, our replicated results in an independent dataset and task showed that this relationship between pre- and poststimulus dynamics exists across tasks and is behaviorally relevant.

scholarly journals The impact of deep learning on document classification using semantically rich representations

2019 ◽  
Vol 56 (5) ◽  
pp. 1618-1632 ◽  
Author(s):  
Zenun Kastrati ◽  
Ali Shariq Imran ◽  
Sule Yildirim Yayilgan
Keyword(s):  
Deep Learning ◽  
Document Classification ◽  
The Impact

scholarly journals Investigating the impact of pre-processing techniques and pre-trained word embeddings in detecting Arabic health information on social media

2021 ◽  
Vol 8 (1) ◽  
Author(s):  
Yahya Albalawi ◽  
Jim Buckley ◽  
Nikola S. Nikolov
Keyword(s):  
Social Media ◽  
Deep Learning ◽  
Comprehensive Evaluation ◽  
Classification Problem ◽  
Data Sets ◽  
Word Embeddings ◽  
Data Set ◽  
Lower Accuracy ◽  
Health Related ◽  
The Impact

AbstractThis paper presents a comprehensive evaluation of data pre-processing and word embedding techniques in the context of Arabic document classification in the domain of health-related communication on social media. We evaluate 26 text pre-processings applied to Arabic tweets within the process of training a classifier to identify health-related tweets. For this task we use the (traditional) machine learning classifiers KNN, SVM, Multinomial NB and Logistic Regression. Furthermore, we report experimental results with the deep learning architectures BLSTM and CNN for the same text classification problem. Since word embeddings are more typically used as the input layer in deep networks, in the deep learning experiments we evaluate several state-of-the-art pre-trained word embeddings with the same text pre-processing applied. To achieve these goals, we use two data sets: one for both training and testing, and another for testing the generality of our models only. Our results point to the conclusion that only four out of the 26 pre-processings improve the classification accuracy significantly. For the first data set of Arabic tweets, we found that Mazajak CBOW pre-trained word embeddings as the input to a BLSTM deep network led to the most accurate classifier with F1 score of 89.7%. For the second data set, Mazajak Skip-Gram pre-trained word embeddings as the input to BLSTM led to the most accurate model with F1 score of 75.2% and accuracy of 90.7% compared to F1 score of 90.8% achieved by Mazajak CBOW for the same architecture but with lower accuracy of 70.89%. Our results also show that the performance of the best of the traditional classifier we trained is comparable to the deep learning methods on the first dataset, but significantly worse on the second dataset.

scholarly journals Data augmentation for computed tomography angiography via synthetic image generation and neural domain adaptation

2020 ◽  
Vol 6 (1) ◽  
Author(s):  
Malte Seemann ◽  
Lennart Bargsten ◽  
Alexander Schlaefer
Keyword(s):  
Computed Tomography ◽  
Neural Networks ◽  
Deep Learning ◽  
Medical Imaging ◽  
Computed Tomography Angiography ◽  
Data Augmentation ◽  
Domain Adaptation ◽  
Synthetic Image ◽  
Wide Range ◽  
The Impact

AbstractDeep learning methods produce promising results when applied to a wide range of medical imaging tasks, including segmentation of artery lumen in computed tomography angiography (CTA) data. However, to perform sufficiently, neural networks have to be trained on large amounts of high quality annotated data. In the realm of medical imaging, annotations are not only quite scarce but also often not entirely reliable. To tackle both challenges, we developed a two-step approach for generating realistic synthetic CTA data for the purpose of data augmentation. In the first step moderately realistic images are generated in a purely numerical fashion. In the second step these images are improved by applying neural domain adaptation. We evaluated the impact of synthetic data on lumen segmentation via convolutional neural networks (CNNs) by comparing resulting performances. Improvements of up to 5% in terms of Dice coefficient and 20% for Hausdorff distance represent a proof of concept that the proposed augmentation procedure can be used to enhance deep learning-based segmentation for artery lumen in CTA images.

Are e-learning Webinars the future of medical education? An exploratory study of a disruptive innovation in the COVID-19 era

2020 ◽  
pp. 1-10
Author(s):  
Colin J. McMahon ◽  
Justin T. Tretter ◽  
Theresa Faulkner ◽  
R. Krishna Kumar ◽  
Andrew N. Redington ◽  
...  
Keyword(s):  
Deep Learning ◽  
Carbon Footprint ◽  
Quantitative Research ◽  
Survey Design ◽  
Hybrid Approach ◽  
Disruptive Innovation ◽  
Cross Sectional Survey ◽  
Cross Sectional ◽  
E Learning ◽  
The Impact

Abstract Objective: This study investigated the impact of the Webinar on deep human learning of CHD. Materials and methods: This cross-sectional survey design study used an open and closed-ended questionnaire to assess the impact of the Webinar on deep learning of topical areas within the management of the post-operative tetralogy of Fallot patients. This was a quantitative research methodology using descriptive statistical analyses with a sequential explanatory design. Results: One thousand-three-hundred and seventy-four participants from 100 countries on 6 continents joined the Webinar, 557 (40%) of whom completed the questionnaire. Over 70% of participants reported that they “agreed” or “strongly agreed” that the Webinar format promoted deep learning for each of the topics compared to other standard learning methods (textbook and journal learning). Two-thirds expressed a preference for attending a Webinar rather than an international conference. Over 80% of participants highlighted significant barriers to attending conferences including cost (79%), distance to travel (49%), time commitment (51%), and family commitments (35%). Strengths of the Webinar included expertise, concise high-quality presentations often discussing contentious issues, and the platform quality. The main weakness was a limited time for questions. Just over 53% expressed a concern for the carbon footprint involved in attending conferences and preferred to attend a Webinar. Conclusion: E-learning Webinars represent a disruptive innovation, which promotes deep learning, greater multidisciplinary participation, and greater attendee satisfaction with fewer barriers to participation. Although Webinars will never fully replace conferences, a hybrid approach may reduce the need for conferencing, reduce carbon footprint. and promote a “sustainable academia”.

scholarly journals The Impact of Arabic Part of Speech Tagging on Sentiment Analysis: A New Corpus and Deep Learning Approach

2021 ◽  
Vol 184 ◽  
pp. 148-155
Author(s):  
Abdul Munem Nerabie ◽  
Manar AlKhatib ◽  
Sujith Samuel Mathew ◽  
May El Barachi ◽  
Farhad Oroumchian
Keyword(s):  
Deep Learning ◽  
Sentiment Analysis ◽  
Learning Approach ◽  
Part Of Speech Tagging ◽  
Part Of Speech ◽  
The Impact ◽  
Speech Tagging

scholarly journals Determinants of Individual Support for Independence: Evidence from Montenegro

2021 ◽  
pp. 1-20
Author(s):  
Pëllumb Kelmendi ◽  
Christian Pedraza
Keyword(s):  
Individual Preference ◽  
Minority Rights ◽  
Relative Effect ◽  
Factors Associated ◽  
Eu Integration ◽  
Eu Membership ◽  
Individual Support ◽  
Nationally Representative ◽  
Democratic Principles ◽  
The Impact

Abstract This article investigates the determinants of individual support for independence in Montenegro. We outline five theoretically distinct groups of factors covered by the literature and evaluate their impact on individual preference for independence. Using observational data obtained from a nationally representative survey conducted in Montenegro in 2003–2004, we find support for several hypotheses, showing that identity, income, and partisanship significantly impact individual opinion about independence. We also investigate and discuss the relative effect size of different factors associated with preference for independence. Additionally, we test variables with hitherto unexplored implications for opinions on independence, including the impact of support for EU membership, as well as support for democratic principles. Our logistic regression analyses reveal that attitudes towards EU integration and minority rights are strongly associated with support for independence. By systematically analyzing existing and new hypotheses with data from an understudied case, our findings contribute to the nascent literature on individual preferences for independence.

scholarly journals Audio-Based Drone Detection and Identification Using Deep Learning Techniques with Dataset Enhancement through Generative Adversarial Networks

Sensors ◽  
2021 ◽  
Vol 21 (15) ◽  
pp. 4953
Author(s):  
Sara Al-Emadi ◽  
Abdulla Al-Ali ◽  
Abdulaziz Al-Ali
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Recurrent Neural Network ◽  
Learning Algorithms ◽  
Generative Adversarial Networks ◽  
Generative Adversarial Network ◽  
Adversarial Networks ◽  
Detection And Identification ◽  
Learning Techniques ◽  
The Impact

Drones are becoming increasingly popular not only for recreational purposes but in day-to-day applications in engineering, medicine, logistics, security and others. In addition to their useful applications, an alarming concern in regard to the physical infrastructure security, safety and privacy has arisen due to the potential of their use in malicious activities. To address this problem, we propose a novel solution that automates the drone detection and identification processes using a drone’s acoustic features with different deep learning algorithms. However, the lack of acoustic drone datasets hinders the ability to implement an effective solution. In this paper, we aim to fill this gap by introducing a hybrid drone acoustic dataset composed of recorded drone audio clips and artificially generated drone audio samples using a state-of-the-art deep learning technique known as the Generative Adversarial Network. Furthermore, we examine the effectiveness of using drone audio with different deep learning algorithms, namely, the Convolutional Neural Network, the Recurrent Neural Network and the Convolutional Recurrent Neural Network in drone detection and identification. Moreover, we investigate the impact of our proposed hybrid dataset in drone detection. Our findings prove the advantage of using deep learning techniques for drone detection and identification while confirming our hypothesis on the benefits of using the Generative Adversarial Networks to generate real-like drone audio clips with an aim of enhancing the detection of new and unfamiliar drones.

Sign in / Sign up

Export Citation Format

Share Document