StimulEye: An intelligent tool for feature extraction and event detection from raw eye gaze data

2021 ◽  
pp. 1-9
Author(s):  
Amrutha Krishnamoorthy ◽  
Vijayasimha Reddy Sindhura ◽  
Devarakonda Gowtham ◽  
C. Jyotsna ◽  
J. Amudha
Keyword(s):  
Decision Making ◽  
Feature Extraction ◽  
Deep Learning ◽  
Event Detection ◽  
Fixation Duration ◽  
Eye Gaze ◽  
Eye Tracker ◽  
End User ◽  
Signal Features ◽  
Learning Techniques

Extraction of eye gaze events is highly dependent on automated powerful software that charges exorbitant prices. The proposed open-source intelligent tool StimulEye helps to detect and classify eye gaze events and analyse various metrics related to these events. The algorithms for eye event detection in use today heavily depend on hand-crafted signal features and thresholding, which are computed from the stream of raw gaze data. These algorithms leave most of their parametric decisions on the end user which might result in ambiguity and inaccuracy. StimulEye uses deep learning techniques to automate eye gaze event detection which neither requires manual decision making nor parametric definitions. StimulEye provides an end to end solution which takes raw streams of data from an eye tracker in text form, analyses these to classify the inputs into the events, namely saccades, fixations, and blinks. It provides the user with insights such as scanpath, fixation duration, radii, etc.

scholarly journals Deep Learning Assisted Neonatal Cry Classification via Support Vector Machine Models

2021 ◽  
Vol 9 ◽  
Author(s):  
Ashwini K ◽  
P. M. Durai Raj Vincent ◽  
Kathiravan Srinivasan ◽  
Chuan-Yu Chang
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Support Vector Machine ◽  
Feature Extraction ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Support Vector ◽  
Svm Classifier ◽  
Infant Cry ◽  
Learning Techniques

Neonatal infants communicate with us through cries. The infant cry signals have distinct patterns depending on the purpose of the cries. Preprocessing, feature extraction, and feature selection need expert attention and take much effort in audio signals in recent days. In deep learning techniques, it automatically extracts and selects the most important features. For this, it requires an enormous amount of data for effective classification. This work mainly discriminates the neonatal cries into pain, hunger, and sleepiness. The neonatal cry auditory signals are transformed into a spectrogram image by utilizing the short-time Fourier transform (STFT) technique. The deep convolutional neural network (DCNN) technique takes the spectrogram images for input. The features are obtained from the convolutional neural network and are passed to the support vector machine (SVM) classifier. Machine learning technique classifies neonatal cries. This work combines the advantages of machine learning and deep learning techniques to get the best results even with a moderate number of data samples. The experimental result shows that CNN-based feature extraction and SVM classifier provides promising results. While comparing the SVM-based kernel techniques, namely radial basis function (RBF), linear and polynomial, it is found that SVM-RBF provides the highest accuracy of kernel-based infant cry classification system provides 88.89% accuracy.

scholarly journals DeepMQ: A Deep Learning Approach Based Myelin Quantification in Microscopic Fluorescence Images

2018 ◽  
Author(s):  
Sibel Çimen ◽  
Abdulkerim Çapar ◽  
Dursun Ali Ekinci ◽  
Umut Engin Ayten ◽  
Bilal Ersen Kerman ◽  
...  
Keyword(s):  
Image Analysis ◽  
Feature Extraction ◽  
Deep Learning ◽  
Neurological Diseases ◽  
Binary Classification ◽  
Signal Transmission ◽  
Machine Learning Techniques ◽  
Neuronal Communication ◽  
Learning Classifier ◽  
Learning Techniques

AbstractOligodendrocytes wrap around the axons and form the myelin. Myelin facilitates rapid neural signal transmission. Any damage to myelin disrupts neuronal communication leading to neurological diseases such as multiple sclerosis (MS). There is no cure for MS. This is, in part, due to lack of an efficient method for myelin quantification during drug screening. In this study, an image analysis based myelin sheath detection method, DeepMQ, is developed. The method consists of a feature extraction step followed by a deep learning based binary classification module. The images, which were acquired on a confocal microscope contain three channels and multiple z-sections. Each channel represents either oligodendroyctes, neurons, or nuclei. During feature extraction, 26-neighbours of each voxel is mapped onto a 2D feature image. This image is, then, fed to the deep learning classifier, in order to detect myelin. Results indicate that 93.38% accuracy is achieved in a set of fluorescence microscope images of mouse stem cell-derived oligodendroyctes and neurons. To the best of authors’ knowledge, this is the first study utilizing image analysis along with machine learning techniques to quantify myelination.

Deep learning methods applied to electronic monitoring data: automated catch event detection for longline fishing

2020 ◽  
Author(s):  
Maoying Qiao ◽  
Dadong Wang ◽  
Geoffrey N Tuck ◽  
L Richard Little ◽  
Andre E Punt ◽  
...  
Keyword(s):  
Deep Learning ◽  
Event Detection ◽  
Electronic Monitoring ◽  
Cost Effective ◽  
Marine Resources ◽  
Review Time ◽  
Video Footage ◽  
Learning Techniques ◽  
Long Time ◽  
Time Required

Abstract Electronic monitoring (EM) systems have become functional and cost-effective tools for the conservation and sustainable harvesting of marine resources. EM is an alternative to on-board observers, which produces video segments that can subsequently be reviewed by analysts. It is currently used in a range of fisheries. There are two major challenges to the widespread adoption of EM. One is the large storage requirement for the video footage recorded and the other is the long time required by analysts to review the video footage. We propose an automated catch event detection framework to address these challenges. Our solution, based on deep learning techniques, automatically extracts video segments of catch events, which substantially reduces storage space and review time by analysts. Here, we demonstrate the framework using video footage from three longline fishing trips. The system recalled nearly 100% of the catch events across all trips.

Survey of Deep-learning Techniques in Big-Data analytics

2021 ◽  
Author(s):  
Shubhashish Goswami ◽  
Abhimanyu Kumar
Keyword(s):  
Decision Making ◽  
Big Data ◽  
Deep Learning ◽  
Learning Process ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Operational Parameters ◽  
Learning Techniques ◽  
The Impact ◽  
Business Sectors

Abstract The present elaboration of Big-data research studies relying upon Deep-learning methods had revitalized the decision-making mechanism in the business sectors and the enterprise domains. The firms' operational parameters also have the dependency of the Big-data analytics phase, their way of managing the data, and to evolve the outcomes of Big-data implementation by using the Deep-learning algorithms. The present enhancements in the Deep-learning approaches in Big-data applications facilitate the decision-making process such as the information-processing to the employees, analytical potentials augmentation, and in the transition to having more innovative work. In this DL-approach, the robust-patterns of the data-predictions resulted from the unstructured information by conceptualizing the Decision-making methods. Hence this paper elaborates the above statements stating the impact of the Deep-learning process utilizing the Big-data to operate in the enterprise and Business sectors. Also this study provides a comprehensive survey of all the Deep-learning techniques illustrating the efficiency of Big-Data processing on having the impacts of operational parameters, concentrating the data-dimensionality factors and the Big-data complications rectifying by utilizing the DL-algorithms, usage of Machine-learning or deep-learning process for the decision-making mechanism in the Enterprise sectors and business sectors, the predictions of the Big-data analytics resulting to the decision parameters within the organisations, and in the management of larger scale of datasets in Big-data analytics processing by utilizing the Deep-learning implementations. The comparative analysis of the reviewed studies has also been described by comparing existing approaches of Deep-learning methodologies in employing Big-data analytics.

Bearing fault diagnosis using deep learning techniques coupled with handcrafted feature extraction: A comparative study

2020 ◽  
pp. 107754632092914
Author(s):  
Mohammed Alabsi ◽  
Yabin Liao ◽  
Ala-Addin Nabulsi
Keyword(s):  
Neural Networks ◽  
Feature Extraction ◽  
Deep Learning ◽  
Comparative Study ◽  
Domain Knowledge ◽  
Deep Neural Networks ◽  
Performance Limits ◽  
Data Repositories ◽  
Learning Techniques ◽  
Wide Range

Deep learning has seen tremendous growth over the past decade. It has set new performance limits for a wide range of applications, including computer vision, speech recognition, and machinery health monitoring. With the abundance of instrumentation data and the availability of high computational power, deep learning continues to prove itself as an efficient tool for the extraction of micropatterns from machinery big data repositories. This study presents a comparative study for feature extraction capabilities using stacked autoencoders considering the use of expert domain knowledge. Case Western Reserve University bearing dataset was used for the study, and a classifier was trained and tested to extract and visualize features from 12 different failure classes. Based on the raw data preprocessing, four different deep neural network structures were studied. Results indicated that integrating domain knowledge with deep learning techniques improved feature extraction capabilities and reduced the deep neural networks size and computational requirements without the need for exhaustive deep neural networks architecture tuning and modification.

scholarly journals Age-Related Changes in the Characteristics of the Elderly Females Using the Signal Features of an Earlobe Photoplethysmogram

Sensors ◽  
2021 ◽  
Vol 21 (23) ◽  
pp. 7782
Author(s):  
Jeong-Woo Seo ◽  
Jungmi Choi ◽  
Kunho Lee ◽  
Jaeuk U. Kim
Keyword(s):  
Deep Learning ◽  
Linear Regression Analysis ◽  
Differential Forms ◽  
The Elderly ◽  
Multiple Linear Regression Analysis ◽  
Non Invasive ◽  
Aging Index ◽  
Age Related ◽  
Signal Features ◽  
Learning Techniques

Non-invasive measurement of physiological parameters and indicators, specifically among the elderly, is of utmost importance for personal health monitoring. In this study, we focused on photoplethysmography (PPG), and developed a regression model that calculates variables from the second (SDPPG) and third (TDPPG) derivatives of the PPG pulse that can observe the inflection point of the pulse wave measured by a wearable PPG device. The PPG pulse at the earlobe was measured for 3 min in 84 elderly Korean women (age: 71.19 ± 6.97 years old). Based on the PPG-based cardiovascular function, we derived additional variables from TDPPG, in addition to the aging variable to predict the age. The Aging Index (AI) from SDPPG and Sum of TDPPG variables were calculated in the second and third differential forms of PPG. The variables that significantly correlated with age were c/a, Tac, AI of SDPPG, sum of TDPPG, and correlation coefficient ‘r’ of the model. In multiple linear regression analysis, the r value of the model was 0.308, and that using deep learning on the model was 0.839. Moreover, the possibility of improving the accuracy of the model using supervised deep learning techniques, rather than the addition of datasets, was confirmed.

scholarly journals A Study on Deep Learning Methods for Skin Disease Classification

2021 ◽  
Vol 11 (2) ◽  
pp. 48-52
Author(s):  
N.Vanitha ◽  
M.Geetha
Keyword(s):  
Feature Extraction ◽  
Deep Learning ◽  
Skin Diseases ◽  
Disease Classification ◽  
Learning Technology ◽  
The People ◽  
Learning Techniques ◽  
Initial Stage ◽  
Human Labor ◽  
Tone Color

Dermatological disorders are one among the foremost widespread diseases within the world. Despite being common its diagnosis is extremely difficult due to its complexities of skin tone, color, presence of hair. This paper provides an approach to use various computer vision-based techniques (deep learning) to automatically predict the varied sorts of skin diseases. The system makes use of deep learning technology to coach itself with the varied skin images. the most objective of this technique is to realize maximum accuracy of disease of the skin prediction. The people health quite the other diseases. Skin diseases are mostly caused by mycosis, bacteria, allergy, or viruses, etc. The lasers advancement and Photonics based medical technology is employed in diagnosis of the skin diseases quickly and accurately. The medical equipment for such diagnosis is restricted and costliest. So, Deep learning techniques helps in detection of disease of the skin at an initial stage. The feature extraction plays a key role in classification of skin diseases. The usage of Deep Learning algorithms has reduced the necessity for human labor, like manual feature extraction and data reconstruction for classification purpose.

Feature extraction strategies in deep learning based acoustic event detection

2015 ◽  
Author(s):  
Miquel Espi ◽  
Masakiyo Fujimoto ◽  
Keisuke Kinoshita ◽  
Tomohiro Nakatani
Keyword(s):  
Feature Extraction ◽  
Deep Learning ◽  
Event Detection ◽  
Acoustic Event Detection ◽  
Acoustic Event

scholarly journals Deep Learning Techniques for Automatic Detection of Embryonic Neurodevelopmental Disorders

Diagnostics ◽  
2020 ◽  
Vol 10 (1) ◽  
pp. 27 ◽  
Author(s):  
Omneya Attallah ◽  
Maha A. Sharkas ◽  
Heba Gadelkarim
Keyword(s):  
Feature Extraction ◽  
Deep Learning ◽  
Pregnant Women ◽  
Neurodevelopmental Disorders ◽  
Feature Fusion ◽  
Feature Reduction ◽  
Learning Methods ◽  
Learning Techniques ◽  
Healthy Infants ◽  
Deep Feature Extraction

The increasing rates of neurodevelopmental disorders (NDs) are threatening pregnant women, parents, and clinicians caring for healthy infants and children. NDs can initially start through embryonic development due to several reasons. Up to three in 1000 pregnant women have embryos with brain defects; hence, the primitive detection of embryonic neurodevelopmental disorders (ENDs) is necessary. Related work done for embryonic ND classification is very limited and is based on conventional machine learning (ML) methods for feature extraction and classification processes. Feature extraction of these methods is handcrafted and has several drawbacks. Deep learning methods have the ability to deduce an optimum demonstration from the raw images without image enhancement, segmentation, and feature extraction processes, leading to an effective classification process. This article proposes a new framework based on deep learning methods for the detection of END. To the best of our knowledge, this is the first study that uses deep learning techniques for detecting END. The framework consists of four stages which are transfer learning, deep feature extraction, feature reduction, and classification. The framework depends on feature fusion. The results showed that the proposed framework was capable of identifying END from embryonic MRI images of various gestational ages. To verify the efficiency of the proposed framework, the results were compared with related work that used embryonic images. The performance of the proposed framework was competitive. This means that the proposed framework can be successively used for detecting END.

Sign in / Sign up

Export Citation Format

Share Document