Transfer learning techniques for emotion classification on visual features of images in the deep learning network

2020 ◽  
Vol 23 (2) ◽  
pp. 361-372
Author(s):  
D. Tamil Priya ◽  
J. Divya Udayan
Keyword(s):  
Deep Learning ◽  
Transfer Learning ◽  
Visual Features ◽  
Emotion Classification ◽  
Learning Network ◽  
Learning Techniques ◽  
Deep Learning Network

scholarly journals ERISNet: Deep learning network for Sargassum detection along the coastline of the Mexican Caribbean

2018 ◽  
Author(s):  
Javier Arellano-Verdejo ◽  
Hugo-Enrique Lazcano-Hernandez ◽  
Nancy Cabanillas-Terán
Keyword(s):  
Deep Learning ◽  
Recurrent Neural Networks ◽  
Algal Blooms ◽  
Quintana Roo ◽  
Negative Consequences ◽  
Learning Network ◽  
Learning Techniques ◽  
Mexican Caribbean ◽  
Modis Imagery ◽  
Deep Learning Network

Recently, Caribbean coasts have experienced atypical massive arrivals of pelagic Sargassum with negative consequences both ecologically and economically. Based on deep learning techniques, this study proposes a novel algorithm for floating and accumulated pelagic Sargassum detection along the coastline of Quintana Roo, Mexico. Using convolutional and recurrent neural networks architectures, a deep learning network (named ERISNet) was designed specifically to detect this macroalgae along the coastline through remote sensing support. A new dataset which includes pixels values with and without Sargassum was built to training and testing ERISNet. Aqua-MODIS imagery was used to build the dataset. After the learning process, the designed algorithm achieves a 90 % of probability in its classification skills. ERISNet provides a baseline for automated systems to accurately and efficiently monitor algal blooms arrivals.

scholarly journals ERISNet: Deep learning network for Sargassum detection along the coastline of the Mexican Caribbean

2018 ◽  
Author(s):  
Javier Arellano-Verdejo ◽  
Hugo-Enrique Lazcano-Hernandez ◽  
Nancy Cabanillas-Terán
Keyword(s):  
Deep Learning ◽  
Recurrent Neural Networks ◽  
Algal Blooms ◽  
Quintana Roo ◽  
Negative Consequences ◽  
Learning Network ◽  
Learning Techniques ◽  
Mexican Caribbean ◽  
Modis Imagery ◽  
Deep Learning Network

Recently, Caribbean coasts have experienced atypical massive arrivals of pelagic Sargassum with negative consequences both ecologically and economically. Based on deep learning techniques, this study proposes a novel algorithm for floating and accumulated pelagic Sargassum detection along the coastline of Quintana Roo, Mexico. Using convolutional and recurrent neural networks architectures, a deep learning network (named ERISNet) was designed specifically to detect this macroalgae along the coastline through remote sensing support. A new dataset which includes pixels values with and without Sargassum was built to training and testing ERISNet. Aqua-MODIS imagery was used to build the dataset. After the learning process, the designed algorithm achieves a 90 % of probability in its classification skills. ERISNet provides a baseline for automated systems to accurately and efficiently monitor algal blooms arrivals.

scholarly journals Malware Classification Using Machine Learning and Image Processing

2022 ◽  
Vol 10 (1) ◽  
pp. 531-541
Author(s):  
Zainab Mushtaq
Keyword(s):  
Machine Learning ◽  
Deep Learning ◽  
Computer Security ◽  
Transfer Learning ◽  
Learning Technology ◽  
Test Dataset ◽  
Learning Network ◽  
Malware Classification ◽  
Learning Technique ◽  
Deep Learning Network

Abstract: Malware is routinely used for illegal reasons, and new malware variants are discovered every day. Computer vision in computer security is one of the most significant disciplines of research today, and it has witnessed tremendous growth in the preceding decade due to its efficacy. We employed research in machine-learning and deep-learning technology such as Logistic Regression, ANN, CNN, transfer learning on CNN, and LSTM to arrive at our conclusions. We have published analysis-based results from a range of categorization models in the literature. InceptionV3 was trained using a transfer learning technique, which yielded reasonable results when compared with other methods such as LSTM. On the test dataset, the transferring learning technique was about 98.76 percent accurate, while on the train dataset, it was around 99.6 percent accurate. Keywords: Malware, illegal activity, Deep learning, Network Security,

scholarly journals UAVs in rail damage image diagnostics supported by deep-learning networks

2021 ◽  
Vol 11 (1) ◽  
pp. 339-348
Author(s):  
Piotr Bojarczak ◽  
Piotr Lesiak
Keyword(s):  
Deep Learning ◽  
Head Width ◽  
Learning Networks ◽  
Image Brightness ◽  
Learning Network ◽  
Rail Head ◽  
Image Recording ◽  
Python Language ◽  
Deep Learning Network ◽  
Efficiency Rate

Abstract The article uses images from Unmanned Aerial Vehicles (UAVs) for rail diagnostics. The main advantage of such a solution compared to traditional surveys performed with measuring vehicles is the elimination of decreased train traffic. The authors, in the study, limited themselves to the diagnosis of hazardous split defects in rails. An algorithm has been proposed to detect them with an efficiency rate of about 81% for defects not less than 6.9% of the rail head width. It uses the FCN-8 deep-learning network, implemented in the Tensorflow environment, to extract the rail head by image segmentation. Using this type of network for segmentation increases the resistance of the algorithm to changes in the recorded rail image brightness. This is of fundamental importance in the case of variable conditions for image recording by UAVs. The detection of these defects in the rail head is performed using an algorithm in the Python language and the OpenCV library. To locate the defect, it uses the contour of a separate rail head together with a rectangle circumscribed around it. The use of UAVs together with artificial intelligence to detect split defects is an important element of novelty presented in this work.

scholarly journals BioECG: Improving ECG Biometrics with Deep Learning and Enhanced Datasets

2021 ◽  
Vol 11 (13) ◽  
pp. 5880
Author(s):  
Paloma Tirado-Martin ◽  
Raul Sanchez-Reillo
Keyword(s):  
Deep Learning ◽  
Temporal Variations ◽  
Physical Activities ◽  
Learning Tools ◽  
Biometric Recognition ◽  
Learning Network ◽  
Deep Learning Network ◽  
Electrocardiogram Ecg

Nowadays, Deep Learning tools have been widely applied in biometrics. Electrocardiogram (ECG) biometrics is not the exception. However, the algorithm performances rely heavily on a representative dataset for training. ECGs suffer constant temporal variations, and it is even more relevant to collect databases that can represent these conditions. Nonetheless, the restriction in database publications obstructs further research on this topic. This work was developed with the help of a database that represents potential scenarios in biometric recognition as data was acquired in different days, physical activities and positions. The classification was implemented with a Deep Learning network, BioECG, avoiding complex and time-consuming signal transformations. An exhaustive tuning was completed including variations in enrollment length, improving ECG verification for more complex and realistic biometric conditions. Finally, this work studied one-day and two-days enrollments and their effects. Two-days enrollments resulted in huge general improvements even when verification was accomplished with more unstable signals. EER was improved in 63% when including a change of position, up to almost 99% when visits were in a different day and up to 91% if the user experienced a heartbeat increase after exercise.

scholarly journals Method for Diagnosing the Bone Marrow Edema of Sacroiliac Joint in Patients with Axial Spondyloarthritis Using Magnetic Resonance Image Analysis Based on Deep Learning

Diagnostics ◽  
2021 ◽  
Vol 11 (7) ◽  
pp. 1156
Author(s):  
Kang Hee Lee ◽  
Sang Tae Choi ◽  
Guen Young Lee ◽  
You Jung Ha ◽  
Sang-Il Choi
Keyword(s):  
Bone Marrow ◽  
Deep Learning ◽  
Bone Marrow Edema ◽  
Axial Spondyloarthritis ◽  
Mr Images ◽  
Sacroiliac Joints ◽  
Learning Network ◽  
Active Sacroiliitis ◽  
Deep Learning Network ◽  
Marrow Edema

Axial spondyloarthritis (axSpA) is a chronic inflammatory disease of the sacroiliac joints. In this study, we develop a method for detecting bone marrow edema by magnetic resonance (MR) imaging of the sacroiliac joints and a deep-learning network. A total of 815 MR images of the sacroiliac joints were obtained from 60 patients diagnosed with axSpA and 19 healthy subjects. Gadolinium-enhanced fat-suppressed T1-weighted oblique coronal images were used for deep learning. Active sacroiliitis was defined as bone marrow edema, and the following processes were performed: setting the region of interest (ROI) and normalizing it to a size suitable for input to a deep-learning network, determining bone marrow edema using a convolutional-neural-network-based deep-learning network for individual MR images, and determining sacroiliac arthritis in subject examinations based on the classification results of individual MR images. About 70% of the patients and normal subjects were randomly selected for the training dataset, and the remaining 30% formed the test dataset. This process was repeated five times to calculate the average classification rate of the five-fold sets. The gradient-weighted class activation mapping method was used to validate the classification results. In the performance analysis of the ResNet18-based classification network for individual MR images, use of the ROI showed excellent detection performance of bone marrow edema with 93.55 ± 2.19% accuracy, 92.87 ± 1.27% recall, and 94.69 ± 3.03% precision. The overall performance was additionally improved using a median filter to reflect the context information. Finally, active sacroiliitis was diagnosed in individual subjects with 96.06 ± 2.83% accuracy, 100% recall, and 94.84 ± 3.73% precision. This is a pilot study to diagnose bone marrow edema by deep learning based on MR images, and the results suggest that MR analysis using deep learning can be a useful complementary means for clinicians to diagnose bone marrow edema.

Transfer learning based convolution neural net for authentication and classification of emotions from natural and stimulated speech signals

2021 ◽  
pp. 1-12
Author(s):  
Mukul Kumar ◽  
Nipun Katyal ◽  
Nersisson Ruban ◽  
Elena Lyakso ◽  
A. Mary Mekala ◽  
...  
Keyword(s):  
Machine Learning ◽  
Deep Learning ◽  
Transfer Learning ◽  
Research Work ◽  
Oral Communication ◽  
Neural Net ◽  
Emotion Classification ◽  
Style Transfer ◽  
Conventional Machine ◽  
Neural Network Algorithm

Over the years the need for differentiating various emotions from oral communication plays an important role in emotion based studies. There have been different algorithms to classify the kinds of emotion. Although there is no measure of fidelity of the emotion under consideration, which is primarily due to the reason that most of the readily available datasets that are annotated are produced by actors and not generated in real-world scenarios. Therefore, the predicted emotion lacks an important aspect called authenticity, which is whether an emotion is actual or stimulated. In this research work, we have developed a transfer learning and style transfer based hybrid convolutional neural network algorithm to classify the emotion as well as the fidelity of the emotion. The model is trained on features extracted from a dataset that contains stimulated as well as actual utterances. We have compared the developed algorithm with conventional machine learning and deep learning techniques by few metrics like accuracy, Precision, Recall and F1 score. The developed model performs much better than the conventional machine learning and deep learning models. The research aims to dive deeper into human emotion and make a model that understands it like humans do with precision, recall, F1 score values of 0.994, 0.996, 0.995 for speech authenticity and 0.992, 0.989, 0.99 for speech emotion classification respectively.

Sign in / Sign up

Export Citation Format

Share Document