Classification of Legislations using Deep Learning

2021 ◽  
Vol 18 (5) ◽  
Author(s):  
Sameerchand Pudaruth ◽  
Sunjiv Soyjaudah ◽  
Rajendra Gunputh
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Short Term Memory ◽  
Support Vector ◽  
Word Embeddings ◽  
Legal Professionals ◽  
Domain Specific ◽  
The Republic ◽  
Learning Architectures

Laws are often developed in a piecemeal approach and many provisions of similar nature are often found in different legislations. Therefore, there is a need to classify legislations into various legal topics to help legal professionals in their daily activities. In this study, we have experimented with various deep learning architectures for the automatic classification of 490 legislations from the Republic of Mauritius into 30 categories. Our results demonstrate that a Deep Neural Network (DNN) with three hidden layers delivered the best performance compared with other architectures such as Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs). A mean classification accuracy of 60.9% was achieved using DNN, 56.5% for CNN and 33.7% for Long Short-Term Memory (LSTM). Comparisons were also made with traditional machine learning classifiers such as support vector machines and decision trees and it was found that the performance of DNN was superior, by at least 10%, in all runs. Both general pre-trained word embeddings such as Word2vec and domain-specific word embeddings such as Law2vec were used in combination with the above deep learning architectures but Word2vec had the best performance. To our knowledge, this is the first application of deep learning in the categorisation of legislations.

scholarly journals Deep Learning Methods for Classification of Certain Abnormalities in Echocardiography

Electronics ◽  
2021 ◽  
Vol 10 (4) ◽  
pp. 495
Author(s):  
Imayanmosha Wahlang ◽  
Arnab Kumar Maji ◽  
Goutam Saha ◽  
Prasun Chakrabarti ◽  
Michal Jasinski ◽  
...  
Keyword(s):  
Deep Learning ◽  
Short Term Memory ◽  
Support Vector ◽  
Variational Autoencoder ◽  
Different Types ◽  
Static Images ◽  
Long Short Term Memory ◽  
2D And 3D ◽  
Better Than

This article experiments with deep learning methodologies in echocardiogram (echo), a promising and vigorously researched technique in the preponderance field. This paper involves two different kinds of classification in the echo. Firstly, classification into normal (absence of abnormalities) or abnormal (presence of abnormalities) has been done, using 2D echo images, 3D Doppler images, and videographic images. Secondly, based on different types of regurgitation, namely, Mitral Regurgitation (MR), Aortic Regurgitation (AR), Tricuspid Regurgitation (TR), and a combination of the three types of regurgitation are classified using videographic echo images. Two deep-learning methodologies are used for these purposes, a Recurrent Neural Network (RNN) based methodology (Long Short Term Memory (LSTM)) and an Autoencoder based methodology (Variational AutoEncoder (VAE)). The use of videographic images distinguished this work from the existing work using SVM (Support Vector Machine) and also application of deep-learning methodologies is the first of many in this particular field. It was found that deep-learning methodologies perform better than SVM methodology in normal or abnormal classification. Overall, VAE performs better in 2D and 3D Doppler images (static images) while LSTM performs better in the case of videographic images.

scholarly journals Stock Pattern Classification from Charts using Deep Learning Algorithms

2020 ◽  
Vol 3 (1) ◽  
pp. 445-454
Author(s):  
Celal Buğra Kaya ◽  
Alperen Yılmaz ◽  
Gizem Nur Uzun ◽  
Zeynep Hilal Kilimci
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Networks ◽  
Pattern Classification ◽  
Short Term Memory ◽  
Stock Exchange ◽  
Learning Techniques ◽  
Proposed Model ◽  
Istanbul Stock Exchange

Pattern classification is related with the automatic finding of regularities in dataset through the utilization of various learning techniques. Thus, the classification of the objects into a set of categories or classes is provided. This study is undertaken to evaluate deep learning methodologies to the classification of stock patterns. In order to classify patterns that are obtained from stock charts, convolutional neural networks (CNNs), recurrent neural networks (RNNs), and long-short term memory networks (LSTMs) are employed. To demonstrate the efficiency of proposed model in categorizing patterns, hand-crafted image dataset is constructed from stock charts in Istanbul Stock Exchange and NASDAQ Stock Exchange. Experimental results show that the usage of convolutional neural networks exhibits superior classification success in recognizing patterns compared to the other deep learning methodologies.

scholarly journals Investigating Deep Feedforward Neural Networks for Classification of Transposon-Derived piRNAs

2020 ◽  
Author(s):  
Alisson Hayasi da Costa ◽  
Renato Augusto C. dos Santos ◽  
Ricardo Cerri
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
State Of The Art ◽  
Feedforward Neural Networks ◽  
The State ◽  
Machine Learning Algorithms ◽  
Support Vector ◽  
Advantages And Disadvantages ◽  
Large Application

AbstractPIWI-Interacting RNAs (piRNAs) form an important class of non-coding RNAs that play a key role in the genome integrity through the silencing of transposable elements. However, despite their importance and the large application of deep learning in computational biology for classification tasks, there are few studies of deep learning and neural networks for piRNAs prediction. Therefore, this paper presents an investigation on deep feedforward networks models for classification of transposon-derived piRNAs. We analyze and compare the results of the neural networks in different hyperparameters choices, such as number of layers, activation functions and optimizers, clarifying the advantages and disadvantages of each configuration. From this analysis, we propose a model for human piRNAs classification and compare our method with the state-of-the-art deep neural network for piRNA prediction in the literature and also traditional machine learning algorithms, such as Support Vector Machines and Random Forests, showing that our model has achieved a great performance with an F-measure value of 0.872, outperforming the state-of-the-art method in the literature.

scholarly journals Convolutional Neural Networks for Recognition of Lymphoblast Cell Images

2019 ◽  
Vol 2019 ◽  
pp. 1-12 ◽  
Author(s):  
Tatdow Pansombut ◽  
Siripen Wikaisuksakul ◽  
Kittiya Khongkraphan ◽  
Aniruth Phon-on
Keyword(s):  
Deep Learning ◽  
Lymphoblastic Leukaemia ◽  
Specific Problem ◽  
Support Vector ◽  
Feature Engineering ◽  
Learning Approach ◽  
Domain Specific ◽  
Vector Machines ◽  
Multilayer Architecture

This paper presents the recognition for WHO classification of acute lymphoblastic leukaemia (ALL) subtypes. The two ALL subtypes considered are T-lymphoblastic leukaemia (pre-T) and B-lymphoblastic leukaemia (pre-B). They exhibit various characteristics which make it difficult to distinguish between subtypes from their mature cells, lymphocytes. In a common approach, handcrafted features must be well designed for this complex domain-specific problem. With deep learning approach, handcrafted feature engineering can be eliminated because a deep learning method can automate this task through the multilayer architecture of a convolutional neural network (CNN). In this work, we implement a CNN classifier to explore the feasibility of deep learning approach to identify lymphocytes and ALL subtypes, and this approach is benchmarked against a dominant approach of support vector machines (SVMs) applying handcrafted feature engineering. Additionally, two traditional machine learning classifiers, multilayer perceptron (MLP), and random forest are also applied for the comparison. The experiments show that our CNN classifier delivers better performance to identify normal lymphocytes and pre-B cells. This shows a great potential for image classification with no requirement of multiple preprocessing steps from feature engineering.

Sentiment Recognition in Customer Reviews Using Deep Learning

2018 ◽  
Vol 14 (2) ◽  
pp. 77-86 ◽  
Author(s):  
Vinay Kumar Jain ◽  
Shishir Kumar ◽  
Prabhat Mahanti
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Sentiment Analysis ◽  
Text Classification ◽  
Short Term Memory ◽  
Machine Learning Techniques ◽  
Support Vector ◽  
Customer Reviews ◽  
Analysis Question ◽  
Comparison Of The Results

Deep learning has become popular in all aspect related to human judgments. Most machine learning techniques work well which includes text classification, text sequence learning, sentiment analysis, question-answer engine, etc. This paper has been focused on two objectives, firstly is to study the applicability of deep neural networks strategies for extracting sentiment present in social media data and customer reviews with effective training solutions. The second objective is to design deep networks that can be trained with these weakly supervised strategies in order to predict meaningful inferences. This paper presents the concept and steps of using deep learning for extraction sentiments from customer reviews. The extraction pulls out the features from the customer reviews using deep learning popular methods including Convolution neural networks (CNN) and Long Short-Term Memory (LSTM) architectures. The comparison of the results with tradition text classification method such as Naive Bayes(NB) and Support Vector Machine(SVM) using two data sets IMDB reviews and Amazon customer reviews have been presented. This work mainly focused on investigating the merit of using deep models for sentiment analysis in customer reviews.

scholarly journals Hybrid Representation of Sensor Data for the Classification of Driving Behaviour

2021 ◽  
Vol 11 (18) ◽  
pp. 8574
Author(s):  
Michalis Savelonas ◽  
Ioannis Vernikos ◽  
Dimitris Mantzekis ◽  
Evaggelos Spyrou ◽  
Athanasia Tsakiri ◽  
...  
Keyword(s):  
Neural Networks ◽  
Time Series ◽  
Event Detection ◽  
Domain Knowledge ◽  
Short Term Memory ◽  
Main Idea ◽  
Sensor Data ◽  
Support Vector ◽  
Driving Behaviour

Monitoring driving behaviour is important in controlling driving risk, fuel consumption, and CO2 emissions. Recent advances in machine learning, which include several variants of convolutional neural networks (CNNs), and recurrent neural networks (RNNs), such as long short-term memory (LSTM) and gated recurrent unit (GRU) networks, could be valuable for the development of objective and efficient computational tools in this direction. The main idea in this work is to complement data-driven classification of driving behaviour with rules derived from domain knowledge. In this light, we present a hybrid representation approach, which employs NN-based time-series encoding and rule-guided event detection. Histograms derived from the output of these two components are concatenated, normalized, and used to train a standard support vector machine (SVM). For the NN-based component, CNN-based, LSTM-based, and GRU-based variants are investigated. The CNN-based variant uses image-like representations of sensor measurements, whereas the RNN-based variants (LSTM and GRU) directly process sensor measurements in the form of time-series. Experimental evaluation on three datasets leads to the conclusion that the proposed approach outperforms a state-of-the-art camera-based approaches in distinguishing between normal and aggressive driving behaviour without using data derived from a camera. Moreover, it is demonstrated that both NN-guided time-series encoding and rule-guided event detection contribute to overall classification accuracy.

scholarly journals Classification of plumage images for identifying bird species

2021 ◽  
Vol 5 (45) ◽  
pp. 749-755
Author(s):  
A.V. Belko ◽  
K.S. Dobratulin ◽  
A.V. Kuznetsov
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Species Identification ◽  
Real World ◽  
Experimental Evaluation ◽  
Bird Species ◽  
Classification Task ◽  
Taxonomic Identification ◽  
Learning Architectures

This paper studies the possibility of using neural networks to classify plumage images in order to identify bird species. Taxonomic identification of bird plumage is widely used in aviation ornithology to analyze collisions with aircraft and develop methods for their prevention. This article provides a method for bird species identification based on a dataset made up in the previous research. A method for identifying birds from real-world images based on YoloV4 neural networks and DenseNet models is proposed. We present results of the feather classification task. We selected several deep learning architectures (DenseNet based) for a comparison of categorical crossentropy values on the provided dataset. The experimental evaluation has shown that the proposed method allows determining the bird species from a photo of an individual feather with an accuracy of up to 81.03 % for accurate classification, and with an accuracy of 97.09 % for the first five predictions.

Application of Deep Learning for EEG

2020 ◽  
pp. 106-123
Author(s):  
Angana Saikia ◽  
Sudip Paul
Keyword(s):  
Deep Learning ◽  
Extraction Methods ◽  
Physiological Signals ◽  
High Dimensional ◽  
Support Vector ◽  
Learning Techniques ◽  
Eeg Data ◽  
Learning Architectures ◽  
Subject Differences

Deep learning is a relatively new branch of machine learning, which has been used in a variety of biomedical applications. It has been used to analyze different physiological signals and gain better understanding of human physiology for automated diagnosis of abnormal conditions. It is used in the classification of electroencephalography signals. Most of the present research has continued to use manual feature extraction methods followed by a traditional classifier, such as support vector machine or logistic regression. This is largely due to the low number of samples per experiment, high-dimensional nature of the data, and the difficulty in finding appropriate deep learning architectures for classification of EEG signals. One of the challenges in modeling cognitive events from EEG data is finding representations that are invariant to inter- and intra-subject differences as well as the inherent noise associated with EEG data collection. Herein, the authors explore the capabilities of the recent deep learning techniques for modeling cognitive events from EEG data.

scholarly journals Convolutional neural network-based model for web-based text classification

2019 ◽  
Vol 9 (6) ◽  
pp. 5785
Author(s):  
Satyabrata Aich ◽  
Sabyasachi Chakraborty ◽  
Hee-Cheol Kim
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Text Classification ◽  
Short Term Memory ◽  
Classification Model ◽  
Learning Models ◽  
Real World Problem ◽  
Traditional Approaches ◽  
The Web

<table width="593" border="1" cellspacing="0" cellpadding="0"><tbody><tr><td valign="top" width="387"><p>There is an increasing amount of text data available on the web with multiple topical granularities; this necessitates proper categorization/classification of text to facilitate obtaining useful information as per the needs of users. Some traditional approaches such as bag-of-words and bag-of-ngrams models provide good results for text classification. However, texts available on the web in the current state contain high event-related granularity on different topics at different levels, which may adversely affect the accuracy of traditional approaches. With the invention of deep learning models, which already have the capability of providing good accuracy in the field of image processing and speech recognition, the problems inherent in the traditional text classification model can be overcome. Currently, there are several deep learning models such as a convolutional neural networks (CNNs), recurrent neural networks (RNNs), and long-short term memory that are widely used for various text-related tasks; however, among them, the CNN model is popular because it is simple to use and has high accuracy for text classification. In this study, classification of random texts on the web into categories is attempted using a CNN-based model by changing the hyperparameters and sequence of text vectors. We attempt to tune every hyperparameter that is unique for the classification task along with the sequences of word vectors to obtain the desired accuracy; the accuracy is found to be in the range of 85–92%. This model can be considered as a reliable model and applied to solve real-world problem or extract useful information for various text mining applications.</p></td></tr></tbody></table>

scholarly journals DLBench: a comprehensive experimental evaluation of deep learning frameworks

2021 ◽  
Author(s):  
Radwa Elshawi ◽  
Abdul Wahab ◽  
Ahmed Barnawi ◽  
Sherif Sakr
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Networks ◽  
Language Processing ◽  
Experimental Evaluation ◽  
Short Term Memory ◽  
Performance Characteristics ◽  
Training Time ◽  
Learning Frameworks ◽  
Learning Architectures

AbstractDeep Learning (DL) has achieved remarkable progress over the last decade on various tasks such as image recognition, speech recognition, and natural language processing. In general, three main crucial aspects fueled this progress: the increasing availability of large amount of digitized data, the increasing availability of affordable parallel and powerful computing resources (e.g., GPU) and the growing number of open source deep learning frameworks that facilitate and ease the development process of deep learning architectures. In practice, the increasing popularity of deep learning frameworks calls for benchmarking studies that can effectively evaluate and understand the performance characteristics of these systems. In this paper, we conduct an extensive experimental evaluation and analysis of six popular deep learning frameworks, namely, TensorFlow, MXNet, PyTorch, Theano, Chainer, and Keras, using three types of DL architectures Convolutional Neural Networks (CNN), Faster Region-based Convolutional Neural Networks (Faster R-CNN), and Long Short Term Memory (LSTM). Our experimental evaluation considers different aspects for its comparison including accuracy, training time, convergence and resource consumption patterns. Our experiments have been conducted on both CPU and GPU environments using different datasets. We report and analyze the performance characteristics of the studied frameworks. In addition, we report a set of insights and important lessons that we have learned from conducting our experiments.

Sign in / Sign up

Export Citation Format

Share Document