Pattern-Based Deep Learning Method to Extract Information from the Log Dataset

2021 ◽  
pp. 2150296
Author(s):  
Xi Li ◽  
Ting Wang ◽  
Shexiong Wang
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Data Sets ◽  
Learning Method ◽  
Statistical Features ◽  
Log Data ◽  
The Neural Network ◽  
Testing Data ◽  
Extract Information

It draws researchers’ attentions how to make use of the log data effectively without paying much for storing them. In this paper, we propose pattern-based deep learning method to extract the features from log datasets and to facilitate its further use at the reasonable expense of the storage performances. By taking the advantages of the neural network and thoughts to combine statistical features with experts’ knowledge, there are satisfactory results in the experiments on some specified datasets and on the routine systems that our group maintains. Processed on testing data sets, the model is 5%, at least, more likely to outperform its competitors in accuracy perspective. More importantly, its schema unveils a new way to mingle experts’ experiences with statistical log parser.

Cluster Based Medical Image Registration Using Optimized Neural Network

2017 ◽  
pp. 1437-1467
Author(s):  
Joydev Hazra ◽  
Aditi Roy Chowdhury ◽  
Paramartha Dutta
Keyword(s):  
Neural Network ◽  
Genetic Algorithm ◽  
Image Registration ◽  
Convergence Rate ◽  
Optimization Algorithm ◽  
Clustering Algorithms ◽  
Data Sets ◽  
Learning Method ◽  
Local Minima ◽  
The Neural Network

Registration of medical images like CT-MR, MR-MR etc. are challenging area for researchers. This chapter introduces a new cluster based registration technique with help of the supervised optimized neural network. Features are extracted from different cluster of an image obtained from clustering algorithms. To overcome the drawback regarding convergence rate of neural network, an optimized neural network is proposed in this chapter. The weights are optimized to increase the convergence rate as well as to avoid stuck in local minima. Different clustering algorithms are explored to minimize the clustering error of an image and extract features from suitable one. The supervised learning method applied to train the neural network. During this training process an optimization algorithm named Genetic Algorithm (GA) is used to update the weights of a neural network. To demonstrate the effectiveness of the proposed method, investigation is carried out on MR T1, T2 data sets. The proposed method shows convincing results in comparison with other existing techniques.

Cluster Based Medical Image Registration Using Optimized Neural Network

2016 ◽  
pp. 551-581 ◽  
Author(s):  
Joydev Hazra ◽  
Aditi Roy Chowdhury ◽  
Paramartha Dutta
Keyword(s):  
Neural Network ◽  
Genetic Algorithm ◽  
Image Registration ◽  
Convergence Rate ◽  
Optimization Algorithm ◽  
Clustering Algorithms ◽  
Data Sets ◽  
Learning Method ◽  
Local Minima ◽  
The Neural Network

Registration of medical images like CT-MR, MR-MR etc. are challenging area for researchers. This chapter introduces a new cluster based registration technique with help of the supervised optimized neural network. Features are extracted from different cluster of an image obtained from clustering algorithms. To overcome the drawback regarding convergence rate of neural network, an optimized neural network is proposed in this chapter. The weights are optimized to increase the convergence rate as well as to avoid stuck in local minima. Different clustering algorithms are explored to minimize the clustering error of an image and extract features from suitable one. The supervised learning method applied to train the neural network. During this training process an optimization algorithm named Genetic Algorithm (GA) is used to update the weights of a neural network. To demonstrate the effectiveness of the proposed method, investigation is carried out on MR T1, T2 data sets. The proposed method shows convincing results in comparison with other existing techniques.

Human Activity Recognition using Fourier Transform Inspired Deep Learning Combination Model

2019 ◽  
Vol 9 (1) ◽  
pp. 16-31
Author(s):  
Kyungkoo Jun
Keyword(s):  
Fourier Transform ◽  
Deep Learning ◽  
Short Term Memory ◽  
Window Size ◽  
Sensor Data ◽  
Data Sets ◽  
Data Set ◽  
Proposed Model ◽  
Testing Data ◽  
Labeling Scheme

Background & Objective: This paper proposes a Fourier transform inspired method to classify human activities from time series sensor data. Methods: Our method begins by decomposing 1D input signal into 2D patterns, which is motivated by the Fourier conversion. The decomposition is helped by Long Short-Term Memory (LSTM) which captures the temporal dependency from the signal and then produces encoded sequences. The sequences, once arranged into the 2D array, can represent the fingerprints of the signals. The benefit of such transformation is that we can exploit the recent advances of the deep learning models for the image classification such as Convolutional Neural Network (CNN). Results: The proposed model, as a result, is the combination of LSTM and CNN. We evaluate the model over two data sets. For the first data set, which is more standardized than the other, our model outperforms previous works or at least equal. In the case of the second data set, we devise the schemes to generate training and testing data by changing the parameters of the window size, the sliding size, and the labeling scheme. Conclusion: The evaluation results show that the accuracy is over 95% for some cases. We also analyze the effect of the parameters on the performance.

scholarly journals Augmented Reality Maintenance Assistant Using YOLOv5

2021 ◽  
Vol 11 (11) ◽  
pp. 4758
Author(s):  
Ana Malta ◽  
Mateus Mendes ◽  
Torres Farinha
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Object Recognition ◽  
Augmented Reality ◽  
Real Time ◽  
Recognition System ◽  
High Accuracy ◽  
Video Streams ◽  
The Neural Network ◽  
Deep Learning Neural Network

Maintenance professionals and other technical staff regularly need to learn to identify new parts in car engines and other equipment. The present work proposes a model of a task assistant based on a deep learning neural network. A YOLOv5 network is used for recognizing some of the constituent parts of an automobile. A dataset of car engine images was created and eight car parts were marked in the images. Then, the neural network was trained to detect each part. The results show that YOLOv5s is able to successfully detect the parts in real time video streams, with high accuracy, thus being useful as an aid to train professionals learning to deal with new equipment using augmented reality. The architecture of an object recognition system using augmented reality glasses is also designed.

scholarly journals Neutrosophy for physiological data compression: in particular by neural nets using deep learning

2020 ◽  
pp. 74-80
Author(s):  
Philippe Schweizer ◽  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Boundary Surface ◽  
Human Perception ◽  
Neural Nets ◽  
Physiological Data ◽  
Compression Process ◽  
The Neural Network ◽  
Algorithmic Solution ◽  
Algorithmic Techniques

We would like to show the small distance in neutropsophy applications in sciences and humanities, has both finally consider as a terminal user a human. The pace of data production continues to grow, leading to increased needs for efficient storage and transmission. Indeed, the consumption of this information is preferably made on mobile terminals using connections invoiced to the user and having only reduced storage capacities. Deep learning neural networks have recently exceeded the compression rates of algorithmic techniques for text. We believe that they can also significantly challenge classical methods for both audio and visual data (images and videos). To obtain the best physiological compression, i.e. the highest compression ratio because it comes closest to the specificity of human perception, we propose using a neutrosophical representation of the information for the entire compression-decompression cycle. Such a representation consists for each elementary information to add to it a simple neutrosophical number which informs the neural network about its characteristics relative to compression during this treatment. Such a neutrosophical number is in fact a triplet (t,i,f) representing here the belonging of the element to the three constituent components of information in compression; 1° t = the true significant part to be preserved, 2° i = the inderterminated redundant part or noise to be eliminated in compression and 3° f = the false artifacts being produced in the compression process (to be compensated). The complexity of human perception and the subtle niches of its defects that one seeks to exploit requires a detailed and complex mapping that a neural network can produce better than any other algorithmic solution, and networks with deep learning have proven their ability to produce a detailed boundary surface in classifiers.

scholarly journals Is the Skip Connection Provable to Reform the Neural Network Loss Landscape?

2020 ◽  
Author(s):  
Lifu Wang ◽  
Bo Shen ◽  
Ning Zhao ◽  
Zhiyuan Zhang
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Level Sets ◽  
Theoretical Explanation ◽  
Learning Ability ◽  
Local Minima ◽  
Global Minima ◽  
Residual Network ◽  
The Neural Network ◽  
Hidden Nodes

The residual network is now one of the most effective structures in deep learning, which utilizes the skip connections to “guarantee" the performance will not get worse. However, the non-convexity of the neural network makes it unclear whether the skip connections do provably improve the learning ability since the nonlinearity may create many local minima. In some previous works [Freeman and Bruna, 2016], it is shown that despite the non-convexity, the loss landscape of the two-layer ReLU network has good properties when the number m of hidden nodes is very large. In this paper, we follow this line to study the topology (sub-level sets) of the loss landscape of deep ReLU neural networks with a skip connection and theoretically prove that the skip connection network inherits the good properties of the two-layer network and skip connections can help to control the connectedness of the sub-level sets, such that any local minima worse than the global minima of some two-layer ReLU network will be very “shallow". The “depth" of these local minima are at most O(m^(η-1)/n), where n is the input dimension, η<1. This provides a theoretical explanation for the effectiveness of the skip connection in deep learning.

scholarly journals Sub3DNet1.0: a deep-learning model for regional-scale 3D subsurface structure mapping

2021 ◽  
Vol 14 (6) ◽  
pp. 3421-3435
Author(s):  
Zhenjiao Jiang ◽  
Dirk Mallants ◽  
Lei Gao ◽  
Tim Munday ◽  
Gregoire Mariethoz ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Land Surface ◽  
Regional Scale ◽  
Learning Model ◽  
Generic Structure ◽  
Squared Error ◽  
The Neural Network ◽  
Deep Learning Model ◽  
Surface Observations

Abstract. This study introduces an efficient deep-learning model based on convolutional neural networks with joint autoencoder and adversarial structures for 3D subsurface mapping from 2D surface observations. The method was applied to delineate paleovalleys in an Australian desert landscape. The neural network was trained on a 6400 km2 domain by using a land surface topography as 2D input and an airborne electromagnetic (AEM)-derived probability map of paleovalley presence as 3D output. The trained neural network has a squared error <0.10 across 99 % of the training domain and produces a squared error <0.10 across 93 % of the validation domain, demonstrating that it is reliable in reconstructing 3D paleovalley patterns beyond the training area. Due to its generic structure, the neural network structure designed in this study and the training algorithm have broad application potential to construct 3D geological features (e.g., ore bodies, aquifer) from 2D land surface observations.

scholarly journals Defect Detection in CK45 Steel Structures through C-scan Images Using Deep Learning Method

2021 ◽  
Vol 3 (1) ◽  
Author(s):  
Navid Moshtaghi Yazdani
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Measurement System ◽  
Processing System ◽  
Steel Structures ◽  
Learning Method ◽  
Metallic Structures ◽  
Defect Profile ◽  
Network Methods ◽  
Deep Convolution Neural Network

In the present paper, a method for reliable estimation of defect profile in CK45 steel structures is presented using an eddy current testing based measurement system and post-processing system based on deep learning technique. So a deep learning method is used to determine the defect characteristics in metallic structures by magnetic field C-scan images obtained by an anisotropic magneto-resistive sensor. Having designed and adjusting the deep convolution neural network and applied it to C-scan images obtained from the measurement system, the performance of deep learning method proposed is compared with conventional artificial neural network methods such as multilayer perceptron and radial basis function on a number of metallic specimens with different defects. The results confirm the superiority of the proposed method for characterizing defects compared to other classical training-oriented methods.

Oversampling Based on Data Augmentation in Convolutional Neural Network for Silicon Wafer Defect Classification

2020 ◽  
Author(s):  
Uzma Batool ◽  
Mohd Ibrahim Shapiai ◽  
Nordinah Ismail ◽  
Hilman Fauzi ◽  
Syahrizal Salleh
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Silicon Wafer ◽  
Data Augmentation ◽  
Imbalanced Data ◽  
Training Data ◽  
Defect Classification ◽  
Learning Method ◽  
Test Set

Silicon wafer defect data collected from fabrication facilities is intrinsically imbalanced because of the variable frequencies of defect types. Frequently occurring types will have more influence on the classification predictions if a model gets trained on such skewed data. A fair classifier for such imbalanced data requires a mechanism to deal with type imbalance in order to avoid biased results. This study has proposed a convolutional neural network for wafer map defect classification, employing oversampling as an imbalance addressing technique. To have an equal participation of all classes in the classifier’s training, data augmentation has been employed, generating more samples in minor classes. The proposed deep learning method has been evaluated on a real wafer map defect dataset and its classification results on the test set returned a 97.91% accuracy. The results were compared with another deep learning based auto-encoder model demonstrating the proposed method, a potential approach for silicon wafer defect classification that needs to be investigated further for its robustness.

Implementation of Reduce AI-NN Model for Highly Accurate Blood Pressure Measurement

2020 ◽  
Author(s):  
Jerry Lin ◽  
Rajeev Kumar Pandey ◽  
Paul C.-P. Chao
Keyword(s):  
Neural Network ◽  
Blood Pressure ◽  
Measurement Accuracy ◽  
Blood Pressure Measurement ◽  
Principal Component ◽  
Data Sets ◽  
British Hypertension Society ◽  
The Neural Network ◽  
Pca Method ◽  
Highly Correlated

Abstract This study proposes a reduce AI model for the accurate measurement of the blood pressure (BP). In this study varied temporal periods of photoplethysmography (PPG) waveforms is used as the features for the artificial neural networks to estimate blood pressure. A nonlinear Principal component analysis (PCA) method is used herein to remove the redundant features and determine a set of dominant features which is highly correlated to the Blood pressure (BP). The reduce features-set not only helps to minimize the size of the neural network but also improve the measurement accuracy of the systolic blood pressure (SBP) and diastolic blood pressure (DBP). The designed Neural Network has the 5-input layer, 2 hidden layers (32 nodes each) and 2 output nodes for SBP and DBP, respectively. The NN model is trained by the PPG data sets, acquired from the 96 subjects. The testing regression for the SBP and DBP estimation is obtained as 0.81. The resultant errors for the SBP and DBP measurement are 2.00±6.08 mmHg and 1.87±4.09 mmHg, respectively. According to the Advancement of Medical Instrumentation (AAMI) and British Hypertension Society (BHS) standard, the measured error of ±6.08 mmHg is less than 8 mmHg, which shows that the device performance is in grade “A”.

Sign in / Sign up

Export Citation Format

Share Document