Analysis of Deep Rain Streaks Removal Convolutional Neural Network-Based Post-Processing Techniques in HEVC Encoder

2020 ◽  
pp. 2150020
Author(s):  
Thiyagarajan Jayaraman ◽  
Gowri Shankar Chinnusamy
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Optimization Algorithm ◽  
High Efficiency ◽  
Convergence Time ◽  
Video Sequences ◽  
Bit Rate ◽  
Post Processing ◽  
Rate Reduction ◽  
High Definition

This paper presents Deep Rain Streaks Removal Convolutional Neural Network (Derain SRCNN) based post-processing optimization algorithm for High-Efficiency Video Coder (HEVC). Earlier, the CNN-based denoising optimization algorithm faced overfitting issues and large convergence time when training the CNN for rain streaks affected High Definition (HD) video sequences. To address these problems, Deep rain streaks removal CNN-based post-processing block is introduced in HEVC encoder. Derain SRCNN architecture consists of a parallel two residual block layer and Dual Channel Rectification Linear Unit (DCReLU) activation function with various sizes of the convolutional layer. By reducing the validate error and training the error of CNN, the overfitting issue is solved. Also, convergence time is reduced using proper learning rate and kernel weight of optimization algorithm. The proposed network provides a higher bit rate reduction and higher convergence speed for corrupted high-definition video sequences. The experiment result shows that proposed DerainSRCNN-based post-processing filtering method achieves 6.8% and 4.1% -bit rate reduction for random access (RA) and low delay [Formula: see text] frame (LDP) configuration, respectively.

Sparse-FCM and Deep Convolutional Neural Network for the segmentation and classification of acute lymphoblastic leukaemia

2020 ◽  
Vol 65 (6) ◽  
pp. 759-773
Author(s):  
Segu Praveena ◽  
Sohan Pal Singh
Keyword(s):  
Neural Network ◽  
Acute Lymphoblastic Leukaemia ◽  
Convolutional Neural Network ◽  
Optimization Algorithm ◽  
Lymphoblastic Leukaemia ◽  
Input Image ◽  
Deep Convolutional Neural Network ◽  
Grey Wolf ◽  
Deep Cnn

AbstractLeukaemia detection and diagnosis in advance is the trending topic in the medical applications for reducing the death toll of patients with acute lymphoblastic leukaemia (ALL). For the detection of ALL, it is essential to analyse the white blood cells (WBCs) for which the blood smear images are employed. This paper proposes a new technique for the segmentation and classification of the acute lymphoblastic leukaemia. The proposed method of automatic leukaemia detection is based on the Deep Convolutional Neural Network (Deep CNN) that is trained using an optimization algorithm, named Grey wolf-based Jaya Optimization Algorithm (GreyJOA), which is developed using the Grey Wolf Optimizer (GWO) and Jaya Optimization Algorithm (JOA) that improves the global convergence. Initially, the input image is applied to pre-processing and the segmentation is performed using the Sparse Fuzzy C-Means (Sparse FCM) clustering algorithm. Then, the features, such as Local Directional Patterns (LDP) and colour histogram-based features, are extracted from the segments of the pre-processed input image. Finally, the extracted features are applied to the Deep CNN for the classification. The experimentation evaluation of the method using the images of the ALL IDB2 database reveals that the proposed method acquired a maximal accuracy, sensitivity, and specificity of 0.9350, 0.9528, and 0.9389, respectively.

scholarly journals Enhanced Convolutional-Neural-Network Architecture for Crop Classification

2021 ◽  
Vol 11 (9) ◽  
pp. 4292
Author(s):  
Mónica Y. Moreno-Revelo ◽  
Lorena Guachi-Guachi ◽  
Juan Bernardo Gómez-Mendoza ◽  
Javier Revelo-Fuelagán ◽  
Diego H. Peluffo-Ordóñez
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Network Architecture ◽  
Classification Model ◽  
Classification Error ◽  
Small Scale ◽  
Post Processing ◽  
Average Accuracy ◽  
Processing Step ◽  
Crop Classification

Automatic crop identification and monitoring is a key element in enhancing food production processes as well as diminishing the related environmental impact. Although several efficient deep learning techniques have emerged in the field of multispectral imagery analysis, the crop classification problem still needs more accurate solutions. This work introduces a competitive methodology for crop classification from multispectral satellite imagery mainly using an enhanced 2D convolutional neural network (2D-CNN) designed at a smaller-scale architecture, as well as a novel post-processing step. The proposed methodology contains four steps: image stacking, patch extraction, classification model design (based on a 2D-CNN architecture), and post-processing. First, the images are stacked to increase the number of features. Second, the input images are split into patches and fed into the 2D-CNN model. Then, the 2D-CNN model is constructed within a small-scale framework, and properly trained to recognize 10 different types of crops. Finally, a post-processing step is performed in order to reduce the classification error caused by lower-spatial-resolution images. Experiments were carried over the so-named Campo Verde database, which consists of a set of satellite images captured by Landsat and Sentinel satellites from the municipality of Campo Verde, Brazil. In contrast to the maximum accuracy values reached by remarkable works reported in the literature (amounting to an overall accuracy of about 81%, a f1 score of 75.89%, and average accuracy of 73.35%), the proposed methodology achieves a competitive overall accuracy of 81.20%, a f1 score of 75.89%, and an average accuracy of 88.72% when classifying 10 different crops, while ensuring an adequate trade-off between the number of multiply-accumulate operations (MACs) and accuracy. Furthermore, given its ability to effectively classify patches from two image sequences, this methodology may result appealing for other real-world applications, such as the classification of urban materials.

AUTOMATED SCREENING OF DIABETIC RETINOPATHY WITH OPTIMIZED DEEP CONVOLUTIONAL NEURAL NETWORK: ENHANCED MOTH FLAME MODEL

2021 ◽  
Vol 21 (01) ◽  
pp. 2150005
Author(s):  
ARUN T NAIR ◽  
K. MUTHUVEL
Keyword(s):  
Neural Network ◽  
Feature Extraction ◽  
Blood Vessel ◽  
Convolutional Neural Network ◽  
Optimization Algorithm ◽  
Vessel Segmentation ◽  
Deep Convolutional Neural Network ◽  
Gray Level ◽  
Pass Filter ◽  
Blood Vessel Segmentation

Nowadays, analysis on retinal image exists as one of the challenging area for study. Numerous retinal diseases could be recognized by analyzing the variations taking place in retina. However, the main disadvantage among those studies is that, they do not have higher recognition accuracy. The proposed framework includes four phases namely, (i) Blood Vessel Segmentation (ii) Feature Extraction (iii) Optimal Feature Selection and (iv) Classification. Initially, the input fundus image is subjected to blood vessel segmentation from which two binary thresholded images (one from High Pass Filter (HPF) and other from top-hat reconstruction) are acquired. These two images are differentiated and the areas that are common to both are said to be the major vessels and the left over regions are fused to form vessel sub-image. These vessel sub-images are classified with Gaussian Mixture Model (GMM) classifier and the resultant is summed up with the major vessels to form the segmented blood vessels. The segmented images are subjected to feature extraction process, where the features like proposed Local Binary Pattern (LBP), Gray-Level Co-Occurrence Matrix (GLCM) and Gray Level Run Length Matrix (GLRM) are extracted. As the curse of dimensionality seems to be the greatest issue, it is important to select the appropriate features from the extracted one for classification. In this paper, a new improved optimization algorithm Moth Flame with New Distance Formulation (MF-NDF) is introduced for selecting the optimal features. Finally, the selected optimal features are subjected to Deep Convolutional Neural Network (DCNN) model for classification. Further, in order to make the precise diagnosis, the weights of DCNN are optimally tuned by the same optimization algorithm. The performance of the proposed algorithm will be compared against the conventional algorithms in terms of positive and negative measures.

scholarly journals ARPEGE cloud cover forecast post-processing with convolutional neural network

2020 ◽  
Author(s):  
Florian Dupuy ◽  
Olivier Mestre ◽  
Léo Pfitzner
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Convolutional Neural Network ◽  
Random Forests ◽  
Cloud Cover ◽  
Spatial Information ◽  
Weather Prediction ◽  
Excellent Result ◽  
Machine Learning Algorithms ◽  
Post Processing

<p>Cloud cover is a crucial information for many applications such as planning land observation missions from space. However, cloud cover remains a challenging variable to forecast, and Numerical Weather Prediction (NWP) models suffer from significant biases, hence justifying the use of statistical post-processing techniques. In our application, the ground truth is a gridded cloud cover product derived from satellite observations over Europe, and predictors are spatial fields of various variables produced by ARPEGE (Météo-France global NWP) at the corresponding lead time.</p><p>In this study, ARPEGE cloud cover is post-processed using a convolutional neural network (CNN). CNN is the most popular machine learning tool to deal with images. In our case, CNN allows to integrate spatial information contained in NWP outputs. We show that a simple U-Net architecture produces significant improvements over Europe. Compared to the raw ARPEGE forecasts, MAE drops from 25.1 % to 17.8 % and RMSE decreases from 37.0 % to 31.6 %. Considering specific needs for earth observation, special interest was put on forecasts with low cloud cover conditions (< 10 %). For this particular nebulosity class, we show that hit rate jumps from 40.6 to 70.7 (which is the order of magnitude of what can be achieved using classical machine learning algorithms such as random forests) while false alarm decreases from 38.2 to 29.9. This is an excellent result, since improving hit rates by means of random forests usually also results in a slight increase of false alarms.</p>

A Novel Method of Maize Leaf Disease Image Identification Based on a Multichannel Convolutional Neural Network

2018 ◽  
Vol 61 (5) ◽  
pp. 1461-1474 ◽  
Author(s):  
Zhongqi Lin ◽  
Shaomin Mu ◽  
Aiju Shi ◽  
Chao Pang ◽  
Xiaoxiao Sun
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Graphics Processing Units ◽  
High Efficiency ◽  
Saliency Detection ◽  
Machine Learning Algorithms ◽  
Brown Spot ◽  
Maize Leaf ◽  
Leaf Disease ◽  
Fully Connected

Abstract. Traditional methods for detecting maize leaf diseases (such as leaf blight, sooty blotch, brown spot, rust, and purple leaf sheaf) are typically labor-intensive and strongly subjective. With the aim of achieving high accuracy and efficiency in the identification of maize leaf diseases from digital imagery, this article proposes a novel multichannel convolutional neural network (MCNN). The MCNN is composed of an input layer, five convolutional layers, three subsampling layers, three fully connected layers, and an output layer. Using a method that imitates human visual behavior in video saliency detection, the first and second subsampling layers are connected directly with the first fully connected layer. In addition, the mixed modes of pooling and normalization methods, rectified linear units (ReLU), and dropout are introduced to prevent overfitting and gradient diffusion. The learning process corresponding to the network structure is also illustrated. At present, there are no large-scale images of maize leaf disease for use as experimental samples. To test the proposed MCNN, 10,820 RGB images containing five types of disease were collected from maize planting areas in Shandong Province, China. The original images could not be used directly in identification experiments because of noise and irrelevant regions. They were therefore denoised and segmented by homomorphic filtering and region of interest (ROI) segmentation to construct a standard database. A series of experiments on 8 GB graphics processing units (GPUs) showed that the MCNN could achieve an average accuracy of 92.31% and a high efficiency in the identification of maize leaf diseases. The multichannel design and the integration of different innovations proved to be helpful methods for boosting performance. Keywords: Artificial intelligence, Convolutional neural network, Deep learning, Image classification, Machine learning algorithms, Maize leaf disease.

scholarly journals Estimation of Ultrasound Echogenicity Map from B-Mode Images Using Convolutional Neural Network

Sensors ◽  
2020 ◽  
Vol 20 (17) ◽  
pp. 4931
Author(s):  
Che-Chou Shen ◽  
Jui-En Yang
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Imaging System ◽  
Speckle Pattern ◽  
Image Resolution ◽  
Post Processing ◽  
Point Spread ◽  
Spread Function ◽  
In Silico Simulation ◽  
Tissue Structures

In ultrasound B-mode imaging, speckle noises decrease the accuracy of estimation of tissue echogenicity of imaged targets from the amplitude of the echo signals. In addition, since the granular size of the speckle pattern is affected by the point spread function (PSF) of the imaging system, the resolution of B-mode image remains limited, and the boundaries of tissue structures often become blurred. This study proposed a convolutional neural network (CNN) to remove speckle noises together with improvement of image spatial resolution to reconstruct ultrasound tissue echogenicity map. The CNN model is trained using in silico simulation dataset and tested with experimentally acquired images. Results indicate that the proposed CNN method can effectively eliminate the speckle noises in the background of the B-mode images while retaining the contours and edges of the tissue structures. The contrast and the contrast-to-noise ratio of the reconstructed echogenicity map increased from 0.22/2.72 to 0.33/44.14, and the lateral and axial resolutions also improved from 5.9/2.4 to 2.9/2.0, respectively. Compared with other post-processing filtering methods, the proposed CNN method provides better approximation to the original tissue echogenicity by completely removing speckle noises and improving the image resolution together with the capability for real-time implementation.

scholarly journals Discrete Cosine Transformation and Temporal Adjacent Convolutional Neural Network-Based Remaining Useful Life Estimation of Bearings

2020 ◽  
Vol 2020 ◽  
pp. 1-14
Author(s):  
Yu Pang ◽  
Limin Jia ◽  
Zhan Liu
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
High Efficiency ◽  
Remaining Useful Life ◽  
Discrete Cosine Transformation ◽  
Time Frequency ◽  
Cosine Transformation ◽  
Useful Life ◽  
Spectrum Coding ◽  
Low Dimensional

In recent years, several time-frequency representation (TFR) and convolutional neural network- (CNN-) based approaches have been proposed to provide reliable remaining useful life (RUL) estimation for bearings. However, existing methods cannot tackle the spatiotemporal continuity between adjacent TFRs since temporal proposals are considered individually and their temporal dependencies are neglected. In allusion to this problem, a novel prognostic approach based on discrete cosine transformation (DCT) and temporal adjacent convolutional neural network (TACNN) is proposed. Wavelet transform (WT) is applied to effectively map the raw signals to the time frequency domain. Considering the high load and complexity of model computation, bilinear interpolation and DCT algorithm are introduced to convert TFRs into low-dimensional DCT spectrum coding matrix with strong sparsity. Furthermore, the TACNN model is proposed which is capable of learning discriminative features for temporal adjacent DCT spectrum coding matrix. Effectiveness of the proposed method is verified on the PRONOSTIA dataset, and experiment results show that the proposed model is able to realize automatic high-precision estimation of bearings RUL with high efficiency.

scholarly journals Detection of Computer Graphics Using Attention-Based Dual-Branch Convolutional Neural Network from Fused Color Components

Sensors ◽  
2020 ◽  
Vol 20 (17) ◽  
pp. 4743
Author(s):  
Peisong He ◽  
Haoliang Li ◽  
Hongxia Wang ◽  
Ruimei Zhang
Keyword(s):  
Neural Network ◽  
Computer Graphics ◽  
Convolutional Neural Network ◽  
Video Game ◽  
Detection Methods ◽  
Post Processing ◽  
Pass Filter ◽  
Low Pass Filter ◽  
Generalized Patterns ◽  
Color Components

With the development of 3D rendering techniques, people can create photorealistic computer graphics (CG) easily with the advanced software, which is of great benefit to the video game and film industries. On the other hand, the abuse of CGs has threatened the integrity and authenticity of digital images. In the last decade, several detection methods of CGs have been proposed successfully. However, existing methods cannot provide reliable detection results for CGs with the small patch size and post-processing operations. To overcome the above-mentioned limitation, we proposed an attention-based dual-branch convolutional neural network (AD-CNN) to extract robust representations from fused color components. In pre-processing, raw RGB components and their blurred version with Gaussian low-pass filter are stacked together in channel-wise as the input for the AD-CNN, which aims to help the network learn more generalized patterns. The proposed AD-CNN starts with a dual-branch structure where two branches work in parallel and have the identical shallow CNN architecture, except that the first convolutional layer in each branch has various kernel sizes to exploit low-level forensics traces in multi-scale. The output features from each branch are jointly optimized by the attention-based fusion module which can assign the asymmetric weights to different branches automatically. Finally, the fused feature is fed into the following fully-connected layers to obtain final detection results. Comparative and self-analysis experiments have demonstrated the better detection capability and robustness of the proposed detection compared with other state-of-the-art methods under various experimental settings, especially for image patch with the small size and post-processing operations.

Sign in / Sign up

Export Citation Format

Share Document