scholarly journals Identifying Leaf Phenology of Deciduous Broadleaf Forests from PhenoCam Images Using a Convolutional Neural Network Regression Method

2021 ◽  
Vol 13 (12) ◽  
pp. 2331
Author(s):  
Mengying Cao ◽  
Ying Sun ◽  
Xin Jiang ◽  
Ziming Li ◽  
Qinchuan Xin
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Environmental Changes ◽  
Region Of Interest ◽  
Absolute Error ◽  
Leaf Phenology ◽  
Coefficient Of Determination ◽  
Learning Approaches ◽  
The One

Vegetation phenology plays a key role in influencing ecosystem processes and biosphere-atmosphere feedbacks. Digital cameras such as PhenoCam that monitor vegetation canopies in near real-time provide continuous images that record phenological and environmental changes. There is a need to develop methods for automated and effective detection of vegetation dynamics from PhenoCam images. Here we developed a method to predict leaf phenology of deciduous broadleaf forests from individual PhenoCam images using deep learning approaches. We tested four convolutional neural network regression (CNNR) networks on their ability to predict vegetation growing dates based on PhenoCam images at 56 sites in North America. In the one-site experiment, the predicted phenology dated to after the leaf-out events agree well with the observed data, with a coefficient of determination (R2) of nearly 0.999, a root mean square error (RMSE) of up to 3.7 days, and a mean absolute error (MAE) of up to 2.1 days. The method developed achieved lower accuracies in the all-site experiment than in the one-site experiment, and the achieved R2 was 0.843, RMSE was 25.2 days, and MAE was 9.3 days in the all-site experiment. The model accuracy increased when the deep networks used the region of interest images rather than the entire images as inputs. Compared to the existing methods that rely on time series of PhenoCam images for studying leaf phenology, we found that the deep learning method is a feasible solution to identify leaf phenology of deciduous broadleaf forests from individual PhenoCam images.

scholarly journals Real-Time Automated Classification of Sky Conditions Using Deep Learning and Edge Computing

2021 ◽  
Vol 13 (19) ◽  
pp. 3859
Author(s):  
Joby M. Prince Czarnecki ◽  
Sathishkumar Samiappan ◽  
Meilun Zhou ◽  
Cary Daniel McCraine ◽  
Louis L. Wasson
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Image Quality ◽  
Convolutional Neural Network ◽  
Precision Agriculture ◽  
Edge Computing ◽  
Training Data ◽  
Learning Approaches ◽  
Sky Conditions

The radiometric quality of remotely sensed imagery is crucial for precision agriculture applications because estimations of plant health rely on the underlying quality. Sky conditions, and specifically shadowing from clouds, are critical determinants in the quality of images that can be obtained from low-altitude sensing platforms. In this work, we first compare common deep learning approaches to classify sky conditions with regard to cloud shadows in agricultural fields using a visible spectrum camera. We then develop an artificial-intelligence-based edge computing system to fully automate the classification process. Training data consisting of 100 oblique angle images of the sky were provided to a convolutional neural network and two deep residual neural networks (ResNet18 and ResNet34) to facilitate learning two classes, namely (1) good image quality expected, and (2) degraded image quality expected. The expectation of quality stemmed from the sky condition (i.e., density, coverage, and thickness of clouds) present at the time of the image capture. These networks were tested using a set of 13,000 images. Our results demonstrated that ResNet18 and ResNet34 classifiers produced better classification accuracy when compared to a convolutional neural network classifier. The best overall accuracy was obtained by ResNet34, which was 92% accurate, with a Kappa statistic of 0.77. These results demonstrate a low-cost solution to quality control for future autonomous farming systems that will operate without human intervention and supervision.

scholarly journals A Deep Learning-Based Approach for the Detection of Early Signs of Gingivitis in Orthodontic Patients Using Faster Region-Based Convolutional Neural Networks

2020 ◽  
Vol 17 (22) ◽  
pp. 8447
Author(s):  
Dima M. Alalharith ◽  
Hajar M. Alharthi ◽  
Wejdan M. Alghamdi ◽  
Yasmine M. Alsenbel ◽  
Nida Aslam ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Periodontal Disease ◽  
Convolutional Neural Network ◽  
Region Of Interest ◽  
Training Dataset ◽  
Detection Accuracy ◽  
Detection Model ◽  
Art Object ◽  
Orthodontic Patients

Computer-based technologies play a central role in the dentistry field, as they present many methods for diagnosing and detecting various diseases, such as periodontitis. The current study aimed to develop and evaluate the state-of-the-art object detection and recognition techniques and deep learning algorithms for the automatic detection of periodontal disease in orthodontic patients using intraoral images. In this study, a total of 134 intraoral images were divided into a training dataset (n = 107 [80%]) and a test dataset (n = 27 [20%]). Two Faster Region-based Convolutional Neural Network (R-CNN) models using ResNet-50 Convolutional Neural Network (CNN) were developed. The first model detects the teeth to locate the region of interest (ROI), while the second model detects gingival inflammation. The detection accuracy, precision, recall, and mean average precision (mAP) were calculated to verify the significance of the proposed model. The teeth detection model achieved an accuracy, precision, recall, and mAP of 100 %, 100%, 51.85%, and 100%, respectively. The inflammation detection model achieved an accuracy, precision, recall, and mAP of 77.12%, 88.02%, 41.75%, and 68.19%, respectively. This study proved the viability of deep learning models for the detection and diagnosis of gingivitis in intraoral images. Hence, this highlights its potential usability in the field of dentistry and aiding in reducing the severity of periodontal disease globally through preemptive non-invasive diagnosis.

scholarly journals An Efficient Deep Learning Approach to Pneumonia Classification in Healthcare

2019 ◽  
Vol 2019 ◽  
pp. 1-7 ◽  
Author(s):  
Okeke Stephen ◽  
Mangal Sain ◽  
Uchenna Joseph Maduh ◽  
Do-Un Jeong
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Network Model ◽  
Neural Network Model ◽  
Data Augmentation ◽  
Classification Performance ◽  
Learning Approaches ◽  
X Ray ◽  
Chest X Ray

This study proposes a convolutional neural network model trained from scratch to classify and detect the presence of pneumonia from a collection of chest X-ray image samples. Unlike other methods that rely solely on transfer learning approaches or traditional handcrafted techniques to achieve a remarkable classification performance, we constructed a convolutional neural network model from scratch to extract features from a given chest X-ray image and classify it to determine if a person is infected with pneumonia. This model could help mitigate the reliability and interpretability challenges often faced when dealing with medical imagery. Unlike other deep learning classification tasks with sufficient image repository, it is difficult to obtain a large amount of pneumonia dataset for this classification task; therefore, we deployed several data augmentation algorithms to improve the validation and classification accuracy of the CNN model and achieved remarkable validation accuracy.

scholarly journals Detection of Brief Episodes of Atrial Fibrillation Based on Electrocardiomatrix and Convolutional Neural Network

2021 ◽  
Vol 12 ◽  
Author(s):  
Ricardo Salinas-Martínez ◽  
Johannes de Bie ◽  
Nicoletta Marzocchi ◽  
Frida Sandberg
Keyword(s):  
Neural Network ◽  
Atrial Fibrillation ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Thrombus Formation ◽  
Normal Sinus Rhythm ◽  
Morphological Characteristics ◽  
P Wave ◽  
Learning Approaches ◽  
Normal Sinus

Background: Brief episodes of atrial fibrillation (AF) may evolve into longer AF episodes increasing the chances of thrombus formation, stroke, and death. Classical methods for AF detection investigate rhythm irregularity or P-wave absence in the ECG, while deep learning approaches profit from the availability of annotated ECG databases to learn discriminatory features linked to different diagnosis. However, some deep learning approaches do not provide analysis of the features used for classification. This paper introduces a convolutional neural network (CNN) approach for automatic detection of brief AF episodes based on electrocardiomatrix-images (ECM-images) aiming to link deep learning to features with clinical meaning.Materials and Methods: The CNN is trained using two databases: the Long-Term Atrial Fibrillation and the MIT-BIH Normal Sinus Rhythm, and tested on three databases: the MIT-BIH Atrial Fibrillation, the MIT-BIH Arrhythmia, and the Monzino-AF. Detection of AF is done using a sliding window of 10 beats plus 3 s. Performance is quantified using both standard classification metrics and the EC57 standard for arrhythmia detection. Layer-wise relevance propagation analysis was applied to link the decisions made by the CNN to clinical characteristics in the ECG.Results: For all three testing databases, episode sensitivity was greater than 80.22, 89.66, and 97.45% for AF episodes shorter than 15, 30 s, and for all episodes, respectively.Conclusions: Rhythm and morphological characteristics of the electrocardiogram can be learned by a CNN from ECM-images for the detection of brief episodes of AF.

scholarly journals Apple Leaf Disease Identification Through Region-of-Interest-Aware Deep Convolutional Neural Network

2020 ◽  
Vol 64 (2) ◽  
pp. 20507-1-20507-10 ◽  
Author(s):  
Hee-Jin Yu ◽  
Chang-Hwan Son ◽  
Dong Hyuk Lee
Keyword(s):  
Neural Network ◽  
Feature Extraction ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Leaf Area ◽  
Region Of Interest ◽  
Deep Convolutional Neural Network ◽  
Discriminative Power ◽  
Feature Map ◽  
Traditional Approaches

Abstract Traditional approaches for the identification of leaf diseases involve the use of handcrafted features such as colors and textures for feature extraction. Therefore, these approaches may have limitations in extracting abundant and discriminative features. Although deep learning approaches have been recently introduced to overcome the shortcomings of traditional approaches, existing deep learning models such as VGG and ResNet have been used in these approaches. This indicates that the approach can be further improved to increase the discriminative power because the spatial attention mechanism to predict the background and spot areas (i.e., local areas with leaf diseases) has not been considered. Therefore, a new deep learning architecture, which is hereafter referred to as region-of-interest-aware deep convolutional neural network (ROI-aware DCNN), is proposed to make deep features more discriminative and increase classification performance. The primary idea is that leaf disease symptoms appear in leaf area, whereas the background region does not contain useful information regarding leaf diseases. To realize this, two subnetworks are designed. One subnetwork is the ROI subnetwork to provide more discriminative features from the background, leaf areas, and spot areas in the feature map. The other subnetwork is the classification subnetwork to increase the classification accuracy. To train the ROI-aware DCNN, the ROI subnetwork is first learned with a new image set containing the ground truth images where the background, leaf area, and spot area are divided. Subsequently, the entire network is trained in an end-to-end manner to connect the ROI subnetwork with the classification subnetwork through a concatenation layer. The experimental results confirm that the proposed ROI-aware DCNN can increase the discriminative power by predicting the areas in the feature map that are more important for leaf diseases identification. The results prove that the proposed method surpasses conventional state-of-the-art methods such as VGG, ResNet, SqueezeNet, bilinear model, and multiscale-based deep feature extraction and pooling.

scholarly journals Estimating Cervical Vertebral Maturation with a Lateral Cephalogram Using the Convolutional Neural Network

2021 ◽  
Vol 10 (22) ◽  
pp. 5400
Author(s):  
Eun-Gyeong Kim ◽  
Il-Seok Oh ◽  
Jeong-Eun So ◽  
Junhyeok Kang ◽  
Van Nhat Thang Le ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Region Of Interest ◽  
Bone Maturation ◽  
Lateral Cephalogram ◽  
Step Model ◽  
Lateral Cephalograms ◽  
One Step ◽  
Cervical Vertebral Maturation

Recently, the estimation of bone maturation using deep learning has been actively conducted. However, many studies have considered hand–wrist radiographs, while a few studies have focused on estimating cervical vertebral maturation (CVM) using lateral cephalograms. This study proposes the use of deep learning models for estimating CVM from lateral cephalograms. As the second, third, and fourth cervical vertebral regions (denoted as C2, C3, and C4, respectively) are considerably smaller than the whole image, we propose a stepwise segmentation-based model that focuses on the C2–C4 regions. We propose three convolutional neural network-based classification models: a one-step model with only CVM classification, a two-step model with region of interest (ROI) detection and CVM classification, and a three-step model with ROI detection, cervical segmentation, and CVM classification. Our dataset contains 600 lateral cephalogram images, comprising six classes with 100 images each. The three-step segmentation-based model produced the best accuracy (62.5%) compared to the models that were not segmentation-based.

Estimation of structural response using convolutional neural network: application to the Suramadu bridge

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Arya Panji Pamuncak ◽  
Mohammad Reza Salami ◽  
Augusta Adha ◽  
Bambang Budiono ◽  
Irwanda Laory
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Convolutional Neural Network ◽  
Structural Response ◽  
Force Sensor ◽  
Absolute Error ◽  
Percentage Error ◽  
Learning Approaches ◽  
Content Type ◽  
Cable Force

PurposeStructural health monitoring (SHM) has gained significant attention due to its capability in providing support for efficient and optimal bridge maintenance activities. However, despite the promising potential, the effectiveness of SHM system might be hindered by unprecedented factors that impact the continuity of data collection. This research presents a framework utilising convolutional neural network (CNN) for estimating structural response using environmental variations.Design/methodology/approachThe CNN framework is validated using monitoring data from the Suramadu bridge monitoring system. Pre-processing is performed to transform the data into data frames, each containing a sequence of data. The data frames are divided into training, validation and testing sets. Both the training and validation sets are employed to train the CNN models while the testing set is utilised for evaluation by calculating error metrics such as mean absolute error (MAE), mean absolute percentage error (MAPE) and root mean square error (RMSE). Comparison with other machine learning approaches is performed to investigate the effectiveness of the CNN framework.FindingsThe CNN models are able to learn the trend of cable force sensor measurements with the ranges of MAE between 10.23 kN and 19.82 kN, MAPE between 0.434% and 0.536% and RMSE between 13.38 kN and 25.32 kN. In addition, the investigation discovers that the CNN-based model manages to outperform other machine learning models.Originality/valueThis work investigates, for the first time, how cable stress can be estimated using temperature variations. The study presents the first application of 1-D CNN regressor on data collected from a full-scale bridge. This work also evaluates the comparison between CNN regressor and other techniques, such as artificial neutral network (ANN) and linear regression, in estimating bridge cable stress, which has not been performed previously.

scholarly journals Deep Learning Approaches on Defect Detection in High Resolution Aerial Images of Insulators

Sensors ◽  
2021 ◽  
Vol 21 (4) ◽  
pp. 1033
Author(s):  
Qiaodi Wen ◽  
Ziqi Luo ◽  
Ruitao Chen ◽  
Yifan Yang ◽  
Guofa Li
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
High Resolution ◽  
Convolutional Neural Network ◽  
Target Detection ◽  
Defect Detection ◽  
Region Of Interest ◽  
Aerial Images ◽  
Detection Methods ◽  
Complex Background

By detecting the defect location in high-resolution insulator images collected by unmanned aerial vehicle (UAV) in various environments, the occurrence of power failure can be timely detected and the caused economic loss can be reduced. However, the accuracies of existing detection methods are greatly limited by the complex background interference and small target detection. To solve this problem, two deep learning methods based on Faster R-CNN (faster region-based convolutional neural network) are proposed in this paper, namely Exact R-CNN (exact region-based convolutional neural network) and CME-CNN (cascade the mask extraction and exact region-based convolutional neural network). Firstly, we proposed an Exact R-CNN based on a series of advanced techniques including FPN (feature pyramid network), cascade regression, and GIoU (generalized intersection over union). RoI Align (region of interest align) is introduced to replace RoI pooling (region of interest pooling) to address the misalignment problem, and the depthwise separable convolution and linear bottleneck are introduced to reduce the computational burden. Secondly, a new pipeline is innovatively proposed to improve the performance of insulator defect detection, namely CME-CNN. In our proposed CME-CNN, an insulator mask image is firstly generated to eliminate the complex background by using an encoder-decoder mask extraction network, and then the Exact R-CNN is used to detect the insulator defects. The experimental results show that our proposed method can effectively detect insulator defects, and its accuracy is better than the examined mainstream target detection algorithms.

scholarly journals Deep learning in geodesy

2021 ◽  
Author(s):  
Omid Memarian Sorkhabi
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Spatial Resolution ◽  
Absolute Error ◽  
Three Solutions ◽  
Resolution Problem

Abstract Deep learning (DL) can be a way to automate the analysis of predictions. DL algorithms are in the hierarchy of increasing complexity and abstraction while traditional machine learning is linear. In this study, the downscaling of the GRACE-FO satellite was investigated using a convolutional neural network (CNN). Three solutions were used for downscaling with CNN. Down-scaling accuracy is estimated to be 0.1 degree and its absolute error is 1 mm. The results show that this method can improve the GRACE-FO spatial resolution problem with higher efficiency and make it easier to analyze the results. Also, DL can solve many geodesy problems.

scholarly journals Dog Breed Prediction using Convolutional Neural Network

2020 ◽  
Vol 9 (5) ◽  
pp. 318-322
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Image Classification ◽  
Convolutional Neural Networks ◽  
Graphical Representation ◽  
Outcome Analysis ◽  
Dog Breed ◽  
The One

Deep learning gives the strength on the way to train algorithms model that can handle the difficulties of info classification also prediction grounded on totally on arising information as of raw information. Convolutional Neural Networks (CNNs) gives single often used method for image classification and detection. In this exertion, we define a CNNbased approach for spotting dogs in per chance complex images and due to this fact reflect inconsideration on the identification of the one of kinds of dog breed. The experimental outcome analysis supported the standard metrics and thus the graphical representation confirms that the algorithm (CNN) gives good analysis accuracy for all the tested datasets

Sign in / Sign up

Export Citation Format

Share Document