scholarly journals Development of a deep neural network for predicting 6-hour average PM<sub>2.5</sub> concentrations up to two subsequent days using various training data

2021 ◽  
Author(s):  
Jeong-Beom Lee ◽  
Jae-Bum Lee ◽  
Youn-Seo Koo ◽  
Hee-Yong Kwon ◽  
Min-Hyeok Choi ◽  
...  
Keyword(s):  
Neural Network ◽  
Air Quality ◽  
Deep Neural Network ◽  
Model Performance ◽  
Prediction Performance ◽  
Training Data ◽  
Forecasting Model ◽  
Observation Data ◽  
Forecast Data ◽  
Air Quality Forecasting

Abstract. This study aims to develop a deep neural network (DNN) model as an artificial neural network (ANN) for the prediction of 6-hour average fine particulate matter (PM2.5) concentrations for a three-day period—the day of prediction (D+0), one day after prediction (D+1) and two days after prediction (D+2)—using observation data and forecast data obtained via numerical models. The performance of the DNN model was comparatively evaluated against that of the currently operational Community Multiscale Air Quality (CMAQ) modelling system for air quality forecasting in South Korea. In addition, the effect on predictive performance of the DNN model on using different training data was analyzed. For the D+0 forecast, the DNN model performance was superior to that of the CMAQ model, and there was no significant dependence on the training data. For the D+1 and D+2 forecasts, the DNN model that used the observation and forecast data (DNN-ALL) outperformed the CMAQ model. The root-mean-squared error (RMSE) of DNN-ALL was lower than that of the CMAQ model by 2.2 μgm−3, and 3.0 μgm−3 for the D+1 and D+2 forecasts, respectively, because the overprediction of higher concentrations was curtailed. An IOA increase of 0.46 for D+1 prediction and 0.59 for the D+2 prediction was observed in case of the DNN-ALL model compared to the IOA of the DNN model that used only observation data (DNN-OBS). In additionally, An RMSE decrease of 7.2 μgm−3 for the D+1 prediction and 6.3 μgm−3 for the D+2 prediction was observed in case of the DNN-ALL model, compared to the RMSE of DNN-OBS, indicating that the inclusion of forecast data in the training data greatly affected the DNN model performance. Considering the prediction of the 6-hour average PM2.5 concentration, the 8.8 μgm−3 RMSE of the DNN-ALL model was 2.7 μgm−3 lower than that of the CMAQ model, indicating the superior prediction performance of the former. These results suggest that the DNN model could be utilized as a better-performing air quality forecasting model than the CMAQ, and that observation data plays an important role in determining the prediction performance of the DNN model for D+0 forecasting, while prediction data does the same for D+1 and D+2 forecasting. The use of the proposed DNN model as a forecasting model may result in a reduction in the economic losses caused by pollution-mitigation policies and aid better protection of public health.

scholarly journals Robust Approach to Supervised Deep Neural Network Training for Real-Time Object Classification in Cluttered Indoor Environment

2021 ◽  
Vol 11 (15) ◽  
pp. 7148
Author(s):  
Bedada Endale ◽  
Abera Tullu ◽  
Hayoung Shi ◽  
Beom-Soo Kang
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Real Time ◽  
Network Architecture ◽  
Input Data ◽  
Deep Neural Network ◽  
Data Augmentation ◽  
Object Classification ◽  
Training Data ◽  
Gradient Descent Algorithm

Unmanned aerial vehicles (UAVs) are being widely utilized for various missions: in both civilian and military sectors. Many of these missions demand UAVs to acquire artificial intelligence about the environments they are navigating in. This perception can be realized by training a computing machine to classify objects in the environment. One of the well known machine training approaches is supervised deep learning, which enables a machine to classify objects. However, supervised deep learning comes with huge sacrifice in terms of time and computational resources. Collecting big input data, pre-training processes, such as labeling training data, and the need for a high performance computer for training are some of the challenges that supervised deep learning poses. To address these setbacks, this study proposes mission specific input data augmentation techniques and the design of light-weight deep neural network architecture that is capable of real-time object classification. Semi-direct visual odometry (SVO) data of augmented images are used to train the network for object classification. Ten classes of 10,000 different images in each class were used as input data where 80% were for training the network and the remaining 20% were used for network validation. For the optimization of the designed deep neural network, a sequential gradient descent algorithm was implemented. This algorithm has the advantage of handling redundancy in the data more efficiently than other algorithms.

scholarly journals Performance Evaluation of Deep CNN-Based Crack Detection and Localization Techniques for Concrete Structures

Sensors ◽  
2021 ◽  
Vol 21 (5) ◽  
pp. 1688
Author(s):  
Luqman Ali ◽  
Fady Alnajjar ◽  
Hamad Al Jassmi ◽  
Munkhjargal Gochoo ◽  
Wasif Khan ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Crack Detection ◽  
Concrete Structures ◽  
Model Performance ◽  
Training Data ◽  
Computational Time ◽  
Data Heterogeneity ◽  
Public Datasets ◽  
Detection And Localization

This paper proposes a customized convolutional neural network for crack detection in concrete structures. The proposed method is compared to four existing deep learning methods based on training data size, data heterogeneity, network complexity, and the number of epochs. The performance of the proposed convolutional neural network (CNN) model is evaluated and compared to pretrained networks, i.e., the VGG-16, VGG-19, ResNet-50, and Inception V3 models, on eight datasets of different sizes, created from two public datasets. For each model, the evaluation considered computational time, crack localization results, and classification measures, e.g., accuracy, precision, recall, and F1-score. Experimental results demonstrated that training data size and heterogeneity among data samples significantly affect model performance. All models demonstrated promising performance on a limited number of diverse training data; however, increasing the training data size and reducing diversity reduced generalization performance, and led to overfitting. The proposed customized CNN and VGG-16 models outperformed the other methods in terms of classification, localization, and computational time on a small amount of data, and the results indicate that these two models demonstrate superior crack detection and localization for concrete structures.

scholarly journals Ensemble Predictions of Air Pollutants in China in 2013 for Health Effects Studies Using WRF/CMAQ Modeling System with Four Emission Inventories

2017 ◽  
Author(s):  
Jianlin Hu ◽  
Xun Li ◽  
Lin Huang ◽  
Qi Ying ◽  
Qiang Zhang ◽  
...  
Keyword(s):  
Air Quality ◽  
Health Effects ◽  
Air Pollutants ◽  
Emission Inventory ◽  
Model Performance ◽  
Observation Data ◽  
Emission Inventories ◽  
Air Quality Model ◽  
Quality Model ◽  
Future Health

Abstract. Accurate exposure estimates are required for health effects analyses of severe air pollution in China. Chemical transport models (CTMs) are widely used tools to provide detailed information of spatial distribution, chemical composition, particle size fractions, and source origins of pollutants. The accuracy of CTMs' predictions in China is largely affected by the uncertainties of public available emission inventories. The Community Multi-scale Air Quality model (CMAQ) with meteorological inputs from the Weather Research and Forecasting model (WRF) were used in this study to simulate air quality in China in 2013. Four sets of simulations were conducted with four different anthropogenic emission inventories, including the Multi-resolution Emission Inventory for China (MEIC), the Emission Inventory for China by School of Environment at Tsinghua University (SOE), the Emissions Database for Global Atmospheric Research (EDGAR), and the Regional Emission inventory in Asia version 2 (REAS2). Model performance was evaluated against available observation data from 422 sites in 60 cities across China. Model predictions of O3 and PM2.5 with the four inventories generally meet the criteria of model performance, but difference exists in different pollutants and different regions among the inventories. Ensemble predictions were calculated by linearly combining the results from different inventories under the constraint that sum of the squared errors between the ensemble results and the observations from all the cities was minimized. The ensemble annual concentrations show improved agreement with observations in most cities. The mean fractional bias (MFB) and mean fractional errors (MFE) of the ensemble predicted annual PM2.5 at the 60 cities are −0.11 and 0.24, respectively, which are better than the MFB (−0.25–−0.16) and MFE (0.26–0.31) of individual simulations. The ensemble annual 1-hour peak O3 (O3-1 h) concentrations are also improved, with mean normalized bias (MNB) of 0.03 and mean normalized errors (MNE) of 0.14, compared to MNB of 0.06–0.19 and MNE of 0.16–0.22 of the individual predictions. The ensemble predictions agree better with observations with daily, monthly, and annual averaging times in all regions of China for both PM2.5 and O3-1 h. The study demonstrates that ensemble predictions by combining predictions from individual emission inventories can improve the accuracy of predicted temporal and spatial distributions of air pollutants. This study is the first ensemble model study in China using multiple emission inventories and the results are publicly available for future health effects studies.

scholarly journals DANNP: an efficient artificial neural network pruning tool

2017 ◽  
Vol 3 ◽  
pp. e137 ◽  
Author(s):  
Mona Alshahrani ◽  
Othman Soufan ◽  
Arturo Magana-Mora ◽  
Vladimir B. Bajic
Keyword(s):  
Neural Network ◽  
State Of The Art ◽  
Model Performance ◽  
Training Data ◽  
Classification Problems ◽  
Link Type ◽  
On Line ◽  
Pruning Algorithms ◽  
Artificial Neural ◽  
The Impact

Background Artificial neural networks (ANNs) are a robust class of machine learning models and are a frequent choice for solving classification problems. However, determining the structure of the ANNs is not trivial as a large number of weights (connection links) may lead to overfitting the training data. Although several ANN pruning algorithms have been proposed for the simplification of ANNs, these algorithms are not able to efficiently cope with intricate ANN structures required for complex classification problems. Methods We developed DANNP, a web-based tool, that implements parallelized versions of several ANN pruning algorithms. The DANNP tool uses a modified version of the Fast Compressed Neural Network software implemented in C++ to considerably enhance the running time of the ANN pruning algorithms we implemented. In addition to the performance evaluation of the pruned ANNs, we systematically compared the set of features that remained in the pruned ANN with those obtained by different state-of-the-art feature selection (FS) methods. Results Although the ANN pruning algorithms are not entirely parallelizable, DANNP was able to speed up the ANN pruning up to eight times on a 32-core machine, compared to the serial implementations. To assess the impact of the ANN pruning by DANNP tool, we used 16 datasets from different domains. In eight out of the 16 datasets, DANNP significantly reduced the number of weights by 70%–99%, while maintaining a competitive or better model performance compared to the unpruned ANN. Finally, we used a naïve Bayes classifier derived with the features selected as a byproduct of the ANN pruning and demonstrated that its accuracy is comparable to those obtained by the classifiers trained with the features selected by several state-of-the-art FS methods. The FS ranking methodology proposed in this study allows the users to identify the most discriminant features of the problem at hand. To the best of our knowledge, DANNP (publicly available at www.cbrc.kaust.edu.sa/dannp) is the only available and on-line accessible tool that provides multiple parallelized ANN pruning options. Datasets and DANNP code can be obtained at www.cbrc.kaust.edu.sa/dannp/data.php and https://doi.org/10.5281/zenodo.1001086.

scholarly journals Deep Neural Network for Predicting Ore Production by Truck-Haulage Systems in Open-Pit Mines

2020 ◽  
Vol 10 (5) ◽  
pp. 1657 ◽  
Author(s):  
Jieun Baek ◽  
Yosoon Choi
Keyword(s):  
Neural Network ◽  
Prediction Accuracy ◽  
Deep Neural Network ◽  
Training Data ◽  
Open Pit ◽  
Percentage Error ◽  
Open Pit Mines ◽  
Determination Coefficient ◽  
Packet Data ◽  
Hidden Layer

This paper proposes a deep neural network (DNN)-based method for predicting ore production by truck-haulage systems in open-pit mines. The proposed method utilizes two DNN models that are designed to predict ore production during the morning and afternoon haulage sessions, respectively. The configuration of the input nodes of the DNN models is based on truck-haulage conditions and corresponding operation times. To verify the efficacy of the proposed method, training data for the DNN models were generated by processing packet data collected over the two-month period December 2018 to January 2019. Subsequently, following training under different hidden-layer conditions, it was observed that the prediction accuracy of morning ore production was highest when the number of hidden layers and number of corresponding nodes were four and 50, respectively. The corresponding values of the determination coefficient and mean absolute percentage error (MAPE) were 0.99% and 4.78%, respectively. Further, the prediction accuracy of afternoon ore production was highest when the number of hidden layers was four and the corresponding number of nodes was 50. This yielded determination coefficient and MAPE values of 0.99% and 5.26%, respectively.

scholarly journals An Ultrashort-Term Net Load Forecasting Model Based on Phase Space Reconstruction and Deep Neural Network

2019 ◽  
Vol 9 (7) ◽  
pp. 1487 ◽  
Author(s):  
Fei Mei ◽  
Qingliang Wu ◽  
Tian Shi ◽  
Jixiang Lu ◽  
Yi Pan ◽  
...  
Keyword(s):  
Neural Network ◽  
Phase Space ◽  
Deep Neural Network ◽  
Time Series Data ◽  
Load Forecasting ◽  
Phase Space Reconstruction ◽  
Series Data ◽  
Forecasting Model ◽  
Model Based ◽  
Net Load

Recently, a large number of distributed photovoltaic (PV) power generations have been connected to the power grid, which resulted in an increased fluctuation of the net load. Therefore, load forecasting has become more difficult. Considering the characteristics of the net load, an ultrashort-term forecasting model based on phase space reconstruction and deep neural network (DNN) is proposed, which can be divided into two steps. First, the phase space reconstruction of the net load time series data is performed using the C-C method. Second, the reconstructed data is fitted by the DNN to obtain the predicted value of the net load. The performance of this model is verified using real data. The accuracy is high in forecasting the net load under high PV penetration rate and different weather conditions.

scholarly journals A DBN-Based Deep Neural Network Model with Multitask Learning for Online Air Quality Prediction

2019 ◽  
Vol 2019 ◽  
pp. 1-9 ◽  
Author(s):  
Jiangeng Li ◽  
Xingyang Shao ◽  
Rihui Sun
Keyword(s):  
Neural Network ◽  
Air Quality ◽  
Network Model ◽  
Neural Network Model ◽  
Prediction Accuracy ◽  
Deep Neural Network ◽  
Multitask Learning ◽  
Air Pollutant ◽  
Quality Prediction ◽  
Air Quality Prediction

To avoid the adverse effects of severe air pollution on human health, we need accurate real-time air quality prediction. In this paper, for the purpose of improve prediction accuracy of air pollutant concentration, a deep neural network model with multitask learning (MTL-DBN-DNN), pretrained by a deep belief network (DBN), is proposed for forecasting of nonlinear systems and tested on the forecast of air quality time series. MTL-DBN-DNN model can solve several related prediction tasks at the same time by using shared information contained in the training data of different tasks. In the model, DBN is used to learn feature representations. Each unit in the output layer is connected to only a subset of units in the last hidden layer of DBN. Such connection effectively avoids the problem that fully connected networks need to juggle the learning of each task while being trained, so that the trained networks cannot get optimal prediction accuracy for each task. The sliding window is used to take the recent data to dynamically adjust the parameters of the MTL-DBN-DNN model. The MTL-DBN-DNN model is evaluated with a dataset from Microsoft Research. Comparison with multiple baseline models shows that the proposed MTL-DBN-DNN achieve state-of-art performance on air pollutant concentration forecasting.

Sign in / Sign up

Export Citation Format

Share Document