scholarly journals A Machine Learning Approach for Improving Near-Real-Time Satellite-Based Rainfall Estimates by Integrating Soil Moisture

2019 ◽  
Vol 11 (19) ◽  
pp. 2221 ◽  
Author(s):  
Ashish Kumar ◽  
RAAJ Ramsankaran ◽  
Luca Brocca ◽  
Francisco Munoz-Arriola
Keyword(s):  
Soil Moisture ◽  
Real Time ◽  
Tropical Rainfall Measuring Mission ◽  
Integrated Approach ◽  
Support Vector ◽  
Godavari River ◽  
Statistical Measures ◽  
Novel Approach ◽  
Rainfall Estimates

Near-real-time (NRT) satellite-based rainfall estimates (SREs) are a viable option for flood/drought monitoring. However, SREs have often been associated with complex and nonlinear errors. One way to enhance the quality of SREs is to use soil moisture information. Few studies have indicated that soil moisture information can be used to improve the quality of SREs. Nowadays, satellite-based soil moisture products are becoming available at desired spatial and temporal resolutions on an NRT basis. Hence, this study proposes an integrated approach to improve NRT SRE accuracy by combining it with NRT soil moisture through a nonlinear support vector machine-based regression (SVR) model. To test this novel approach, Ashti catchment, a sub-basin of Godavari river basin, India, is chosen. Tropical Rainfall Measuring Mission (TRMM) Multisatellite Precipitation Analysis (TMPA)-based NRT SRE 3B42RT and Advanced Scatterometer-derived NRT soil moisture are considered in the present study. The performance of the 3B42RT and the corrected product are assessed using different statistical measures such as correlation coefficient (CC), bias, and root mean square error (RMSE), for the monsoon seasons of 2012–2015. A detailed spatial analysis of these measures and their variability across different rainfall intensity classes are also presented. Overall, the results revealed significant improvement in the corrected product compared to 3B42RT (except CC) across the catchment. Particularly, for light and moderate rainfall classes, the corrected product showed the highest improvement (except CC). On the other hand, the corrected product showed limited performance for the heavy rainfall class. These results demonstrate that the proposed approach has potential to enhance the quality of NRT SRE through the use of NRT satellite-based soil moisture estimates.

scholarly journals Synergetic Use of Sentinel-1 and Sentinel-2 Data for Soil Moisture Mapping at Plot Scale

2018 ◽  
Vol 10 (8) ◽  
pp. 1285 ◽  
Author(s):  
Reza Attarzadeh ◽  
Jalal Amini ◽  
Claudia Notarnicola ◽  
Felix Greifeneder
Keyword(s):  
Soil Moisture ◽  
Optical Data ◽  
Estimation Accuracy ◽  
Support Vector ◽  
Practical Applications ◽  
Initial Stage ◽  
Object Based ◽  
Single Polarization ◽  
Selection Of

This paper presents an approach for retrieval of soil moisture content (SMC) by coupling single polarization C-band synthetic aperture radar (SAR) and optical data at the plot scale in vegetated areas. The study was carried out at five different sites with dominant vegetation cover located in Kenya. In the initial stage of the process, different features are extracted from single polarization mode (VV polarization) SAR and optical data. Subsequently, proper selection of the relevant features is conducted on the extracted features. An advanced state-of-the-art machine learning regression approach, the support vector regression (SVR) technique, is used to retrieve soil moisture. This paper takes a new look at soil moisture retrieval in vegetated areas considering the needs of practical applications. In this context, we tried to work at the object level instead of the pixel level. Accordingly, a group of pixels (an image object) represents the reality of the land cover at the plot scale. Three approaches, a pixel-based approach, an object-based approach, and a combination of pixel- and object-based approaches, were used to estimate soil moisture. The results show that the combined approach outperforms the other approaches in terms of estimation accuracy (4.94% and 0.89 compared to 6.41% and 0.62 in terms of root mean square error (RMSE) and R2), flexibility on retrieving the level of soil moisture, and better quality of visual representation of the SMC map.

Improving Real-Time Drilling Data Quality Using Artificial Intelligence and Machine Learning Techniques

2021 ◽  
Author(s):  
S. H. Al Gharbi ◽  
A. A. Al-Majed ◽  
A. Abdulraheem ◽  
S. Patil ◽  
S. M. Elkatatny
Keyword(s):  
Artificial Intelligence ◽  
Machine Learning ◽  
Data Quality ◽  
Real Time ◽  
Input Data ◽  
Support Vector ◽  
The Real ◽  
Drilling Data ◽  
Drilling Operations

Abstract Due to high demand for energy, oil and gas companies started to drill wells in remote areas and unconventional environments. This raised the complexity of drilling operations, which were already challenging and complex. To adapt, drilling companies expanded their use of the real-time operation center (RTOC) concept, in which real-time drilling data are transmitted from remote sites to companies’ headquarters. In RTOC, groups of subject matter experts monitor the drilling live and provide real-time advice to improve operations. With the increase of drilling operations, processing the volume of generated data is beyond a human's capability, limiting the RTOC impact on certain components of drilling operations. To overcome this limitation, artificial intelligence and machine learning (AI/ML) technologies were introduced to monitor and analyze the real-time drilling data, discover hidden patterns, and provide fast decision-support responses. AI/ML technologies are data-driven technologies, and their quality relies on the quality of the input data: if the quality of the input data is good, the generated output will be good; if not, the generated output will be bad. Unfortunately, due to the harsh environments of drilling sites and the transmission setups, not all of the drilling data is good, which negatively affects the AI/ML results. The objective of this paper is to utilize AI/ML technologies to improve the quality of real-time drilling data. The paper fed a large real-time drilling dataset, consisting of over 150,000 raw data points, into Artificial Neural Network (ANN), Support Vector Machine (SVM) and Decision Tree (DT) models. The models were trained on the valid and not-valid datapoints. The confusion matrix was used to evaluate the different AI/ML models including different internal architectures. Despite the slowness of ANN, it achieved the best result with an accuracy of 78%, compared to 73% and 41% for DT and SVM, respectively. The paper concludes by presenting a process for using AI technology to improve real-time drilling data quality. To the author's knowledge based on literature in the public domain, this paper is one of the first to compare the use of multiple AI/ML techniques for quality improvement of real-time drilling data. The paper provides a guide for improving the quality of real-time drilling data.

Real-Time Detection System of Soil Moisture Based on GPRS

2011 ◽  
Vol 464 ◽  
pp. 175-178
Author(s):  
Rong Biao Zhang ◽  
Jing Jing Guo ◽  
Qi Wang ◽  
Lei Zhang ◽  
Xian Lin Wang
Keyword(s):  
Soil Moisture ◽  
Real Time ◽  
Detection System ◽  
Field Tests ◽  
Support Vector ◽  
Calibration Model ◽  
Vector Machines ◽  
Moisture Detection ◽  
Software And Hardware ◽  
Seamless Connection

Real-time monitoring of soil moisture is essential for agricultural production. In this paper, an improved system is designed based on GPRS technology for real-time detecting soil moisture, a salinity calibration model is established based on Least Squares Support Vector Machines on MatLAB (LS-SVMlab) for improving detection precision. The transmission of soil moisture information is the key technology of the system, by software and hardware design we have solved the problems of data congestion, off-line, and moving the monitoring terminal at any time, which still restrict the application of GPRS in soil moisture detection. Field tests show that the system can realize seamless connection between the collection nodes and remote host, and acquire soil moisture accurately. Simultaneously, the time of re-networking has been shortened greatly.

scholarly journals Evaluating TMPA Rainfall over the Sparsely Gauged East African Rift

2018 ◽  
Vol 19 (9) ◽  
pp. 1507-1528 ◽  
Author(s):  
Elise Monsieurs ◽  
Dalia Bach Kirschbaum ◽  
Jackson Tan ◽  
Jean-Claude Maki Mateso ◽  
Liesbet Jacobs ◽  
...  
Keyword(s):  
Real Time ◽  
Spatial Scales ◽  
Rainfall Variability ◽  
Tropical Rainfall Measuring Mission ◽  
East African Rift ◽  
East African ◽  
High Rainfall ◽  
Two Factors ◽  
African Rift ◽  
Rainfall Estimates

Abstract Accurate precipitation data are fundamental for understanding and mitigating the disastrous effects of many natural hazards in mountainous areas. Floods and landslides, in particular, are potentially deadly events that can be mitigated with advanced warning, but accurate forecasts require timely estimation of precipitation, which is problematic in regions such as tropical Africa with limited gauge measurements. Satellite rainfall estimates (SREs) are of great value in such areas, but rigorous validation is required to identify the uncertainties linked to SREs for hazard applications. This paper presents results of an unprecedented record of gauge data in the western branch of the East African Rift, with temporal resolutions ranging from 30 min to 24 h and records from 1998 to 2018. These data were used to validate the Tropical Rainfall Measuring Mission (TRMM) Multisatellite Precipitation Analysis (TMPA) research version and near-real-time products for 3-hourly, daily, and monthly rainfall accumulations, over multiple spatial scales. Results indicate that there are at least two factors that led to the underestimation of TMPA at the regional level: complex topography and high rainfall intensities. The TMPA near-real-time product shows overall stronger rainfall underestimations but lower absolute errors and a better performance at higher rainfall intensities compared to the research version. We found area-averaged TMPA rainfall estimates relatively more suitable in order to move toward regional hazard assessment, compared to data from scarcely distributed gauges with limited representativeness in the context of high rainfall variability.

Automatic evaluation of online learning interaction content using domain concepts

2020 ◽  
Vol 38 (3) ◽  
pp. 421-445
Author(s):  
Di Wu ◽  
Lei Wu ◽  
Alexis Palmer ◽  
Dr Kinshuk ◽  
Peng Zhou
Keyword(s):  
Online Learning ◽  
Online Course ◽  
Support Vector ◽  
Content Type ◽  
Educational Domain ◽  
Novel Approach ◽  
Vector Machines ◽  
Quality Dimensions ◽  
Supporting Teachers

Purpose Interaction content is created during online learning interaction for the exchanged information to convey experience and share knowledge. Prior studies have mainly focused on the quantity of online learning interaction content (OLIC) from the perspective of types or frequency, resulting in a limited analysis of the quality of OLIC. Domain concepts as the highest form of interaction are shown as entities or things that are particularly relevant to the educational domain of an online course. The purpose of this paper is to explore a new method to evaluate the quality of OLIC using domain concepts. Design/methodology/approach This paper proposes a novel approach to automatically evaluate the quality of OLIC regarding relevance, completeness and usefulness. A sample of OLIC corpus is classified and evaluated based on domain concepts and textual features. Findings Experimental results show that random forest classifiers not only outperform logistic regression and support vector machines but also their performance is improved by considering the quality dimensions of relevance and completeness. In addition, domain concepts contribute to improving the performance of evaluating OLIC. Research limitations/implications This paper adopts a limited sample to train the classification models. It has great benefits in monitoring students’ knowledge performance, supporting teachers’ decision-making and even enhancing the efficiency of school management. Originality/value This study extends the research of domain concepts in quality evaluation, especially in the online learning domain. It also has great potential for other domains.

Using Eye-Tracking and Support Vector Machine to Measure Learning Attention in eLearning

2013 ◽  
Vol 311 ◽  
pp. 9-14 ◽  
Author(s):  
Chien Hung Liu ◽  
Po Yin Chang ◽  
Chun Yuan Huang
Keyword(s):  
Support Vector Machine ◽  
Learning Environment ◽  
Unsupervised Learning ◽  
Real Time ◽  
Feedback System ◽  
Integrated Approach ◽  
Support Vector ◽  
Region Detection ◽  
Volumetric Features ◽  
Finite State

For eLearning, how to naturally measure the learning attention of students with lower cost devices in an unsupervised learning environment is a crucial issue. Students often far away and out of teachers’ control in above situation which may cause students do not have strong learning motivation and might feel fatigued and inattentive for learning. A real-time and naturally learning attention measure approach can support instructor to better control the learning attention of students in unsupervised learning environment. This paper proposes an integrated approach, named Real-time Learning Attention Feedback System (RLAFS) which could naturally measure learning attention in unsupervised learning environments. The system architecture of RLAFS consists with three layers: first layer is Image preprocessing layer, which is responsible for image processing and motion detection. Second is eyebrow region detection layer, which is focus on the features of face and eyes capturing and positioning. Classifier layer is the third layer, in which integral image, volumetric features and finite-state-machine are used to capture the current state of learning attention of students. Consequently, support vector machine is utilized to classify the level of learning attention. The experiments are conducted in an unsupervised environment, and results showed RLAFS is a promising approach which can naturally measure learning attention and has a significant impact on learning efficient.

scholarly journals Assimilation of SMOS soil moisture into a distributed hydrological model and impacts on the water cycle variables over the Ouémé catchment in Benin

2016 ◽  
Vol 20 (7) ◽  
pp. 2827-2840 ◽  
Author(s):  
Delphine J. Leroux ◽  
Thierry Pellarin ◽  
Théo Vischel ◽  
Jean-Martial Cohard ◽  
Tania Gascon ◽  
...  
Keyword(s):  
Soil Moisture ◽  
Real Time ◽  
Water Table ◽  
Hydrological Model ◽  
Water Cycle ◽  
Tropical Rainfall Measuring Mission ◽  
Water Table Depth ◽  
Distributed Hydrological Model ◽  
Model Soil ◽  
Precipitation Estimation

Abstract. Precipitation forcing is usually the main source of uncertainty in hydrology. It is of crucial importance to use accurate forcing in order to obtain a good distribution of the water throughout the basin. For real-time applications, satellite observations allow quasi-real-time precipitation monitoring like the products PERSIANN (Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks, TRMM (Tropical Rainfall Measuring Mission) or CMORPH (CPC (Climate Prediction Center) MORPHing). However, especially in West Africa, these precipitation satellite products are highly inaccurate and the water amount can vary by a factor of 2. A post-adjusted version of these products exists but is available with a 2 to 3 month delay, which is not suitable for real-time hydrologic applications. The purpose of this work is to show the possible synergy between quasi-real-time satellite precipitation and soil moisture by assimilating the latter into a hydrological model. Soil Moisture Ocean Salinity (SMOS) soil moisture is assimilated into the Distributed Hydrology Soil Vegetation Model (DHSVM) model. By adjusting the soil water content, water table depth and streamflow simulations are much improved compared to real-time precipitation without assimilation: soil moisture bias is decreased even at deeper soil layers, correlation of the water table depth is improved from 0.09–0.70 to 0.82–0.87, and the Nash coefficients of the streamflow go from negative to positive. Overall, the statistics tend to get closer to those from the reanalyzed precipitation. Soil moisture assimilation represents a fair alternative to reanalyzed rainfall products, which can take several months before being available, which could lead to a better management of available water resources and extreme events.

scholarly journals Evaluation of TRMM rainfall estimates over a large Indian river basin (Mahanadi)

2014 ◽  
Vol 11 (1) ◽  
pp. 1169-1201 ◽  
Author(s):  
D. Kneis ◽  
C. Chatterjee ◽  
R. Singh
Keyword(s):  
Real Time ◽  
River Basin ◽  
Stream Flow ◽  
Remotely Sensed ◽  
Rainfall Runoff ◽  
Runoff Simulation ◽  
Rain Gage ◽  
Precipitation Estimates ◽  
Rainfall Estimates

Abstract. The paper examines the quality of satellite-based precipitation estimates for the Lower Mahanadi River Basin (Eastern India). The considered data sets known as 3B42 and 3B42-RT (version 7/7A) are routinely produced by the tropical rainfall measuring mission (TRMM) from passive microwave and infrared recordings. While the 3B42-RT data are disseminated in real time, the gage-adjusted 3B42 data set is published with a delay of some months. The quality of the two products was assessed in a two-step procedure. First, the correspondence between the remotely sensed precipitation rates and rain gage data was evaluated at the sub-basin scale. Second, the quality of the rainfall estimates was assessed by analyzing their performance in the context of rainfall-runoff simulation. At sub-basin level (4000 to 16 000 km2) the satellite-based areal precipitation estimates were found to be moderately correlated with the gage-based counterparts (R2 of 0.64–0.74 for 3B42 and 0.59–0.72 for 3B42-RT). Significant discrepancies between TRMM data and ground observations were identified at high intensity levels. The rainfall depth derived from rain gage data is often not reflected by the TRMM estimates (hit rate < 0.6 for ground-based intensities > 80 mm day−1). At the same time, the remotely sensed rainfall rates frequently exceed the gage-based equivalents (false alarm ratios of 0.2–0.6). In addition, the real time product 3B42-RT was found to suffer from a spatially consistent negative bias. Since the regionalization of rain gage data is potentially associated with a number of errors, the above results are subject to uncertainty. Hence, a validation against independent information, such as stream flow, was essential. In this case study, the outcome of rainfall–runoff simulation experiments was consistent with the above-mentioned findings. The best fit between observed and simulated stream flow was obtained if rain gage data were used as model input (Nash–Sutcliffe Index of 0.76–0.88 at gages not affected by reservoir operation). This compares to the values of 0.71–0.78 for the gage-adjusted TRMM 3B42 data and 0.65–0.77 for the 3B42-RT real-time data. Whether the 3B42-RT data are useful in the context of operational runoff prediction in spite of the identified problems remains a question for further research.

Real-Time EEG Device for Epilepsy Detection Using Wavelet Transform and Support Vector Machine

2021 ◽  
pp. 104-135
Author(s):  
Sharad Sarjerao Jagtap ◽  
Rajesh Kumar M.
Keyword(s):  
Support Vector Machine ◽  
Feature Extraction ◽  
Wavelet Transform ◽  
Real Time ◽  
Low Cost ◽  
Support Vector ◽  
Svm Classifier ◽  
Discrete Wavelet ◽  
Feature Extraction Technique

This chapter gives an effective and efficient technique that can detect epilepsy in real time. It is low cost, low power, and real-time devices that can easily detect epilepsy. Along with EEG device, one can upgrade with GSM module to alert the doctors and parents of patients about its occurrence to prevent a sudden fall, which may cause injury and death. The accuracy of this EEG device depends on the quality of feature extraction technique and classification algorithm. In this chapter, support vector machine (SVM) is used as a classifier. Wavelet transform gives feature extraction, which helps to train data and to detect normal or seizure patients. Discrete wavelet transform (DWT) decomposes the signals into three decomposition levels. In this detection, mean, median, and non-linear parameter entropy were calculated for every sub-band as key parameters. The extracted features are then applied to SVM classifier for the classification. Better accuracy of classification is obtained using wavelet and SVM classifier.

scholarly journals Evaluation of TRMM rainfall estimates over a large Indian river basin (Mahanadi)

2014 ◽  
Vol 18 (7) ◽  
pp. 2493-2502 ◽  
Author(s):  
D. Kneis ◽  
C. Chatterjee ◽  
R. Singh
Keyword(s):  
Real Time ◽  
Stream Flow ◽  
Rain Gauge ◽  
Rainfall Runoff ◽  
Runoff Simulation ◽  
Rain Gauge Data ◽  
Gauge Data ◽  
Precipitation Estimates ◽  
Rainfall Estimates

Abstract. The paper examines the quality of satellite-based precipitation estimates for the lower Mahanadi River basin (eastern India). The considered data sets known as 3B42 and 3B42-RT (version 7/7A) are routinely produced by the tropical rainfall measuring mission (TRMM) from passive microwave and infrared recordings. While the 3B42-RT data are disseminated in real time, the gauge-adjusted 3B42 data set is published with a delay of some months. The quality of the two products was assessed in a two-step procedure. First, the correspondence between the remotely sensed precipitation rates and rain gauge data was evaluated at the sub-basin scale. Second, the quality of the rainfall estimates was assessed by analysing their performance in the context of rainfall–runoff simulation. At sub-basin level (4000 to 16 000 km2) the satellite-based areal precipitation estimates were found to be moderately correlated with the gauge-based counterparts (R2 of 0.64–0.74 for 3B42 and 0.59–0.72 for 3B42-RT). Significant discrepancies between TRMM data and ground observations were identified at high-intensity levels. The rainfall depth derived from rain gauge data is often not reflected by the TRMM estimates (hit rate < 0.6 for ground-based intensities > 80 mm day-1). At the same time, the remotely sensed rainfall rates frequently exceed the gauge-based equivalents (false alarm ratios of 0.2–0.6). In addition, the real-time product 3B42-RT was found to suffer from a spatially consistent negative bias. Since the regionalisation of rain gauge data is potentially associated with a number of errors, the above results are subject to uncertainty. Hence, a validation against independent information, such as stream flow, was essential. In this case study, the outcome of rainfall–runoff simulation experiments was consistent with the above-mentioned findings. The best fit between observed and simulated stream flow was obtained if rain gauge data were used as model input (Nash–Sutcliffe index of 0.76–0.88 at gauges not affected by reservoir operation). This compares to the values of 0.71–0.78 for the gauge-adjusted TRMM 3B42 data and 0.65–0.77 for the 3B42-RT real-time data. Whether the 3B42-RT data are useful in the context of operational runoff prediction in spite of the identified problems remains a question for further research.

Sign in / Sign up

Export Citation Format

Share Document