scholarly journals Application of machine learning for real-time evaluation of salinity (or TDS) in drinking water using photonic sensors

2016 ◽  
Vol 9 (2) ◽  
pp. 37-45 ◽  
Author(s):  
Sandip Kumar Roy ◽  
Preeta Sharan
Keyword(s):  
Machine Learning ◽  
Drinking Water ◽  
Real Time ◽  
Learning Algorithm ◽  
Training Data ◽  
Raspberry Pi ◽  
Highly Sensitive ◽  
Sample Water ◽  
Photonic Sensors ◽  
Time Evaluation

Abstract. The world is facing an unprecedented problem in safeguarding 0.4 % of potable water, which is gradually depleting day-by-day. From a literature survey it has been observed that the refractive index (RI) of water changes with a change in salinity or total dissolved solids (TDS). In this paper we have proposed an automatic system that can be used for real-time evaluation of salinity or TDS in drinking water. A photonic crystal (PhC) based ring resonator sensor has been designed and simulated using the MEEP (MIT Electromagnetic Equation Propagation) tool and the finite difference time domain (FDTD) algorithm. The modelled and designed sensor is highly sensitive to the changes in the RI of a water sample. This work includes a real-time-based natural sequence follower, which is a machine learning algorithm of the naive Bayesian type, a sequence of statistical algorithms implemented in MATLAB with reference to training data to analyse the sample water. Further interfacing has been done using the Raspberry Pi device to provide an easy display to show the result of water analysis. The main advantage of the designed sensor with an interface is to check whether the salinity or TDS in drinking water is less than 1000 ppm or not. If it is greater than or equal to 2000 ppm, the display shows “High Salinity/TDS Observed”, and if ppm are less than or equal to 1000 ppm, then the display shows “Low salinity/TDS Observed”. The proposed sensor is highly sensitive and it can detect changes in TDS level because of the influence of any dissolved substance in water.

scholarly journals Application of Machine Learning For Real-time Evaluation of Salinity (or TDS) in Drinking Water Using Photonic Sensor

2016 ◽  
Author(s):  
Sandip Kumar Roy ◽  
Preeta Sharan
Keyword(s):  
Machine Learning ◽  
Drinking Water ◽  
Real Time ◽  
Learning Algorithm ◽  
Training Data ◽  
Raspberry Pi ◽  
Photonic Sensor ◽  
Highly Sensitive ◽  
Sample Water ◽  
Time Evaluation

Abstract. World is facing unprecedented problem to safeguard 0.4 percent of potable water, which is eventually depleting day-by-day. From literature survey it has been observed that the refractive index (RI) of water changes with change in salinity or total dissolved solids (TDS). In this paper we have proposed an automatic system that can be used for real-time evaluation of salinity or TDS in drinking water. Photonic Crystal (PhC) based ring resonator sensor has been designed and simulated using MEEP tool and Finite Difference Time Domain (FDTD) algorithm. The modelled and designed sensor is highly sensitive to the changes in RI of water sample. This work includes a real-time based natural sequence follower which is a machine learning algorithm of Naïve Bayesian type. A sequence of statistical algorithm implemented in MATLAB with reference to training data to analyse the sample water. Further interfacing has been done using Raspberry Pi device to provide an easy display to show the result of water analysis. The main advantage of the designed sensor with interface is to check whether the salinity or TDS in drinking water is less than 1000 ppm or not.

scholarly journals Spectrophotometric Online Detection of Drinking Water Disinfectant: A Machine Learning Approach

Sensors ◽  
2020 ◽  
Vol 20 (22) ◽  
pp. 6671
Author(s):  
Sharif Hossain ◽  
Christopher W.K. Chow ◽  
Guna A. Hewa ◽  
David Cook ◽  
Martin Harris
Keyword(s):  
Machine Learning ◽  
Drinking Water ◽  
Real Time ◽  
Learning Algorithm ◽  
Measurement Data ◽  
Treatment Plant ◽  
Water Treatment Plant ◽  
Kernel Functions ◽  
Support Vector ◽  
Organic Nitrate

The spectra fingerprint of drinking water from a water treatment plant (WTP) is characterised by a number of light-absorbing substances, including organic, nitrate, disinfectant, and particle or turbidity. Detection of disinfectant (monochloramine) can be better achieved by separating its spectra from the combined spectra. In this paper, two major focuses are (i) the separation of monochloramine spectra from the combined spectra and (ii) assessment of the application of the machine learning algorithm in real-time detection of monochloramine. The support vector regression (SVR) model was developed using multi-wavelength ultraviolet-visible (UV-Vis) absorbance spectra and online amperometric monochloramine residual measurement data. The performance of the SVR model was evaluated by using four different kernel functions. Results show that (i) particles or turbidity in water have a significant effect on UV-Vis spectral measurement and improved modelling accuracy is achieved by using particle compensated spectra; (ii) modelling performance is further improved by compensating the spectra for natural organic matter (NOM) and nitrate (NO3) and (iii) the choice of kernel functions greatly affected the SVR performance, especially the radial basis function (RBF) appears to be the highest performing kernel function. The outcomes of this research suggest that disinfectant residual (monochloramine) can be measured in real time using the SVR algorithm with a precision level of ± 0.1 mg L−1.

Scalable Approach to High Coverages on Oxides via Iterative Training of a Machine-Learning Algorithm

2019 ◽  
Author(s):  
Andrew Medford ◽  
Shengchun Yang ◽  
Fuzhu Liu
Keyword(s):  
Machine Learning ◽  
Chemical Potential ◽  
Learning Algorithm ◽  
Absolute Error ◽  
Low Energy ◽  
Training Data ◽  
High Coverage ◽  
Metal Compounds ◽  
Adsorption Energies ◽  
The Stability

Understanding the interaction of multiple types of adsorbate molecules on solid surfaces is crucial to establishing the stability of catalysts under various chemical environments. Computational studies on the high coverage and mixed coverages of reaction intermediates are still challenging, especially for transition-metal compounds. In this work, we present a framework to predict differential adsorption energies and identify low-energy structures under high- and mixed-adsorbate coverages on oxide materials. The approach uses Gaussian process machine-learning models with quantified uncertainty in conjunction with an iterative training algorithm to actively identify the training set. The framework is demonstrated for the mixed adsorption of CH<sub>x</sub>, NH<sub>x</sub> and OH<sub>x</sub> species on the oxygen vacancy and pristine rutile TiO<sub>2</sub>(110) surface sites. The results indicate that the proposed algorithm is highly efficient at identifying the most valuable training data, and is able to predict differential adsorption energies with a mean absolute error of ~0.3 eV based on <25% of the total DFT data. The algorithm is also used to identify 76% of the low-energy structures based on <30% of the total DFT data, enabling construction of surface phase diagrams that account for high and mixed coverage as a function of the chemical potential of C, H, O, and N. Furthermore, the computational scaling indicates the algorithm scales nearly linearly (N<sup>1.12</sup>) as the number of adsorbates increases. This framework can be directly extended to metals, metal oxides, and other materials, providing a practical route toward the investigation of the behavior of catalysts under high-coverage conditions.

Detecting Pressure Anomalies While Drilling Using a Machine Learning Hybrid Approach

2021 ◽  
Author(s):  
Aurore Lafond ◽  
Maurice Ringer ◽  
Florian Le Blay ◽  
Jiaxu Liu ◽  
Ekaterina Millan ◽  
...  
Keyword(s):  
Machine Learning ◽  
Data Quality ◽  
Real Time ◽  
Large Scale ◽  
Hybrid Approach ◽  
Physical Models ◽  
Training Data ◽  
Digital Data ◽  
Machine Learning Techniques ◽  
New System

Abstract Abnormal surface pressure is typically the first indicator of a number of problematic events, including kicks, losses, washouts and stuck pipe. These events account for 60–70% of all drilling-related nonproductive time, so their early and accurate detection has the potential to save the industry billions of dollars. Detecting these events today requires an expert user watching multiple curves, which can be costly, and subject to human errors. The solution presented in this paper is aiming at augmenting traditional models with new machine learning techniques, which enable to detect these events automatically and help the monitoring of the drilling well. Today’s real-time monitoring systems employ complex physical models to estimate surface standpipe pressure while drilling. These require many inputs and are difficult to calibrate. Machine learning is an alternative method to predict pump pressure, but this alone needs significant labelled training data, which is often lacking in the drilling world. The new system combines these approaches: a machine learning framework is used to enable automated learning while the physical models work to compensate any gaps in the training data. The system uses only standard surface measurements, is fully automated, and is continuously retrained while drilling to ensure the most accurate pressure prediction. In addition, a stochastic (Bayesian) machine learning technique is used, which enables not only a prediction of the pressure, but also the uncertainty and confidence of this prediction. Last, the new system includes a data quality control workflow. It discards periods of low data quality for the pressure anomaly detection and enables to have a smarter real-time events analysis. The new system has been tested on historical wells using a new test and validation framework. The framework runs the system automatically on large volumes of both historical and simulated data, to enable cross-referencing the results with observations. In this paper, we show the results of the automated test framework as well as the capabilities of the new system in two specific case studies, one on land and another offshore. Moreover, large scale statistics enlighten the reliability and the efficiency of this new detection workflow. The new system builds on the trend in our industry to better capture and utilize digital data for optimizing drilling.

Water Quality Prediction Using Statistical Tool and Machine Learning Algorithm

2020 ◽  
pp. 609-623
Author(s):  
Arun Kumar Beerala ◽  
Gobinath R. ◽  
Shyamala G. ◽  
Siribommala Manvitha
Keyword(s):  
Machine Learning ◽  
Learning Algorithm ◽  
Training Data ◽  
Machine Learning Techniques ◽  
Statistical Tool ◽  
Data Set ◽  
Water Quality Prediction ◽  
Living Things ◽  
Sampling Locations ◽  
Different Seasons

Water is the most valuable natural resource for all living things and the ecosystem. The quality of groundwater is changed due to change in ecosystem, industrialisation, and urbanisation, etc. In the study, 60 samples were taken and analysed for various physio-chemical parameters. The sampling locations were located using global positioning system (GPS) and were taken for two consecutive years for two different seasons, monsoon (Nov-Dec) and post-monsoon (Jan-Mar). In 2016-2017 and 2017-2018 pH, EC, and TDS were obtained in the field. Hardness and Chloride are determined using titration method. Nitrate and Sulphate were determined using Spectrophotometer. Machine learning techniques were used to train the data set and to predict the unknown values. The dominant elements of groundwater are as follows: Ca2, Mg2 for cation and Cl-, SO42, NO3− for anions. The regression value for the training data set was found to be 0.90596, and for the entire network, it was found to be 0.81729. The best performance was observed as 0.0022605 at epoch 223.

Design-Oriented Multifidelity Fluid Simulation Using Machine Learned Fidelity Mapping

2019 ◽  
Author(s):  
Kazuko Fuchi ◽  
Eric M. Wolf ◽  
David S. Makhija ◽  
Nathan A. Wukie ◽  
Christopher R. Schrock ◽  
...  
Keyword(s):  
Machine Learning ◽  
Learning Algorithm ◽  
Fluid Simulation ◽  
Machine Learning Algorithms ◽  
Training Data ◽  
Supervised Machine Learning ◽  
High Fidelity ◽  
Computational Domain ◽  
Symmetry Properties ◽  
High Fidelity Simulations

Abstract A machine learning algorithm that performs multifidelity domain decomposition is introduced. While the design of complex systems can be facilitated by numerical simulations, the determination of appropriate physics couplings and levels of model fidelity can be challenging. The proposed method automatically divides the computational domain into subregions and assigns required fidelity level, using a small number of high fidelity simulations to generate training data and low fidelity solutions as input data. Unsupervised and supervised machine learning algorithms are used to correlate features from low fidelity solutions to fidelity assignment. The effectiveness of the method is demonstrated in a problem of viscous fluid flow around a cylinder at Re ≈ 20. Ling et al. built physics-informed invariance and symmetry properties into machine learning models and demonstrated improved model generalizability. Along these lines, we avoid using problem dependent features such as coordinates of sample points, object geometry or flow conditions as explicit inputs to the machine learning model. Use of pointwise flow features generates large data sets from only one or two high fidelity simulations, and the fidelity predictor model achieved 99.5% accuracy at training points. The trained model was shown to be capable of predicting a fidelity map for a problem with an altered cylinder radius. A significant improvement in the prediction performance was seen when inputs are expanded to include multiscale features that incorporate neighborhood information.

scholarly journals Machine learning algorithms can predict tail biting outbreaks in pigs using feeding behaviour records

2021 ◽  
Author(s):  
Catherine Ollagnier ◽  
Claudia Kasper ◽  
Anna Wallenbeck ◽  
Linda Keeling ◽  
Siavash A Bigdeli
Keyword(s):  
Machine Learning ◽  
Random Forest ◽  
Real Time ◽  
Feeding Behaviour ◽  
Learning Algorithm ◽  
Learning Algorithms ◽  
Machine Learning Algorithms ◽  
Machine Learning Algorithm ◽  
Tail Biting ◽  
Testing Set

Tail biting is a detrimental behaviour that impacts the welfare and health of pigs. Early detection of tail biting precursor signs allows for preventive measures to be taken, thus avoiding the occurrence of the tail biting event. This study aimed to build a machine-learning algorithm for real time detection of upcoming tail biting outbreaks, using feeding behaviour data recorded by an electronic feeder. Prediction capacities of seven machine learning algorithms (e.g., random forest, neural networks) were evaluated from daily feeding data collected from 65 pens originating from 2 herds of grower-finisher pigs (25-100kg), in which 27 tail biting events occurred. Data were divided into training and testing data, either by randomly splitting data into 75% (training set) and 25% (testing set), or by randomly selecting pens to constitute the testing set. The random forest algorithm was able to predict 70% of the upcoming events with an accuracy of 94%, when predicting events in pens for which it had previous data. The detection of events for unknown pens was less sensitive, and the neural network model was able to detect 14% of the upcoming events with an accuracy of 63%. A machine-learning algorithm based on ongoing data collection should be considered for implementation into automatic feeder systems for real time prediction of tail biting events.

scholarly journals Extraction of Sea Ice Cover by Sentinel-1 SAR Based on SVM with Unsupervised Generation of Training Data

2020 ◽  
Author(s):  
Xiaoming Li ◽  
Yan Sun ◽  
Qiang Zhang
Keyword(s):  
Machine Learning ◽  
Sea Ice ◽  
Learning Algorithm ◽  
Texture Features ◽  
Open Water ◽  
Ice Cover ◽  
Training Data ◽  
Support Vector ◽  
Training Samples

In this paper, we focus on developing a novel method to extract sea ice cover (i.e., discrimination/classification of sea ice and open water) using Sentinel-1 (S1) cross-polarization (vertical-horizontal, VH or horizontal-vertical, HV) data in extra wide (EW) swath mode based on the machine learning algorithm support vector machine (SVM). The classification basis includes the S1 radar backscatter coefficients and texture features that are calculated from S1 data using the gray level co-occurrence matrix (GLCM). Different from previous methods where appropriate samples are manually selected to train the SVM to classify sea ice and open water, we proposed a method of unsupervised generation of the training samples based on two GLCM texture features, i.e. entropy and homogeneity, that have contrasting characteristics on sea ice and open water. We eliminate the most uncertainty of selecting training samples in machine learning and achieve automatic classification of sea ice and open water by using S1 EW data. The comparison shows good agreement between the SAR-derived sea ice cover using the proposed method and a visual inspection, of which the accuracy reaches approximately 90% - 95% based on a few cases. Besides this, compared with the analyzed sea ice cover data Ice Mapping System (IMS) based on 728 S1 EW images, the accuracy of extracted sea ice cover by using S1 data is more than 80%.

Sign in / Sign up

Export Citation Format

Share Document