Large-scale machine learning and evaluation platform for real-time traffic surveillance

2016 ◽  
Vol 25 (5) ◽  
pp. 051204
Author(s):  
Justin A. Eichel ◽  
Akshaya Mishra ◽  
Nicholas Miller ◽  
Nicholas Jankovic ◽  
Mohan A. Thomas ◽  
...  
Keyword(s):  
Machine Learning ◽  
Real Time ◽  
Large Scale ◽  
Traffic Surveillance ◽  
Real Time Traffic ◽  
Evaluation Platform

Machine-Learning for the Prediction of Lost Circulation Events - Time Series Analysis and Model Evaluation

2021 ◽  
Author(s):  
Arturo Magana-Mora ◽  
Mohammad AlJubran ◽  
Jothibasu Ramasamy ◽  
Mohammed AlBassam ◽  
Chinthaka Gooneratne ◽  
...  
Keyword(s):  
Machine Learning ◽  
Time Series ◽  
Real Time ◽  
Large Scale ◽  
Model Comparison ◽  
Drilling Fluid ◽  
Sensor Data ◽  
False Alarms ◽  
Suitable Model ◽  
Lost Circulation

Abstract Objective/Scope. Lost circulation events (LCEs) are among the top causes for drilling nonproductive time (NPT). The presence of natural fractures and vugular formations causes loss of drilling fluid circulation. Drilling depleted zones with incorrect mud weights can also lead to drilling induced losses. LCEs can also develop into additional drilling hazards, such as stuck pipe incidents, kicks, and blowouts. An LCE is traditionally diagnosed only when there is a reduction in mud volume in mud pits in the case of moderate losses or reduction of mud column in the annulus in total losses. Using machine learning (ML) for predicting the presence of a loss zone and the estimation of fracture parameters ahead is very beneficial as it can immediately alert the drilling crew in order for them to take the required actions to mitigate or cure LCEs. Methods, Procedures, Process. Although different computational methods have been proposed for the prediction of LCEs, there is a need to further improve the models and reduce the number of false alarms. Robust and generalizable ML models require a sufficiently large amount of data that captures the different parameters and scenarios representing an LCE. For this, we derived a framework that automatically searches through historical data, locates LCEs, and extracts the surface drilling and rheology parameters surrounding such events. Results, Observations, and Conclusions. We derived different ML models utilizing various algorithms and evaluated them using the data-split technique at the level of wells to find the most suitable model for the prediction of an LCE. From the model comparison, random forest classifier achieved the best results and successfully predicted LCEs before they occurred. The developed LCE model is designed to be implemented in the real-time drilling portal as an aid to the drilling engineers and the rig crew to minimize or avoid NPT. Novel/Additive Information. The main contribution of this study is the analysis of real-time surface drilling parameters and sensor data to predict an LCE from a statistically representative number of wells. The large-scale analysis of several wells that appropriately describe the different conditions before an LCE is critical for avoiding model undertraining or lack of model generalization. Finally, we formulated the prediction of LCEs as a time-series problem and considered parameter trends to accurately determine the early signs of LCEs.

scholarly journals RealTE: Real-time Trajectory Estimation Over Large-Scale Road Networks

2022 ◽  
Author(s):  
Qibin Zhou ◽  
Qingang Su ◽  
Dingyu Yang
Keyword(s):  
Travel Time ◽  
Real Time ◽  
High Speed ◽  
Road Network ◽  
Large Scale ◽  
Road Networks ◽  
Trajectory Data ◽  
Real Time Traffic ◽  
Histogram Estimation ◽  
Traffic Estimation

Real-time traffic estimation focuses on predicting the travel time of one travel path, which is capable of helping drivers selecting an appropriate or favor path. Statistical analysis or neural network approaches have been explored to predict the travel time on a massive volume of traffic data. These methods need to be updated when the traffic varies frequently, which incurs tremendous overhead. We build a system RealTER⁢e⁢a⁢l⁢T⁢E, implemented on a popular and open source streaming system StormS⁢t⁢o⁢r⁢m to quickly deal with high speed trajectory data. In RealTER⁢e⁢a⁢l⁢T⁢E, we propose a locality-sensitive partition and deployment algorithm for a large road network. A histogram estimation approach is adopted to predict the traffic. This approach is general and able to be incremental updated in parallel. Extensive experiments are conducted on six real road networks and the results illustrate RealTE achieves higher throughput and lower prediction error than existing methods. The runtime of a traffic estimation is less than 11 seconds over a large road network and it takes only 619619 microseconds for model updates.

scholarly journals Accurate Real-Time Traffic Speed Estimation Using Infrastructure-Free Vehicular Networks

2015 ◽  
Vol 2015 ◽  
pp. 1-19 ◽  
Author(s):  
Zongjian He ◽  
Buyang Cao ◽  
Yan Liu
Keyword(s):  
Real Time ◽  
Large Scale ◽  
Vehicular Networks ◽  
Route Planning ◽  
Speed Estimation ◽  
Traffic Condition ◽  
Real Time Traffic ◽  
Traffic Trace ◽  
Traffic Speed ◽  
Traffic Speed Estimation

Real-time traffic speed is indispensable for many ITS applications, such as traffic-aware route planning and eco-driving advisory system. Existing traffic speed estimation solutions assume vehicles travel along roads using constant speed. However, this assumption does not hold due to traffic dynamicity and can potentially lead to inaccurate estimation in real world. In this paper, we propose a novel in-network traffic speed estimation approach using infrastructure-free vehicular networks. The proposed solution utilizes macroscopic traffic flow model to estimate the traffic condition. The selected model only relies on vehicle density, which is less likely to be affected by the traffic dynamicity. In addition, we also demonstrate an application of the proposed solution in real-time route planning applications. Extensive evaluations using both traffic trace based large scale simulation and testbed based implementation have been performed. The results show that our solution outperforms some existing ones in terms of accuracy and efficiency in traffic-aware route planning applications.

Real-Time Traffic Measurement from Single Loop Inductive Signatures

2002 ◽  
Vol 1804 (1) ◽  
pp. 98-106 ◽  
Author(s):  
Seri Oh ◽  
Stephen G. Ritchie ◽  
Cheol Oh
Keyword(s):  
Real Time ◽  
The United States ◽  
Traffic Data ◽  
Traffic Surveillance ◽  
Vehicle Class ◽  
Traffic Measurement ◽  
Single Loop ◽  
Loop Detectors ◽  
Real Time Traffic ◽  
Traffic Data Collection

Accurate traffic data acquisition is essential for effective traffic surveillance, which is the backbone of advanced transportation management and information systems (ATMIS). Inductive loop detectors (ILDs) are still widely used for traffic data collection in the United States and many other countries. Three fundamental traffic parameters—speed, volume, and occupancy—are obtainable via single or double (speed-trap) ILDs. Real-time knowledge of such traffic parameters typically is required for use in ATMIS from a single loop detector station, which is the most commonly used. However, vehicle speeds cannot be obtained directly. Hence, the ability to estimate vehicle speeds accurately from single loop detectors is of considerable interest. In addition, operating agencies report that conventional loop detectors are unable to achieve volume count accuracies of more than 90% to 95%. The improved derivation of fundamental real-time traffic parameters, such as speed, volume, occupancy, and vehicle class, from single loop detectors and inductive signatures is demonstrated.

Detecting Pressure Anomalies While Drilling Using a Machine Learning Hybrid Approach

2021 ◽  
Author(s):  
Aurore Lafond ◽  
Maurice Ringer ◽  
Florian Le Blay ◽  
Jiaxu Liu ◽  
Ekaterina Millan ◽  
...  
Keyword(s):  
Machine Learning ◽  
Data Quality ◽  
Real Time ◽  
Large Scale ◽  
Hybrid Approach ◽  
Physical Models ◽  
Training Data ◽  
Digital Data ◽  
Machine Learning Techniques ◽  
New System

Abstract Abnormal surface pressure is typically the first indicator of a number of problematic events, including kicks, losses, washouts and stuck pipe. These events account for 60–70% of all drilling-related nonproductive time, so their early and accurate detection has the potential to save the industry billions of dollars. Detecting these events today requires an expert user watching multiple curves, which can be costly, and subject to human errors. The solution presented in this paper is aiming at augmenting traditional models with new machine learning techniques, which enable to detect these events automatically and help the monitoring of the drilling well. Today’s real-time monitoring systems employ complex physical models to estimate surface standpipe pressure while drilling. These require many inputs and are difficult to calibrate. Machine learning is an alternative method to predict pump pressure, but this alone needs significant labelled training data, which is often lacking in the drilling world. The new system combines these approaches: a machine learning framework is used to enable automated learning while the physical models work to compensate any gaps in the training data. The system uses only standard surface measurements, is fully automated, and is continuously retrained while drilling to ensure the most accurate pressure prediction. In addition, a stochastic (Bayesian) machine learning technique is used, which enables not only a prediction of the pressure, but also the uncertainty and confidence of this prediction. Last, the new system includes a data quality control workflow. It discards periods of low data quality for the pressure anomaly detection and enables to have a smarter real-time events analysis. The new system has been tested on historical wells using a new test and validation framework. The framework runs the system automatically on large volumes of both historical and simulated data, to enable cross-referencing the results with observations. In this paper, we show the results of the automated test framework as well as the capabilities of the new system in two specific case studies, one on land and another offshore. Moreover, large scale statistics enlighten the reliability and the efficiency of this new detection workflow. The new system builds on the trend in our industry to better capture and utilize digital data for optimizing drilling.

scholarly journals Measuring Traffic in Cities Through a Large-Scale Online Platform

2019 ◽  
Vol 1 (2-3) ◽  
pp. 161-173 ◽  
Author(s):  
Vilhelm Verendel ◽  
Sonia Yeh
Keyword(s):  
Real Time ◽  
Large Scale ◽  
Data Availability ◽  
Traffic Information ◽  
Traffic Data ◽  
Online Platform ◽  
Real Time Traffic ◽  
Data Source ◽  
Road Segments

Abstract Online real-time traffic data services could effectively deliver traffic information to people all over the world and provide large benefits to the society and research about cities. Yet, city-wide road network traffic data are often hard to come by on a large scale over a longer period of time. We collect, describe, and analyze traffic data for 45 cities from HERE, a major online real-time traffic information provider. We sampled the online platform for city traffic data every 5 min during 1 year, in total more than 5 million samples covering more than 300 thousand road segments. Our aim is to describe some of the practical issues surrounding the data that we experienced in working with this type of data source, as well as to explore the data patterns and see how this data source provides information to study traffic in cities. We focus on data availability to characterize how traffic information is available for different cities; it measures the share of road segments with real-time traffic information at a given time for a given city. We describe the patterns of real-time data availability, and evaluate methods to handle filling in missing speed data for road segments when real-time information was not available. We conduct a validation case study based on Swedish traffic sensor data and point out challenges for future validation. Our findings include (i) a case study of validating the HERE data against ground truth available for roads and lanes in a Swedish city, showing that real-time traffic data tends to follow dips in travel speed but miss instantaneous higher speed measured in some sensors, typically at times when there are fewer vehicles on the road; (ii) using time series clustering, we identify four clusters of cities with different types of measurement patterns; and (iii) a k-nearest neighbor-based method consistently outperforms other methods to fill in missing real-time traffic speeds. We illustrate how to work with this kind of traffic data source that is increasingly available to researchers, travellers, and city planners. Future work is needed to broaden the scope of validation, and to apply these methods to use online data for improving our knowledge of traffic in cities.

scholarly journals Learning from the 2018 Western Japan Heavy Rains to Detect Floods during the 2019 Hagibis Typhoon

2020 ◽  
Vol 12 (14) ◽  
pp. 2244
Author(s):  
Luis Moya ◽  
Erick Mas ◽  
Shunichi Koshimura
Keyword(s):  
Machine Learning ◽  
Real Time ◽  
Local Governments ◽  
Large Scale ◽  
Damage Identification ◽  
Remote Sensing Data ◽  
Early Response ◽  
Training Data ◽  
Supervised Machine Learning ◽  
A Current

Applications of machine learning on remote sensing data appear to be endless. Its use in damage identification for early response in the aftermath of a large-scale disaster has a specific issue. The collection of training data right after a disaster is costly, time-consuming, and many times impossible. This study analyzes a possible solution to the referred issue: the collection of training data from past disaster events to calibrate a discriminant function. Then the identification of affected areas in a current disaster can be performed in near real-time. The performance of a supervised machine learning classifier to learn from training data collected from the 2018 heavy rainfall at Okayama Prefecture, Japan, and to identify floods due to the typhoon Hagibis on 12 October 2019 at eastern Japan is reported in this paper. The results show a moderate agreement with flood maps provided by local governments and public institutions, and support the assumption that previous disaster information can be used to identify a current disaster in near-real time.

Sign in / Sign up

Export Citation Format

Share Document