Deep learning rainfall-runoff predictions of extreme events

Abstract. The most accurate rainfall-runoff predictions are currently based on deep learning. There is a concern among hydrologists that data-driven models based on deep learning may not be reliable in extrapolation or for predicting extreme events. This study tests that hypothesis using Long Short-Term Memory networks (LSTMs) and an LSTM variant that is architecturally constrained to conserve mass. The LSTM (and the mass-conserving LSTM variant) remained relatively accurate in predicting extreme (high return-period) events compared to both a conceptual model (the Sacramento Model) and a process-based model (US National Water Model), even when extreme events were not included in the training period. Adding mass balance constraints to the data-driven model (LSTM) reduced model skill during extreme events.

Download Full-text

Risk Prediction for Ship Encounter Situation Awareness Using Long Short-Term Memory Based Deep Learning on Intership Behaviors

Journal of Advanced Transportation ◽

10.1155/2020/8897700 ◽

2020 ◽

Vol 2020 ◽

pp. 1-15

Author(s):

Jie Ma ◽

Wenkai Li ◽

Chengfeng Jia ◽

Chunwei Zhang ◽

Yu Zhang

Keyword(s):

Deep Learning ◽

Risk Prediction ◽

Short Term Memory ◽

Data Driven ◽

Yangtze River Estuary ◽

Collision Risk ◽

Short Term ◽

Term Memory ◽

Data Driven Approach ◽

Long Short Term Memory

Encounter risk prediction is critical for safe ship navigation, especially in congested waters, where ships sail very near to each other during various encounter situations. Prior studies on the risk of ship collisions were unable to address the uncertainty of the encounter process when ignoring the complex motions constituting the dynamic ship encounter behavior, which may seriously affect the risk prediction performance. To fill this gap, a novel AIS data-driven approach is proposed for ship encounter risk prediction by modeling intership behavior patterns. In particular, multidimensional features of intership behaviors are extracted from the AIS trace data to capture spatial dependencies between encountering ships. Then, the challenging task of risk prediction is to discover the complex and uncertain relationship between intership behaviors and future collision risk. To address this issue, we propose a deep learning framework. To represent the temporal dynamics of the encounter process, we use the sliding window technique to generate the sequences of behavioral features. The collision risk level at a future time is taken as the class label of the sequence. Then, the long short-term memory network, which has a strong ability to model temporal dependency and complex patterns, is extended to establish the relationship. The benefit of our approach is that it transforms the complex problem for risk prediction into a time series classification task, which makes collision risk prediction reliable and easier to implement. Experiments were conducted on a set of naturalistic data from various encounter scenarios in the South Channel of the Yangtze River Estuary. The results show that the proposed data-driven approach can predict future collision risk with high accuracy and efficiency. The approach is expected to be applied for the early prediction of encountering ships and as decision support to improve navigation safety.

Download Full-text

Rainfall-Runoff modelling using Long-Short-Term-Memory (LSTM) networks

10.5194/hess-2018-247 ◽

2018 ◽

Cited By ~ 6

Author(s):

Frederik Kratzert ◽

Daniel Klotz ◽

Claire Brenner ◽

Karsten Schulz ◽

Mathew Herrnegger

Keyword(s):

Short Term Memory ◽

Regional Scale ◽

Model Performance ◽

Data Driven ◽

Rainfall Runoff ◽

Short Term ◽

Data Set ◽

Term Memory ◽

Soil Moisture Accounting ◽

Long Short Term Memory

Abstract. Rainfall-runoff modelling is one of the key challenges in the field of hydrology. Various approaches exist, ranging from physically based over conceptual to fully data driven models. In this paper, we propose a novel data driven approach, using the Long-Short-Term-Memory (LSTM) network, a special type of recurrent neural networks. The advantage of the LSTM is its ability to learn long-term dependencies between the provided input and output of the network, which are essential for modelling storage effects in e.g. catchments with snow influence. We use 241 catchments of the freely available CAMELS data set to test our approach and also compare the results to the well-known Sacramento Soil Moisture Accounting Model (SAC-SMA) coupled with the Snow-17 snow routine. We also show the potential of the LSTM as a regional hydrological model, in which one model predicts the discharge for a variety of catchments. In our last experiment, we show the possibility to transfer process understanding, learned at regional scale, to individual catchments and thereby increasing model performance when compared to a LSTM trained only on the data of single catchments. Using this approach, we were able to achieve better model performance as the SAC-SMA + Snow-17, which underlines the potential of the LSTM for hydrological modelling applications.

Download Full-text

Rainfall–runoff modelling using Long Short-Term Memory (LSTM) networks

Hydrology and Earth System Sciences ◽

10.5194/hess-22-6005-2018 ◽

2018 ◽

Vol 22 (11) ◽

pp. 6005-6022 ◽

Cited By ~ 97

Author(s):

Frederik Kratzert ◽

Daniel Klotz ◽

Claire Brenner ◽

Karsten Schulz ◽

Mathew Herrnegger

Keyword(s):

Short Term Memory ◽

Regional Scale ◽

Model Performance ◽

Data Driven ◽

Rainfall Runoff ◽

Short Term ◽

Data Set ◽

Term Memory ◽

Soil Moisture Accounting ◽

Long Short Term Memory

Abstract. Rainfall–runoff modelling is one of the key challenges in the field of hydrology. Various approaches exist, ranging from physically based over conceptual to fully data-driven models. In this paper, we propose a novel data-driven approach, using the Long Short-Term Memory (LSTM) network, a special type of recurrent neural network. The advantage of the LSTM is its ability to learn long-term dependencies between the provided input and output of the network, which are essential for modelling storage effects in e.g. catchments with snow influence. We use 241 catchments of the freely available CAMELS data set to test our approach and also compare the results to the well-known Sacramento Soil Moisture Accounting Model (SAC-SMA) coupled with the Snow-17 snow routine. We also show the potential of the LSTM as a regional hydrological model in which one model predicts the discharge for a variety of catchments. In our last experiment, we show the possibility to transfer process understanding, learned at regional scale, to individual catchments and thereby increasing model performance when compared to a LSTM trained only on the data of single catchments. Using this approach, we were able to achieve better model performance as the SAC-SMA + Snow-17, which underlines the potential of the LSTM for hydrological modelling applications.

Download Full-text

A novel solution of using deep learning for early prediction cardiac arrest in Sepsis patient: enhanced bidirectional long short-term memory (LSTM)

Multimedia Tools and Applications ◽

10.1007/s11042-021-11176-5 ◽

2021 ◽

Author(s):

Samit Baral ◽

Abeer Alsadoon ◽

P. W. C. Prasad ◽

Sarmad Al Aloussi ◽

Omar Hisham Alsadoon

Keyword(s):

Cardiac Arrest ◽

Deep Learning ◽

Sepsis Patient ◽

Short Term Memory ◽

Early Prediction ◽

Short Term ◽

Term Memory ◽

Long Short Term Memory

Download Full-text

Schätzung der Verdunstung mithilfe von Machine- und Deep Learning-Methoden

Österreichische Wasser- und Abfallwirtschaft ◽

10.1007/s00506-021-00768-y ◽

2021 ◽

Author(s):

Claire Brenner ◽

Jonathan Frame ◽

Grey Nearing ◽

Karsten Schulz

Keyword(s):

Deep Learning ◽

Short Term Memory ◽

Sich Eine ◽

Short Term ◽

Term Memory ◽

Neuronales Netzwerk ◽

Long Short Term Memory

ZusammenfassungDie Verdunstung ist ein entscheidender Prozess im globalen Wasser‑, Energie- sowie Kohlenstoffkreislauf. Daten zur räumlich-zeitlichen Dynamik der Verdunstung sind daher von großer Bedeutung für Klimamodellierungen, zur Abschätzung der Auswirkungen der Klimakrise sowie nicht zuletzt für die Landwirtschaft.In dieser Arbeit wenden wir zwei Machine- und Deep Learning-Methoden für die Vorhersage der Verdunstung mit täglicher und halbstündlicher Auflösung für Standorte des FLUXNET-Datensatzes an. Das Long Short-Term Memory Netzwerk ist ein rekurrentes neuronales Netzwerk, welchen explizit Speichereffekte berücksichtigt und Zeitreihen der Eingangsgrößen analysiert (entsprechend physikalisch-basierten Wasserbilanzmodellen). Dem gegenüber gestellt werden Modellierungen mit XGBoost, einer Entscheidungsbaum-Methode, die in diesem Fall nur Informationen für den zu bestimmenden Zeitschritt erhält (entsprechend physikalisch-basierten Energiebilanzmodellen). Durch diesen Vergleich der beiden Modellansätze soll untersucht werden, inwieweit sich durch die Berücksichtigung von Speichereffekten Vorteile für die Modellierung ergeben.Die Analysen zeigen, dass beide Modellansätze gute Ergebnisse erzielen und im Vergleich zu einem ausgewerteten Referenzdatensatz eine höhere Modellgüte aufweisen. Vergleicht man beide Modelle, weist das LSTM im Mittel über alle 153 untersuchten Standorte eine bessere Übereinstimmung mit den Beobachtungen auf. Allerdings zeigt sich eine Abhängigkeit der Güte der Verdunstungsvorhersage von der Vegetationsklasse des Standorts; vor allem wärmere, trockene Standorte mit kurzer Vegetation werden durch das LSTM besser repräsentiert, wohingegen beispielsweise in Feuchtgebieten XGBoost eine bessere Übereinstimmung mit den Beobachtung liefert. Die Relevanz von Speichereffekten scheint daher zwischen Ökosystemen und Standorten zu variieren.Die präsentierten Ergebnisse unterstreichen das Potenzial von Methoden der künstlichen Intelligenz für die Beschreibung der Verdunstung.

Download Full-text

Concrete compressive strength prediction modeling utilizing deep learning long short-term memory algorithm for a sustainable environment

Environmental Science and Pollution Research ◽

10.1007/s11356-021-12877-y ◽

2021 ◽

Author(s):

Sarmad Dashti Latif

Keyword(s):

Compressive Strength ◽

Deep Learning ◽

Short Term Memory ◽

Strength Prediction ◽

Concrete Compressive Strength ◽

Prediction Modeling ◽

Short Term ◽

Term Memory ◽

Sustainable Environment ◽

Long Short Term Memory

Download Full-text

Comprehensive comparison of artificial neural networks and long short-term memory networks for rainfall-runoff simulation

Physics and Chemistry of the Earth Parts A/B/C ◽

10.1016/j.pce.2021.103026 ◽

2021 ◽

pp. 103026

Author(s):

Ganquan Mao ◽

Meng Wang ◽

Junguo Liu ◽

Zifeng Wang ◽

Kai Wang ◽

...

Keyword(s):

Neural Networks ◽

Artificial Neural Networks ◽

Short Term Memory ◽

Rainfall Runoff ◽

Short Term ◽

Runoff Simulation ◽

Term Memory ◽

Comprehensive Comparison ◽

Long Short Term Memory ◽

Artificial Neural

Download Full-text

Multiple Pedestrians and Vehicles Tracking in Aerial Imagery Using a Convolutional Neural Network

Remote Sensing ◽

10.3390/rs13101953 ◽

2021 ◽

Vol 13 (10) ◽

pp. 1953

Author(s):

Seyed Majid Azimi ◽

Maximilian Kraus ◽

Reza Bahmanyar ◽

Peter Reinartz

Keyword(s):

Neural Network ◽

Deep Learning ◽

Convolutional Neural Network ◽

Object Tracking ◽

Short Term Memory ◽

Aerial Imagery ◽

Future Research ◽

Short Term ◽

Term Memory ◽

Long Short Term Memory

In this paper, we address various challenges in multi-pedestrian and vehicle tracking in high-resolution aerial imagery by intensive evaluation of a number of traditional and Deep Learning based Single- and Multi-Object Tracking methods. We also describe our proposed Deep Learning based Multi-Object Tracking method AerialMPTNet that fuses appearance, temporal, and graphical information using a Siamese Neural Network, a Long Short-Term Memory, and a Graph Convolutional Neural Network module for more accurate and stable tracking. Moreover, we investigate the influence of the Squeeze-and-Excitation layers and Online Hard Example Mining on the performance of AerialMPTNet. To the best of our knowledge, we are the first to use these two for regression-based Multi-Object Tracking. Additionally, we studied and compared the L1 and Huber loss functions. In our experiments, we extensively evaluate AerialMPTNet on three aerial Multi-Object Tracking datasets, namely AerialMPT and KIT AIS pedestrian and vehicle datasets. Qualitative and quantitative results show that AerialMPTNet outperforms all previous methods for the pedestrian datasets and achieves competitive results for the vehicle dataset. In addition, Long Short-Term Memory and Graph Convolutional Neural Network modules enhance the tracking performance. Moreover, using Squeeze-and-Excitation and Online Hard Example Mining significantly helps for some cases while degrades the results for other cases. In addition, according to the results, L1 yields better results with respect to Huber loss for most of the scenarios. The presented results provide a deep insight into challenges and opportunities of the aerial Multi-Object Tracking domain, paving the way for future research.

Download Full-text