Learning from mistakes: Online updating for deep learning models.

Author(s):  
Daniel Klotz ◽  
Frederik Kratzert ◽  
Alden K. Sampson ◽  
Günter Klambauer ◽  
Sepp Hochreiter ◽  
...  

<p>Accurate streamflow forecasts are important for many operational purposes, like hydropower operation or flood risk management. It is obvious that for data-driven models best prediction performance would be obtained if recent streamflow observations were used as an additional model input. Therefore, there exists a certain imperative which demands to use forecasting models that use discharge signals whenever available.</p><p> </p><p>Forecasting models are, however, not well suited when continuous measurement of discharge can not be guaranteed or for applications in ungauged settings. Regarding the former, missing data can have long lasting repercussions on data-driven models if large data-windows are used for the input. Regarding the latter, data-driven forecast models are not applicable at all. Additionally, we would like to point out that data-driven simulation models need to represent the underlying hydrological processes more closely since the setup explicitly reflects the rainfall-runoff relationship. To conclude, in many contexts, it is more appropriate to use process or simulation models, which do not use discharge as input.</p><p> </p><p>Despite the above mentioned difficulties of forecasting models it would nevertheless be beneficial to integrate, whenever available, past runoff information in simulation models in order to improve their accuracy. To this end, multiple potential approaches and strategies are available. In the context of conceptual or physically based rainfall-runoff models, recent runoff information is usually exploited by data assimilation/updating approaches (e.g. input-, state-, parameter- or output-updating). In this contribution we concentrate on input-updating approaches, since it allows to adjust the system for a forecasting period even if no explicit process can be attached to the system states.</p><p> </p><p>We propose and examine different input-updating techniques for DL-based runoff models that can be used as baselines for future studies on data-assimilation tasks and which can be used with arbitrary differentiable model. To test the proposed approaches, we perform a series of experiments on a large set of basins throughout the continental United States. The results show that even simple updating techniques can strongly improve the forecasting accuracy.   </p><p> </p>

Energies ◽  
2021 ◽  
Vol 14 (2) ◽  
pp. 345
Author(s):  
Janusz Sowinski

Forecasting of daily loads is crucial for the Distribution System Operators (DSO). Contemporary short-term load forecasting models (STLF) are very well recognized and described in numerous articles. One of such models is the Adaptive Neuro-Fuzzy Inference System (ANFIS), which requires a large set of historical data. A well-recognized issue both for the ANFIS and other daily load forecasting models is the selection of exogenous variables. This article attempts to verify the statement that an appropriate selection of exogenous variables of the ANFIS model affects the accuracy of the forecasts obtained ex post. This proposal seems to be a return to the roots of the Polish econometrics school and the use of the Hellwig method to select exogenous variables of the ANFIS model. In this context, it is also worth asking whether the use of the Hellwig method in conjunction with the ANFIS model makes it possible to investigate the significance of weather variables on the profile of the daily load in an energy company. The functioning of the ANFIS model was tested for some consumers exhibiting high load randomness located within the area under supervision of the examined power company. The load curves featuring seasonal variability and weekly similarity are suitable for forecasting with the ANFIS model. The Hellwig method has been used to select exogenous variables in the ANFIS model. The optimal set of variables has been determined on the basis of integral indicators of information capacity H. Including an additional variable, i.e., air temperature, has also been taken into consideration. Some results of ex post daily load forecast are presented.


2020 ◽  
Vol 45 (s1) ◽  
pp. 535-559
Author(s):  
Christian Pentzold ◽  
Lena Fölsche

AbstractOur article examines how journalistic reports and online comments have made sense of computational politics. It treats the discourse around data-driven campaigns as its object of analysis and codifies four main perspectives that have structured the debates about the use of large data sets and data analytics in elections. We study American, British, and German sources on the 2016 United States presidential election, the 2017 United Kingdom general election, and the 2017 German federal election. There, groups of speakers maneuvered between enthusiastic, skeptical, agnostic, or admonitory stances and so cannot be clearly mapped onto these four discursive positions. Coming along with the inconsistent accounts, public sensemaking was marked by an atmosphere of speculation about the substance and effects of computational politics. We conclude that this equivocality helped journalists and commentators to sideline prior reporting on the issue in order to repeatedly rediscover the practices they had already covered.


2013 ◽  
Vol 13 (3) ◽  
pp. 583-596 ◽  
Author(s):  
M. Coustau ◽  
S. Ricci ◽  
V. Borrell-Estupina ◽  
C. Bouvier ◽  
O. Thual

Abstract. Mediterranean catchments in southern France are threatened by potentially devastating fast floods which are difficult to anticipate. In order to improve the skill of rainfall-runoff models in predicting such flash floods, hydrologists use data assimilation techniques to provide real-time updates of the model using observational data. This approach seeks to reduce the uncertainties present in different components of the hydrological model (forcing, parameters or state variables) in order to minimize the error in simulated discharges. This article presents a data assimilation procedure, the best linear unbiased estimator (BLUE), used with the goal of improving the peak discharge predictions generated by an event-based hydrological model Soil Conservation Service lag and route (SCS-LR). For a given prediction date, selected model inputs are corrected by assimilating discharge data observed at the basin outlet. This study is conducted on the Lez Mediterranean basin in southern France. The key objectives of this article are (i) to select the parameter(s) which allow for the most efficient and reliable correction of the simulated discharges, (ii) to demonstrate the impact of the correction of the initial condition upon simulated discharges, and (iii) to identify and understand conditions in which this technique fails to improve the forecast skill. The correction of the initial moisture deficit of the soil reservoir proves to be the most efficient control parameter for adjusting the peak discharge. Using data assimilation, this correction leads to an average of 12% improvement in the flood peak magnitude forecast in 75% of cases. The investigation of the other 25% of cases points out a number of precautions for the appropriate use of this data assimilation procedure.


2018 ◽  
Vol 2 (10) ◽  
pp. 735-742 ◽  
Author(s):  
Martin Gerlach ◽  
Beatrice Farb ◽  
William Revelle ◽  
Luís A. Nunes Amaral

Author(s):  
Armando Cartenì

In this chapter attention is focused on the container terminal optimization problem, given that today most international cargo is transported through seaports and on containerized vessels. In this context, in order to manage a container terminal it is sometimes necessary to develop a Decision Support System (DSS). This chapter investigated the prediction reliability of container terminal simulation models (DSS), through a before and after analysis, taking advantage of some significant investment made by the Salerno Container Terminal (Italy) between 2003 and 2008. In particular, disaggregate and an aggregate simulation models implemented in 2003 were validated with a large set of data acquired in 2008 after some structural and functional terminal modifications. Through this analysis it was possible to study both the mathematical details required for model application and the field of application (prediction reliability) of the different simulation approaches implemented.


Author(s):  
Yalda Rahmati ◽  
Mohammadreza Khajeh Hosseini ◽  
Alireza Talebpour ◽  
Benjamin Swain ◽  
Christopher Nelson

Despite numerous studies on general human–robot interactions, in the context of transportation, automated vehicle (AV)–human driver interaction is not a well-studied subject. These vehicles have fundamentally different decision-making logic compared with human drivers and the driving interactions between AVs and humans can potentially change traffic flow dynamics. Accordingly, through an experimental study, this paper investigates whether there is a difference between human–human and human–AV interactions on the road. This study focuses on car-following behavior and conducted several car-following experiments utilizing Texas A&M University’s automated Chevy Bolt. Utilizing NGSIM US-101 dataset, two scenarios for a platoon of three vehicles were considered. For both scenarios, the leader of the platoon follows a series of speed profiles extracted from the NGSIM dataset. The second vehicle in the platoon can be either another human-driven vehicle (scenario A) or an AV (scenario B). Data is collected from the third vehicle in the platoon to characterize the changes in driving behavior when following an AV. A data-driven and a model-based approach were used to identify possible changes in driving behavior from scenario A to scenario B. The findings suggested there is a statistically significant difference between human drivers’ behavior in these two scenarios and human drivers felt more comfortable following the AV. Simulation results also revealed the importance of capturing these changes in human behavior in microscopic simulation models of mixed driving environments.


Sign in / Sign up

Export Citation Format

Share Document