Post-Processing Ensemble Weather Forecasts for Introducing Multisite and Multivariable Correlations using Rank Shuffle and Copula Theory

Statistical methods have been widely used to post-process ensemble weather forecasts for hydrological predictions. However, most of the statistical post-processing methods apply to a single weather variable at a single location, thus neglecting the inter-site and inter-variable dependence structures of forecast variables. This study synthesized a multisite and multivariate (MSMV) post-processing framework that extends the univariate method to the MSMV version by directly rearranging the post-processed ensemble members (post-reordering strategy) or by rearranging the latent variables used in univariate method (pre-reordering strategy). Based on the univariate Generator-based Post-Processing (GPP) method, the two reordering strategies and three dependence reconstruction methods (Rank shuffle (RS), Gaussian Copula (GC), and Empirical Copula (EC)) totaling 6 MSMV methods (RS-Pre, GC-Pre, EC-Pre, RS-Post, GC-Post, and EC-Post) were evaluated in post-processing ensemble precipitation and temperature forecasts for the Xiangjiang Basin in China using the 11-member ensemble forecasts from the Global Ensemble Forecasting System (GEFS). The results showed that raw GEFS forecasts tend to be biased for both the forecast ensembles and the inter-site and inter-variable dependencies. Univariate method can improve the univariate performance of ensemble mean and spread but misrepresent the inter-site and inter-variable dependence among the forecast variables. The MSMV framework can well utilize the advantages of the univariate method and also reconstruct the inter-site and inter-variable dependencies. Among the six methods, RS-Pre, RS-Post, GC-Post, and EC-Post perform better than the others with respect to reproducing the univariate statistics and multivariable dependences. The post-reordering strategy is recommended to combine the univariate method (i.e. GPP) and reconstruction methods.

Sequential Aggregation of Probabilistic Forecasts - Applicaton to Wind Speed Ensemble Forecasts

<p>Sequential aggregation is a theoretically-grounded means to combine several forecasts of a quantity to achieve better forecast performance as evaluated by a loss function. This theory has been mainly applied to point forecasts with a scalar forecast quantity, but rarely to forecasts expressed in a probabilistic form. In this work, we show how this theory can be readily adapted to forecasts expressed as step-wise cumulative distribution function (CDF), with the continuous ranked probabilistic score (CRPS) as performance measure.</p><p>Ensemble weather forecasts estimate the outcome of future observed quantities in a way that can be interpreted as step-wise CDF. Since those forecast CDFs are biased, statistical postprocessing methods are used to improve their statistical coherency with the observed quantity. Since many ensembles and many postprocessing methods exist, one can combine raw and post-processed ensembles in order to get even better forecast performance. To illustrate this point and the advantages of blending CDFs, sequential aggregation is applied to wind-speed ensemble weather forecasts with the CRPS as a performance measure alongside the Jolliffe-Primo test to assess the reliability of the various (raw, post-processed or aggregated) forecasts.</p>

Statistical post-processing of ensemble forecasts at the Belgian met service

<p>Statistical post-processing of ensemble weather forecasts has become an essential step in the forecasting chain as it enables the correction of biases and reliable uncertainty estimates of ensembles (Gneiting, 2014).  One algorithm recently proposed to perform the correction of ensemble weather forecasts is a linear member-by-member (MBM) Model Output Statistics (MOS) system, post-processing each member of the ECMWF ensemble (Van Schaeybroeck & Vannitsem, 2015). This method consists in correcting the mean and variability of the ensemble members in line with the observed climatology. At the same time, it calibrates the ensemble spread such as to match, on average, the mean square error of the ensemble mean. The MBM method calibrates the ensemble forecasts based on the station observations by minimizing the continuous ranked probability score (CRPS).</p><p><span>Using this method, the Royal Meteorological Institute of Belgium has started in 2020 its new postprocessing program by developing an operational application to perform the calibration of the ECMWF ensemble forecasts at the stations points for the minimum and maximum temperature, and for wind gusts. </span>In this report, we will first describe briefly the postprocessing methods being used and the architecture of the application. We will then present the results over the first few months of operation. Finally, we will discuss the future developments of this application and of the program.</p><p><span><br></span></p><p><span> </span> <span> </span></p><p><strong>Gneiting</strong>, <strong>T.</strong>, 2014: Calibration of medium-range weather forecasts. <em>ECMWF Technical Memorandum</em> <strong>No. 719</strong></p><p><span> </span> <span> </span></p><p><strong>Van Schaeybroeck</strong>, <strong>B.</strong> & <strong>Vannitsem</strong>, <strong>S.</strong>, 2015: Ensemble post-processing using member-by-member approaches: theoretical aspects. <em>Quarterly Journal of the Royal Meteorological Society</em>, <strong>141</strong>, 807–818.</p>

A new view of heat wave dynamics and predictability over the eastern Mediterranean

Skillful forecasts of extreme weather events have a major socioeconomic relevance. Here, we compare two complementary approaches to diagnose the predictability of extreme weather: recent developments in dynamical systems theory and numerical ensemble weather forecasts. The former allows us to define atmospheric configurations in terms of their persistence and local dimension, which provides information on how the atmosphere evolves to and from a given state of interest. These metrics may be used as proxies for the intrinsic predictability of the atmosphere, which only depends on the atmosphere's properties. Ensemble weather forecasts provide information on the practical predictability of the atmosphere, which partly depends on the performance of the numerical model used. We focus on heat waves affecting the eastern Mediterranean. These are identified using the climatic stress index (CSI), which was explicitly developed for the summer weather conditions in this region and differentiates between heat waves (upper decile) and cool days (lower decile). Significant differences are found between the two groups from both the dynamical systems and the numerical weather prediction perspectives. Specifically, heat waves show relatively stable flow characteristics (high intrinsic predictability) but comparatively low practical predictability (large model spread and error). For 500 hPa geopotential height fields, the intrinsic predictability of heat waves is lowest at the event's onset and decay. We relate these results to the physical processes governing eastern Mediterranean summer heat waves: adiabatic descent of the air parcels over the region and the geographical origin of the air parcels over land prior to the onset of a heat wave. A detailed analysis of the mid-August 2010 record-breaking heat wave provides further insights into the range of different regional atmospheric configurations conducive to heat waves. We conclude that the dynamical systems approach can be a useful complement to conventional numerical forecasts for understanding the dynamics and predictability of eastern Mediterranean heat waves.

A New View of Heat Wave Dynamics and Predictability over the Eastern Mediterranean

Skillful forecasts of extreme weather events have a major socio-economic relevance. Here, we compare two complementary approaches to diagnose the predictability of extreme weather: recent developments in dynamical systems theory and numerical ensemble weather forecasts. The former allows us to define atmospheric configurations in terms of their persistence and local dimension, which inform on how the atmosphere evolves to and from a given state of interest. These metrics may be used as proxies for the intrinsic predictability of the atmosphere, which depends exclusively on the atmosphere’s properties. Ensemble weather forecasts inform on the practical predictability of the atmosphere, which primarily depends on the performance of the numerical model used. We focus on heat waves affecting the Eastern Mediterranean. These are identified using the Climatic Stress Index (CSI), which was explicitly developed for the summer weather conditions in this region and differentiates between heat waves (upper decile) and cool days (lower decile). Significant differences are found between the two groups from both the dynamical systems and the numerical weather prediction perspectives. Specifically, heat waves show relatively stable flow characteristics (high intrinsic predictability), but comparatively low practical predictability (large model spread/error). For 500 hPa geopotential height fields, the intrinsic predictability of heat waves is lowest at the event’s onset and decay. We relate these results to the physical processes governing Eastern Mediterranean summer heat waves: adiabatic descent of the air parcels over the region and the geographical origin of the air parcels over land prior to the onset of a heat wave. A detailed analysis of the mid-August 2010 record-breaking heat wave provides further insights into the range of different regional atmospheric configurations conducive to heat waves. We conclude that the dynamical systems approach can be a useful complement to conventional numerical forecasts for understanding the dynamics of Eastern Mediterranean heat waves.

The similarity-based method: a new object detection method for deterministic and ensemble weather forecasts

A new object-oriented method has been developed to detect hazardous phenomena predicted by Numerical Weather Prediction (NWP) models. This method, called similarity-based method, is looking for specific meteorological objects in the forecasts, which are defined by a reference histogram representing the meteorological phenomena to be detected. The similarity-based method enables to cope with small scale unpredictable details of mesoscale structures in meteorological models and to quantify the uncertainties on the location of the predicted phenomena. Applied to ensemble forecasts, the similarity-based method can be viewed as a particular case of neighborhood processing, allowing spatialized probabilities to be computed. An application to rainfall detection using forecasts from the AROME deterministic and ensemble models is presented.

Probabilistic Flood Forecasting Using Hydrologic Uncertainty Processor with Ensemble Weather Forecasts

Recent advances in the field of flood forecasting have shown increased interests in probabilistic forecasting as it provides not only the point forecast but also the assessment of associated uncertainty. Here, an investigation of a hydrologic uncertainty processor (HUP) as a postprocessor of ensemble forecasts to generate probabilistic flood forecasts is presented. The main purpose is to quantify dominant uncertainties and enhance flood forecast reliability. HUP is based on Bayes’s theorem and designed to capture hydrologic uncertainty. Ensemble forecasts are forced by ensemble weather forecasts from the Global Ensemble Prediction System (GEPS) that are inherently uncertain, and the input uncertainty propagates through the model chain and integrates with hydrologic uncertainty in HUP. The bias of GEPS was removed using multivariate bias correction, and several scenarios were developed by different combinations of GEPS with HUP. The performance of different forecast horizons for these scenarios was compared using multifaceted evaluation metrics. Results show that HUP is able to improve the performance for both short- and medium-range forecasts; the improvement is significant for short lead times and becomes less obvious with increasing lead time. Overall, the performances for short-range forecasts when using HUP are promising, and the most satisfactory result for the short range is obtained by applying bias correction to each ensemble member plus applying the HUP postprocessor.

Machine Learning Techniques for Predicting the Energy Consumption/Production and Its Uncertainties Driven by Meteorological Observations and Forecasts

Reliable predictions of the energy consumption and production is important information for the management and integration of renewable energy sources. Several different Machine Learning (ML) methodologies have been tested for predicting the energy consumption/production based on the information of hydro-meteorological data. The methods analysed include Multivariate Adaptive Regression Splines (MARS) and various Quantile Regression (QR) models like Quantile Random Forest (QRF) and Gradient Boosting Machines (GBM). Additionally, a Nonhomogeneous Gaussian Regression (NGR) approach has been tested for combining and calibrating monthly ML based forecasts driven by ensemble weather forecasts. The novelty and main focus of this study is the comparison of the capability of ML methods for producing reliable predictive uncertainties and the application of monthly weather forecasts. Different skill scores have been used to verify the predictions and their uncertainties and first results for combining the ML methods applying the NGR approach and coupling the predictions with monthly ensemble weather forecasts are shown for the southern Switzerland (Canton of Ticino). These results highlight the possibilities of improvements using ML methods and the importance of optimally combining different ML methods for achieving more accurate estimates of future energy consumptions and productions with sharper prediction uncertainty estimates (i.e., narrower prediction intervals).