scholarly journals The benefits of ensemble prediction for forecasting an extreme event: The Queensland Floods of February 2019

Author(s):  
Matt Hawcroft ◽  
Sally Lavender ◽  
Dan Copsey ◽  
Sean Milton ◽  
José Rodríguez ◽  
...  

AbstractFrom late January to early February 2019, a quasi-stationary monsoon depression situated over northeast Australia caused devastating floods. During the first week of February, when the event had its greatest impact in northwest Queensland, record-breaking precipitation accumulations were observed in several locations, accompanied by strong winds, substantial cold maximum temperature anomalies and related wind chill. In spite of the extreme nature of the event, the monthly rainfall outlook for February issued by Australia’s Bureau of Meteorology on 31st January provided no indication of the event. In this study, we evaluate the dynamics of the event and assess how predictable it was across a suite of ensemble model forecasts using the UK Met Office numerical weather prediction (NWP) system, focussing on a one week lead time. In doing so, we demonstrate the skill of the NWP system in predicting the possibility of such an extreme event occurring. We further evaluate the benefits derived from running the ensemble prediction system at higher resolution than used operationally at the Met Office and with a fully coupled dynamical ocean. We show that the primary forecast errors are generated locally, with key sources of these errors including atmosphere-ocean coupling and a known bias associated with the behaviour of the convection scheme around the coast. We note that a relatively low resolution ensemble approach requires limited computing resource, yet has the capacity in this event to provide useful information to decision makers with over aweek’s notice, beyond the duration of many operational deterministic forecasts.

2003 ◽  
Vol 10 (6) ◽  
pp. 469-475 ◽  
Author(s):  
J. C. W. Denholm-Price

Abstract. Can a relatively small numerical weather prediction ensemble produce any more forecast information than can be reproduced by a Gaussian probability density function (PDF)? This question is examined using site-specific probability forecasts from the UK Met Office. These forecasts are based on the 51-member Ensemble Prediction System of the European Centre for Medium-range Weather Forecasts. Verification using Brier skill scores suggests that there can be statistically-significant skill in the ensemble forecast PDF compared with a Gaussian fit to the ensemble. The most significant increases in skill were achieved from bias-corrected, calibrated forecasts and for probability forecasts of thresholds that are located well inside the climatological limits at the examined sites. Forecast probabilities for more climatologically-extreme thresholds, where the verification more often lies within the tails or outside of the PDF, showed little difference in skill between the forecast PDF and the Gaussian forecast.


2015 ◽  
Vol 143 (12) ◽  
pp. 5091-5114 ◽  
Author(s):  
K. I. Hodges ◽  
R. Emerton

Abstract This study has explored the prediction errors of tropical cyclones (TCs) in the European Centre for Medium-Range Weather Forecasts (ECMWF) Ensemble Prediction System (EPS) for the Northern Hemisphere summer period for five recent years. Results for the EPS are contrasted with those for the higher-resolution deterministic forecasts. Various metrics of location and intensity errors are considered and contrasted for verification based on IBTrACS and the numerical weather prediction (NWP) analysis (NWPa). Motivated by the aim of exploring extended TC life cycles, location and intensity measures are introduced based on lower-tropospheric vorticity, which is contrasted with traditional verification metrics. Results show that location errors are almost identical when verified against IBTrACS or the NWPa. However, intensity in the form of the mean sea level pressure (MSLP) minima and 10-m wind speed maxima is significantly underpredicted relative to IBTrACS. Using the NWPa for verification results in much better consistency between the different intensity error metrics and indicates that the lower-tropospheric vorticity provides a good indication of vortex strength, with error results showing similar relationships to those based on MSLP and 10-m wind speeds for the different forecast types. The interannual variation in forecast errors are discussed in relation to changes in the forecast and NWPa system and variations in forecast errors between different ocean basins are discussed in terms of the propagation characteristics of the TCs.


2018 ◽  
Vol 146 (10) ◽  
pp. 3481-3498 ◽  
Author(s):  
Angela Benedetti ◽  
Frédéric Vitart

Abstract The fact that aerosols are important players in Earth’s radiation balance is well accepted by the scientific community. Several studies have shown the importance of characterizing aerosols in order to constrain surface radiative fluxes and temperature in climate runs. In numerical weather prediction, however, there has not been definite proof that interactive aerosol schemes are needed to improve the forecast. Climatologies are instead used that allow for computational efficiency and reasonable accuracy. At the monthly to subseasonal range, it is still worth investigating whether aerosol variability could afford some predictability, considering that it is likely that persisting aerosol biases might manifest themselves more over time scales of weeks to months and create a nonnegligible forcing. This paper explores this hypothesis using the ECMWF’s Ensemble Prediction System for subseasonal prediction with interactive prognostic aerosols. Four experiments are conducted with the aim of comparing the monthly prediction by the default system, which uses aerosol climatologies, with the prediction using radiatively interactive aerosols. Only the direct aerosol effect is considered. Twelve years of reforecasts with 50 ensemble members are analyzed on the monthly scale. Results indicate that the interactive aerosols have the capability of improving the subseasonal prediction at the monthly scales for the spring/summer season. It is hypothesized that this is due to the aerosol variability connected to the different phases of the Madden–Julian oscillation, particularly that of dust and carbonaceous aerosols. The degree of improvement depends crucially on the aerosol initialization. More work is required to fully assess the potential of interactive aerosols to increase predictability at the subseasonal scales.


Author(s):  
Jingzhuo Wang ◽  
Jing Chen ◽  
Hanbin Zhang ◽  
Hua Tian ◽  
Yining Shi

AbstractEnsemble forecast is a method to faithfully describe initial and model uncertainties in a weather forecasting system. Initial uncertainties are much more important than model uncertainties in the short-range numerical prediction. Currently, initial uncertainties are described by Ensemble Transform Kalman Filter (ETKF) initial perturbation method in Global and Regional Assimilation and Prediction Enhanced System-Regional Ensemble Prediction System (GRAPES-REPS). However, an initial perturbation distribution similar to the analysis error cannot be yielded in the ETKF method of the GRAPES-REPS. To improve the method, we introduce a regional rescaling factor into the ETKF method (we call it ETKF_R). We also compare the results between the ETKF and ETKF_R methods and further demonstrate how rescaling can affect the initial perturbation characteristics as well as the ensemble forecast skills. The characteristics of the initial ensemble perturbation improve after applying the ETKF_R method. For example, the initial perturbation structures become more reasonable, the perturbations are better able to explain the forecast errors at short lead times, and the lower kinetic energy spectrum as well as perturbation energy at the initial forecast times can lead to a higher growth rate of themselves. Additionally, the ensemble forecast verification results suggest that the ETKF_R method has a better spread-skill relationship, a faster ensemble spread growth rate and a more reasonable rank histogram distribution than ETKF. Furthermore, the rescaling has only a minor impact on the assessment of the sharpness of probabilistic forecasts. The above results all suggest that ETKF_R can be effectively applied to the operational GRAPES-REPS.


2008 ◽  
Vol 8 (3) ◽  
pp. 445-460 ◽  
Author(s):  
M. P. Mittermaier

Abstract. A simple measure of the uncertainty associated with using radar-derived rainfall estimates as "truth" has been introduced to the Numerical Weather Prediction (NWP) verification process to assess the effect on forecast skill and errors. Deterministic precipitation forecasts from the mesoscale version of the UK Met Office Unified Model for a two-day high-impact event and for a month were verified at the daily and six-hourly time scale using a spatially-based intensity-scale method and various traditional skill scores such as the Equitable Threat Score (ETS) and log-odds ratio. Radar-rainfall accumulations from the UK Nimrod radar-composite were used. The results show that the inclusion of uncertainty has some effect, shifting the forecast errors and skill. The study also allowed for the comparison of results from the intensity-scale method and traditional skill scores. It showed that the two methods complement each other, one detailing the scale and rainfall accumulation thresholds where the errors occur, the other showing how skillful the forecast is. It was also found that for the six-hourly forecasts the error distributions remain similar with forecast lead time but skill decreases. This highlights the difference between forecast error and forecast skill, and that they are not necessarily the same.


2013 ◽  
Vol 141 (10) ◽  
pp. 3498-3516 ◽  
Author(s):  
Luca Delle Monache ◽  
F. Anthony Eckel ◽  
Daran L. Rife ◽  
Badrinath Nagarajan ◽  
Keith Searight

Abstract This study explores an analog-based method to generate an ensemble [analog ensemble (AnEn)] in which the probability distribution of the future state of the atmosphere is estimated with a set of past observations that correspond to the best analogs of a deterministic numerical weather prediction (NWP). An analog for a given location and forecast lead time is defined as a past prediction, from the same model, that has similar values for selected features of the current model forecast. The AnEn is evaluated for 0–48-h probabilistic predictions of 10-m wind speed and 2-m temperature over the contiguous United States and against observations provided by 550 surface stations, over the 23 April–31 July 2011 period. The AnEn is generated from the Environment Canada (EC) deterministic Global Environmental Multiscale (GEM) model and a 12–15-month-long training period of forecasts and observations. The skill and value of AnEn predictions are compared with forecasts from a state-of-the-science NWP ensemble system, the 21-member Regional Ensemble Prediction System (REPS). The AnEn exhibits high statistical consistency and reliability and the ability to capture the flow-dependent behavior of errors, and it has equal or superior skill and value compared to forecasts generated via logistic regression (LR) applied to both the deterministic GEM (as in AnEn) and REPS [ensemble model output statistics (EMOS)]. The real-time computational cost of AnEn and LR is lower than EMOS.


2017 ◽  
Vol 32 (3) ◽  
pp. 1185-1208 ◽  
Author(s):  
Phillipa Cookson-Hills ◽  
Daniel J. Kirshbaum ◽  
Madalina Surcel ◽  
Jonathan G. Doyle ◽  
Luc Fillion ◽  
...  

Abstract Environment and Climate Change Canada (ECCC) has recently developed an experimental high-resolution EnKF (HREnKF) regional ensemble prediction system, which it tested over the Pacific Northwest of North America for the first half of February 2011. The HREnKF has 2.5-km horizontal grid spacing and assimilates surface and upper-air observations every hour. To determine the benefits of the HREnKF over less expensive alternatives, its 24-h quantitative precipitation forecasts are compared with those from a lower-resolution (15 km) regional ensemble Kalman filter (REnKF) system and to ensembles directly downscaled from the REnKF using the same grid as the HREnKF but with no additional data assimilation (DS). The forecasts are verified against rain gauge observations and gridded precipitation analyses, the latter of which are characterized by uncertainties of comparable magnitude to the model forecast errors. Nonetheless, both deterministic and probabilistic verification indicates robust improvements in forecast skill owing to the finer grids of the HREnKF and DS. The HREnKF exhibits a further improvement in performance over the DS in the first few forecast hours, suggesting a modest positive impact of data assimilation. However, this improvement is not statistically significant and may be attributable to other factors.


2019 ◽  
Vol 34 (6) ◽  
pp. 1675-1691 ◽  
Author(s):  
Yu Xia ◽  
Jing Chen ◽  
Jun Du ◽  
Xiefei Zhi ◽  
Jingzhuo Wang ◽  
...  

Abstract This study experimented with a unified scheme of stochastic physics and bias correction within a regional ensemble model [Global and Regional Assimilation and Prediction System–Regional Ensemble Prediction System (GRAPES-REPS)]. It is intended to improve ensemble prediction skill by reducing both random and systematic errors at the same time. Three experiments were performed on top of GRAPES-REPS. The first experiment adds only the stochastic physics. The second experiment adds only the bias correction scheme. The third experiment adds both the stochastic physics and bias correction. The experimental period is one month from 1 to 31 July 2015 over the China domain. Using 850-hPa temperature as an example, the study reveals the following: 1) the stochastic physics can effectively increase the ensemble spread, while the bias correction cannot. Therefore, ensemble averaging of the stochastic physics runs can reduce more random error than the bias correction runs. 2) Bias correction can significantly reduce systematic error, while the stochastic physics cannot. As a result, the bias correction greatly improved the quality of ensemble mean forecasts but the stochastic physics did not. 3) The unified scheme can greatly reduce both random and systematic errors at the same time and performed the best of the three experiments. These results were further confirmed by verification of the ensemble mean, spread, and probabilistic forecasts of many other atmospheric fields for both upper air and the surface, including precipitation. Based on this study, we recommend that operational numerical weather prediction centers adopt this unified scheme approach in ensemble models to achieve the best forecasts.


2005 ◽  
Vol 9 (4) ◽  
pp. 300-312 ◽  
Author(s):  
K. Sattler ◽  
H. Feddersen

Abstract. Inherent uncertainties in short-range quantitative precipitation forecasts (QPF) from the high-resolution, limited-area numerical weather prediction model DMI-HIRLAM (LAM) are addressed using two different approaches to creating a small ensemble of LAM simulations, with focus on prediction of extreme rainfall events over European river basins. The first ensemble type is designed to represent uncertainty in the atmospheric state of the initial condition and at the lateral LAM boundaries. The global ensemble prediction system (EPS) from ECMWF serves as host model to the LAM and provides the state perturbations, from which a small set of significant members is selected. The significance is estimated on the basis of accumulated precipitation over a target area of interest, which contains the river basin(s) under consideration. The selected members provide the initial and boundary data for the ensemble integration in the LAM. A second ensemble approach tries to address a portion of the model-inherent uncertainty responsible for errors in the forecasted precipitation field by utilising different parameterisation schemes for condensation and convection in the LAM. Three periods around historical heavy rain events that caused or contributed to disastrous river flooding in Europe are used to study the performance of the LAM ensemble designs. The three cases exhibit different dynamic and synoptic characteristics and provide an indication of the ensemble qualities in different weather situations. Precipitation analyses from the Deutsche Wetterdienst (DWD) are used as the verifying reference and a comparison of daily rainfall amounts is referred to the respective river basins of the historical cases.


2017 ◽  
Vol 32 (3) ◽  
pp. 1041-1056 ◽  
Author(s):  
Roderick van der Linden ◽  
Andreas H. Fink ◽  
Joaquim G. Pinto ◽  
Tan Phan-Van

Abstract A record-breaking rainfall event occurred in northeastern Vietnam in late July–early August 2015. The coastal region in Quang Ninh Province was hit severely, with station rainfall sums in the range of 1000–1500 mm. The heavy rainfall led to flooding and landslides, which resulted in an estimated economic loss of $108 million (U.S. dollars) and 32 fatalities. Using a multitude of data sources and ECMWF ensemble forecasts, the synoptic–dynamic development and practical predictability of the event is investigated in detail for the 4-day period from 1200 UTC 25 July to 1200 UTC 29 July 2015, during which the major portion of the rainfall was observed. A slowly moving upper-level subtropical trough and the associated surface low in the northern Gulf of Tonkin promoted sustained moisture convergence and convection over northeastern Vietnam. The humidity was advected in a moisture transport band lying across the Indochina Peninsula and emanating from a tropical storm over the Bay of Bengal. Analyses of the ECMWF ensemble forecasts clearly showed a sudden emergence of the predictability of the extreme event at lead times of 3 days that was associated with the correct forecasts of the intensity and location of the subtropical trough in the 51 ensemble members. Thus, the Quang Ninh event is a good example in which the predictability of tropical convection arises from large-scale synoptic forcing; in the present case it was due to a tropical–extratropical interaction that has not been documented before for the region and season.


Sign in / Sign up

Export Citation Format

Share Document