scholarly journals Systematic errors analysis of heavy precipitating events prediction using a 30-year hindcast dataset

2019 ◽  
Author(s):  
Matteo Ponzano ◽  
Bruno Joly ◽  
Laurent Descamps ◽  
Philippe Arbogast

Abstract. The western Mediterranean region is prone to devastating flash-flood induced by heavy precipitation events (HPEs), which are responsible for considerable human and material damage. Quantitative precipitation forecasts have improved dramatically in recent years to produce realistic accumulated rainfall estimations. Nevertheless, challenging issues remain in reducing uncertainties in the initial conditions assimilation and the modeling of physical processes. In this study, the spatial errors resulting from a 30-year (1981–2010) ensemble hindcast which implement the same physical parametrizations as in the operational Météo-France short-range ensemble prediction system, Prévision d'Ensemble ARPEGE (PEARP), are analysed. The hindcast consists of a 10-member ensemble reforecast, run every 4-days, covering the period from September to December. 24-hour precipitation fields are classified in order to investigate the local variation of spatial properties and intensities of rainfall fields, with particular focus on the HPEs. The feature-based quality measure SAL is then performed on the model forecast and reference rainfall fields, which shows that both the amplitude and structure components are basically driven by the deep convection parametrization. Between the two main deep convection schemes used in PEARP, we qualify that the PCMT parametrization scheme performs better than the B85 scheme. A further analysis of spatial features of the rainfall objects to which the SAL metric pertains shows the predominance of large objects in the verification measure. It is for the most extreme events that the model has the best representation of the distribution of object integrated rain.

Author(s):  
A. Amengual ◽  
A. Hermoso ◽  
D. S. Carrió ◽  
V. Homar

AbstractOn 12 and 13 September 2019, widespread flash flooding caused devastating effects across eastern Spain. Within the framework of the HyMeX program, this study examines predictability of the long-lasting heavy precipitation episode (HPE) conducive to flash flooding. A set of short-range, convection-permitting ensemble prediction systems (EPSs) is built to cope with different sources of meteorological uncertainty. Specifically, the performance of an Ensemble Kalman Filter, tailored bred vectors and stochastic model parameterizations is compared to more standard ensemble generation techniques such as dynamical downscaling and multiple physics. Results indicate EPS focusing on sampling model uncertainties related to parameterization of subgrid process are skillful, especially when deep convection and its interaction with complex orography are important. Furthermore, representation of small-scale thermodynamical aspects is improved through data assimilation, leading to an enhanced forecasting skill as well. Nevertheless, predictability remains relatively low at the catchment scale in terms of exceedance probabilities in cumulative precipitation and peak discharge. The analysis presented herein could serve as a basis for the future implementation of real-time flash flood warning systems based on skillful meteorological EPSs over small-to-medium, semi-arid watersheds in eastern Spain and, by extension, over the flood-prone Western Mediterranean region.


2020 ◽  
Vol 20 (5) ◽  
pp. 1369-1389
Author(s):  
Matteo Ponzano ◽  
Bruno Joly ◽  
Laurent Descamps ◽  
Philippe Arbogast

Abstract. The western Mediterranean region is prone to devastating flash floods induced by heavy-precipitation events (HPEs), which are responsible for considerable human and material losses. Quantitative precipitation forecasts have improved dramatically in recent years to produce realistic accumulated rainfall estimations. Nevertheless, there are still challenging issues which must be resolved to reduce uncertainties in the initial condition assimilation and the modelling of physical processes. In this study, we analyse the HPE forecasting ability of the multi-physics-based ensemble model Prévision d’Ensemble ARPEGE (PEARP) operational at Météo-France. The analysis is based on 30-year (1981–2010) ensemble hindcasts which implement the same 10 physical parameterizations, one per member, run every 4 d. Over the same period a 24 h precipitation dataset is used as the reference for the verification procedure. Furthermore, regional classification is performed in order to investigate the local variation in spatial properties and intensities of rainfall fields, with a particular focus on HPEs. As grid-point verification tends to be perturbed by the double penalty issue, we focus on rainfall spatial pattern verification thanks to the feature-based quality measure of structure, amplitude, and location (SAL) that is performed on the model forecast and reference rainfall fields. The length of the dataset allows us to subsample scores for very intense rainfall at a regional scale and still obtain a significant analysis, demonstrating that such a procedure is consistent to study model behaviour in HPE forecasting. In the case of PEARP, we show that the amplitude and structure of the rainfall patterns are basically driven by the deep-convection parametrization. Between the two main deep-convection schemes used in PEARP, we qualify that the Prognostic Condensates Microphysics and Transport (PCMT) parametrization scheme performs better than the B85 scheme. A further analysis of spatial features of the rainfall objects to which the SAL metric pertains shows the predominance of large objects in the verification measure. It is for the most extreme events that the model has the best representation of the distribution of object-integrated rain.


2011 ◽  
Vol 11 (11) ◽  
pp. 30457-30485 ◽  
Author(s):  
P. Groenemeijer ◽  
G. C. Craig

Abstract. The stochastic Plant-Craig scheme for deep convection was implemented in the COSMO mesoscale model and used for ensemble forecasting. Ensembles consisting of 100 48 h forecasts at 7 km horizontal resolution were generated for a 2000 × 2000 km domain covering central Europe. Forecasts were made for seven case studies and characterized by different large-scale meteorological environments. Each 100 member ensemble consisted of 10 groups of 10 members, with each group driven by boundary and initial conditions from a selected member from the global ECMWF Ensemble Prediction System. The precipitation variability within and among these groups of members was computed, and it was found that the relative contribution to the ensemble variance introduced by the stochastic convection scheme was substantial, amounting to as much as 76% of the total variance in the ensemble in one of the studied cases. The impact of the scheme was not confined to the grid scale, and typically contributed 25–50% of the total variance even after the precipitation fields had been smoothed to a resolution of 35 km. The variability of precipitation introduced by the scheme was approximately proportional to the total amount of convection that occurred, while the variability due to large-scale conditions changed from case to case, being highest in cases exhibiting strong mid-tropospheric flow and pronounced meso- to synoptic scale vorticity extrema. The stochastic scheme was thus found to be an important source of variability in precipitation cases of weak large-scale flow lacking strong vorticity extrema, but high convective activity.


2010 ◽  
Vol 10 (11) ◽  
pp. 2371-2377 ◽  
Author(s):  
M. Vich ◽  
R. Romero

Abstract. The high-impact precipitation events that regularly affect the western Mediterranean coastal regions are still difficult to predict with the current prediction systems. Bearing this in mind, this paper focuses on the superensemble technique applied to the precipitation field. Encouraged by the skill shown by a previous multiphysics ensemble prediction system applied to western Mediterranean precipitation events, the superensemble is fed with this ensemble. The training phase of the superensemble contributes to the actual forecast with weights obtained by comparing the past performance of the ensemble members and the corresponding observed states. The non-hydrostatic MM5 mesoscale model is used to run the multiphysics ensemble. Simulations are performed with a 22.5 km resolution domain (Domain 1 in http://mm5forecasts.uib.es) nested in the ECMWF forecast fields. The period between September and December 2001 is used to train the superensemble and a collection of 19~MEDEX cyclones is used to test it. The verification procedure involves testing the superensemble performance and comparing it with that of the poor-man and bias-corrected ensemble mean and the multiphysic EPS control member. The results emphasize the need of a well-behaved training phase to obtain good results with the superensemble technique. A strategy to obtain this improved training phase is already outlined.


2012 ◽  
Vol 12 (10) ◽  
pp. 4555-4565 ◽  
Author(s):  
P. Groenemeijer ◽  
G. C. Craig

Abstract. The stochastic Plant-Craig scheme for deep convection was implemented in the COSMO mesoscale model and used for ensemble forecasting. Ensembles consisting of 100 48-h forecasts at 7 km horizontal resolution were generated for a 2000×2000 km domain covering central Europe. Forecasts were made for seven case studies characterized by different large-scale meteorological environments. Each 100 member ensemble consisted of 10 groups of 10 members, with each group driven by boundary and initial conditions from a selected member from the global ECMWF Ensemble Prediction System. The precipitation variability within and among these groups of members was computed, and it was found that the relative contribution to the ensemble variance introduced by the stochastic convection scheme was substantial, amounting to as much as 76% of the total variance in the ensemble in one of the studied cases. The impact of the scheme was not confined to the grid scale, and typically contributed 25–50% of the total variance even after the precipitation fields had been smoothed to a resolution of 35 km. The variability of precipitation introduced by the scheme was approximately proportional to the total amount of convection that occurred, while the variability due to large-scale conditions changed from case to case, being highest in cases exhibiting strong mid-tropospheric flow and pronounced meso- to synoptic scale vorticity extrema. The stochastic scheme was thus found to be an important source of variability in precipitation cases of weak large-scale flow lacking strong vorticity extrema, but high convective activity.


2019 ◽  
Vol 148 (1) ◽  
pp. 63-81 ◽  
Author(s):  
Kevin Bachmann ◽  
Christian Keil ◽  
George C. Craig ◽  
Martin Weissmann ◽  
Christian A. Welzbacher

Abstract We investigate the practical predictability limits of deep convection in a state-of-the-art, high-resolution, limited-area ensemble prediction system. A combination of sophisticated predictability measures, namely, believable and decorrelation scale, are applied to determine the predictable scales of short-term forecasts in a hierarchy of model configurations. First, we consider an idealized perfect model setup that includes both small-scale and synoptic-scale perturbations. We find increased predictability in the presence of orography and a strongly beneficial impact of radar data assimilation, which extends the forecast horizon by up to 6 h. Second, we examine realistic COSMO-KENDA simulations, including assimilation of radar and conventional data and a representation of model errors, for a convectively active two-week summer period over Germany. The results confirm increased predictability in orographic regions. We find that both latent heat nudging and ensemble Kalman filter assimilation of radar data lead to increased forecast skill, but the impact is smaller than in the idealized experiments. This highlights the need to assimilate spatially and temporally dense data, but also indicates room for further improvement. Finally, the examination of operational COSMO-DE-EPS ensemble forecasts for three summer periods confirms the beneficial impact of orography in a statistical sense and also reveals increased predictability in weather regimes controlled by synoptic forcing, as defined by the convective adjustment time scale.


2017 ◽  
Vol 21 (11) ◽  
pp. 5459-5476 ◽  
Author(s):  
Ida Maiello ◽  
Sabrina Gentile ◽  
Rossella Ferretti ◽  
Luca Baldini ◽  
Nicoletta Roberto ◽  
...  

Abstract. An analysis to evaluate the impact of multiple radar reflectivity data with a three-dimensional variational (3-D-Var) assimilation system on a heavy precipitation event is presented. The main goal is to build a regionally tuned numerical prediction model and a decision-support system for environmental civil protection services and demonstrate it in the central Italian regions, distinguishing which type of observations, conventional and not (or a combination of them), is more effective in improving the accuracy of the forecasted rainfall. In that respect, during the first special observation period (SOP1) of HyMeX (Hydrological cycle in the Mediterranean Experiment) campaign several intensive observing periods (IOPs) were launched and nine of which occurred in Italy. Among them, IOP4 is chosen for this study because of its low predictability regarding the exact location and amount of precipitation. This event hit central Italy on 14 September 2012 producing heavy precipitation and causing several cases of damage to buildings, infrastructure, and roads. Reflectivity data taken from three C-band Doppler radars running operationally during the event are assimilated using the 3-D-Var technique to improve high-resolution initial conditions. In order to evaluate the impact of the assimilation procedure at different horizontal resolutions and to assess the impact of assimilating reflectivity data from multiple radars, several experiments using the Weather Research and Forecasting (WRF) model are performed. Finally, traditional verification scores such as accuracy, equitable threat score, false alarm ratio, and frequency bias – interpreted by analysing their uncertainty through bootstrap confidence intervals (CIs) – are used to objectively compare the experiments, using rain gauge data as a benchmark.


2006 ◽  
Vol 21 (6) ◽  
pp. 1006-1023 ◽  
Author(s):  
Fang-Ching Chien ◽  
Yi-Chin Liu ◽  
Ben Jong-Dao Jou

Abstract This paper presents an evaluation study of a real-time fifth-generation Pennsylvania State University–NCAR Mesoscale Model (MM5) mesoscale ensemble prediction system in the Taiwan area during the 2003 mei-yu season. The ensemble system consists of 16 members that used the same nested domains of 45- and 15-km resolutions, but different model settings of the initial conditions (ICs), the cumulus parameterization scheme (CPS), and the microphysics scheme (MS). Verification of geopotential height, temperature, relative humidity, and winds in the 15-km grid shows that the members using the Kain–Fritsch CPS performed better than those using the Grell CPS, and those using the Central Weather Bureau (CWB) Nonhydrostatic Forecast System (NFS) ICs fared better than those using the CWB Global Forecast System (GFS) ICs. The members applying the mixed-phase MS generally exhibited the smallest errors among the four MSs. Precipitation verification shows that the members using the Grell CPS, in general, had higher equitable threat scores (ETSs) than those using the Kain–Fritsch CPS, that the members with the GFS ICs performed better than with the NFS ICs, and that the mixed-phase and Goddard MSs gave relatively high ETSs in the rainfall simulation. The bias scores show that, overall, all 16 members underforecasted rainfall. Comparisons of the ensemble means show that, on average, an ensemble mean, no matter how many members it contains, can produce better forecasts than an individual member. Among the three possible elements (IC, CPS, and MS) that can be varied to compose an ensemble, the ensemble that contains members with all three elements varying performed the best, while that with two elements varying was second best, and that with only one varying was the worst. Furthermore, the first choice for composing an ensemble is to use perturbed ICs, followed by the perturbed CPS, and then the perturbed MS.


2008 ◽  
Vol 136 (2) ◽  
pp. 443-462 ◽  
Author(s):  
Xiaoli Li ◽  
Martin Charron ◽  
Lubos Spacek ◽  
Guillem Candille

Abstract A regional ensemble prediction system (REPS) with the limited-area version of the Canadian Global Environmental Multiscale (GEM) model at 15-km horizontal resolution is developed and tested. The total energy norm singular vectors (SVs) targeted over northeastern North America are used for initial and boundary perturbations. Two SV perturbation strategies are tested: dry SVs with dry simplified physics and moist SVs with simplified physics, including stratiform condensation and convective precipitation as well as dry processes. Model physics uncertainties are partly accounted for by stochastically perturbing two parameters: the threshold vertical velocity in the trigger function of the Kain–Fritsch deep convection scheme, and the threshold humidity in the Sundqvist explicit scheme. The perturbations are obtained from first-order Markov processes. Short-range ensemble forecasts in summer with 16 members are performed for five different experiments. The experiments employ different perturbation and piloting strategies, and two different surface schemes. Verification focuses on quantitative precipitation forecasts and is done using a range of probabilistic measures. Results indicate that using moist SVs instead of dry SVs has a stronger impact on precipitation than on dynamical fields. Forecast skill for precipitation is greatly influenced by the dominant synoptic weather systems. For stratiform precipitation caused by strong baroclinic systems, the forecast skill is improved in the moist SV experiments relative to the dry SV experiments. For convective precipitation rates in the range 15–50 mm (24 h)−1 produced by weak synoptic baroclinic systems, all experiments exhibit noticeably poorer forecast skills. Skill improvements due to the Interactions between Soil, Biosphere, and Atmosphere (ISBA) surface scheme and stochastic perturbations are also observed.


2009 ◽  
Vol 6 (4) ◽  
pp. 4891-4917
Author(s):  
J. A. Velázquez ◽  
T. Petit ◽  
A. Lavoie ◽  
M.-A. Boucher ◽  
R. Turcotte ◽  
...  

Abstract. Hydrological forecasting consists in the assessment of future streamflow. Current deterministic forecasts do not give any information concerning the uncertainty, which might be limiting in a decision-making process. Ensemble forecasts are expected to fill this gap. In July 2007, the Meteorological Service of Canada has improved its ensemble prediction system, which has been operational since 1998. It uses the GEM model to generate a 20-member ensemble on a 100 km grid, at mid-latitudes. This improved system is used for the first time for hydrological ensemble predictions. Five watersheds in Quebec (Canada) are studied: Chaudière, Châteauguay, Du Nord, Kénogami and Du Lièvre. An interesting 17-day rainfall event has been selected in October 2007. Forecasts are produced in a 3 h time step for a 3-day forecast horizon. The deterministic forecast is also available and it is compared with the ensemble ones. In order to correct the bias of the ensemble, an updating procedure has been applied to the output data. Results showed that ensemble forecasts are more skilful than the deterministic ones, as measured by the Continuous Ranked Probability Score (CRPS), especially for 72 h forecasts. However, the hydrological ensemble forecasts are under dispersed: a situation that improves with the increasing length of the prediction horizons. We conjecture that this is due in part to the fact that uncertainty in the initial conditions of the hydrological model is not taken into account.


Sign in / Sign up

Export Citation Format

Share Document