Evaluation of Convection-Permitting Precipitation Forecast Products Using WRF, NMMB, and FV3 for the 2016–17 NOAA Hydrometeorology Testbed Flash Flood and Intense Rainfall Experiments

2019 ◽  
Vol 34 (3) ◽  
pp. 781-804 ◽  
Author(s):  
Nathan Snook ◽  
Fanyou Kong ◽  
Keith A. Brewster ◽  
Ming Xue ◽  
Kevin W. Thomas ◽  
...  
Keyword(s):  
Mesoscale Model ◽  
Flash Flood ◽  
Precipitation Forecast ◽  
Small Scale ◽  
Intense Rainfall ◽  
Ensemble Forecasts ◽  
Probabilistic Forecasts ◽  
Ensemble Mean ◽  
Substantial Bias ◽  
Cubed Sphere

Abstract During the summers of 2016 and 2017, the Center for Analysis and Prediction of Storms (CAPS) ran real-time storm-scale ensemble forecasts (SSEFs) in support of the Hydrometeorology Testbed (HMT) Flash Flood and Intense Rainfall (FFaIR) experiment. These forecasts, using WRF-ARW and Nonhydrostatic Mesoscale Model on the B-grid (NMMB) in 2016, and WRF-ARW and GFDL Finite Volume Cubed-Sphere Dynamical Core (FV3) in 2017, covered the contiguous United States at 3-km horizontal grid spacing, and supported the generation and evaluation of precipitation forecast products, including ensemble probabilistic products. Forecasts of 3-h precipitation accumulation are evaluated. Overall, the SSEF produces skillful 3-h accumulated precipitation forecasts, with ARW members generally outperforming NMMB members and the single FV3 member run in 2017 outperforming ARW members; these differences are significant at some forecast hours. Statistically significant differences exist in the performance, in terms of bias and ETS, among subensembles of members sharing common microphysics and PBL schemes. Year-to-year consistency is higher for PBL subensembles than for microphysical subensembles. Probability-matched (PM) ensemble mean forecasts outperform individual members, while the simple ensemble mean exhibits substantial bias. A newly developed localized probability-matched (LPM) ensemble mean product was produced in 2017; compared to the simple ensemble mean and the conventional PM mean, the LPM mean exhibits improved retention of small-scale structures, evident in both 2D forecast fields and variance spectra. Probabilistic forecasts of precipitation exceeding flash flood guidance (FFG) or thresholds associated with recurrence intervals (RI) ranging from 10 to 100 years show utility in predicting regions of flooding threat, but generally overpredict the occurrence of such events; however, they may still be useful in subjective flash flood risk assessment.

scholarly journals Multiscale Mountain Waves Influencing a Major Orographic Precipitation Event

2007 ◽  
Vol 64 (3) ◽  
pp. 711-737 ◽  
Author(s):  
Matthew F. Garvert ◽  
Bradley Smull ◽  
Cliff Mass
Keyword(s):  
Mesoscale Model ◽  
Precipitation Forecast ◽  
Precipitation Event ◽  
Small Scale ◽  
Second Phase ◽  
Mountain Waves ◽  
Low Level ◽  
Orographic Rainfall ◽  
Vertically Propagating ◽  
Horizontal Wavelength

Abstract This study combines high-resolution mesoscale model simulations and comprehensive airborne Doppler radar observations to identify kinematic structures influencing the production and mesoscale distribution of precipitation and microphysical processes during a period of heavy prefrontal orographic rainfall over the Cascade Mountains of Oregon on 13–14 December 2001 during the second phase of the Improvement of Microphysical Parameterization through Observational Verification Experiment (IMPROVE-2) field program. Airborne-based radar detection of precipitation from well upstream of the Cascades to the lee allows a depiction of terrain-induced wave motions in unprecedented detail. Two distinct scales of mesoscale wave–like air motions are identified: 1) a vertically propagating mountain wave anchored to the Cascade crest associated with strong midlevel zonal (i.e., cross barrier) flow, and 2) smaller-scale (<20-km horizontal wavelength) undulations over the windward foothills triggered by interaction of the low-level along-barrier flow with multiple ridge–valley corrugations oriented perpendicular to the Cascade crest. These undulations modulate cloud liquid water (CLW) and snow mixing ratios in the fifth-generation Pennsylvania State University–National Center for Atmospheric Research (PSU–NCAR) Mesoscale Model (MM5), with modeled structures comparing favorably to radar-documented zones of enhanced reflectivity and CLW measured by the NOAA P3 aircraft. Errors in the model representation of a low-level shear layer and the vertically propagating mountain waves are analyzed through a variety of sensitivity tests, which indicated that the mountain wave’s amplitude and placement are extremely sensitive to the planetary boundary layer (PBL) parameterization being employed. The effects of 1) using unsmoothed versus smoothed terrain and 2) the removal of upstream coastal terrain on the flow and precipitation over the Cascades are evaluated through a series of sensitivity experiments. Inclusion of unsmoothed terrain resulted in net surface precipitation increases of ∼4%–14% over the windward slopes relative to the smoothed-terrain simulation. Small-scale waves (<20-km horizontal wavelength) over the windward slopes significantly impact the horizontal pattern of precipitation and hence quantitative precipitation forecast (QPF) accuracy.

scholarly journals Impact of a Stochastic Kinetic Energy Backscatter Scheme on Warm Season Convection-Allowing Ensemble Forecasts

2016 ◽  
Vol 144 (5) ◽  
pp. 1887-1908 ◽  
Author(s):  
Jeffrey D. Duda ◽  
Xuguang Wang ◽  
Fanyou Kong ◽  
Ming Xue ◽  
Judith Berner
Keyword(s):  
Kinetic Energy ◽  
Wrf Model ◽  
Warm Season ◽  
Weather Research And Forecasting ◽  
Potential Utility ◽  
Ensemble Forecasts ◽  
Probabilistic Forecasts ◽  
Ensemble Mean ◽  
Central United States ◽  
Surface Observations

The efficacy of a stochastic kinetic energy backscatter (SKEB) scheme to improve convection-allowing probabilistic forecasts was studied. While SKEB has been explored for coarse, convection-parameterizing models, studies of SKEB for convective scales are limited. Three ensembles were compared. The SKMP ensemble used mixed physics with the SKEB scheme, whereas the MP ensemble was configured identically but without using the SKEB scheme. The SK ensemble used the SKEB scheme with no physics diversity. The experiment covered May 2013 over the central United States on a 4-km Weather Research and Forecasting (WRF) Model domain. The SKEB scheme was successful in increasing the spread in all fields verified, especially mid- and upper-tropospheric fields. Additionally, the rmse of the ensemble mean was maintained or reduced, in some cases significantly. Rank histograms in the SKMP ensemble were flatter than those in the MP ensemble, indicating the SKEB scheme produces a less underdispersive forecast distribution. Some improvement was seen in probabilistic precipitation forecasts, particularly when examining Brier scores. Verification against surface observations agree with verification against Rapid Refresh (RAP) model analyses, showing that probabilistic forecasts for 2-m temperature, 2-m dewpoint, and 10-m winds were also improved using the SKEB scheme. The SK ensemble gave competitive forecasts for some fields. The SK ensemble had reduced spread compared to the MP ensemble at the surface due to the lack of physics diversity. These results suggest the potential utility of mixed physics plus the SKEB scheme in the design of convection-allowing ensemble forecasts.

scholarly journals Short-Range Ensemble Forecasts of Precipitation Type

2005 ◽  
Vol 20 (4) ◽  
pp. 609-626 ◽  
Author(s):  
Matthew S. Wandishin ◽  
Michael E. Baldwin ◽  
Steven L. Mullen ◽  
John V. Cortinas
Keyword(s):  
Short Range ◽  
Ensemble Forecast ◽  
Ensemble Forecasting ◽  
Precipitation Forecast ◽  
Initial Condition ◽  
Forecast System ◽  
Ensemble Forecasts ◽  
Probabilistic Forecasts ◽  
Precipitation Type ◽  
Forecast Quality

Abstract Short-range ensemble forecasting is extended to a critical winter weather problem: forecasting precipitation type. Forecast soundings from the operational NCEP Short-Range Ensemble Forecast system are combined with five precipitation-type algorithms to produce probabilistic forecasts from January through March 2002. Thus the ensemble combines model diversity, initial condition diversity, and postprocessing algorithm diversity. All verification numbers are conditioned on both the ensemble and observations recording some form of precipitation. This separates the forecast of type from the yes–no precipitation forecast. The ensemble is very skillful in forecasting rain and snow but it is only moderately skillful for freezing rain and unskillful for ice pellets. However, even for the unskillful forecasts the ensemble shows some ability to discriminate between the different precipitation types and thus provides some positive value to forecast users. Algorithm diversity is shown to be as important as initial condition diversity in terms of forecast quality, although neither has as big an impact as model diversity. The algorithms have their individual strengths and weaknesses, but no algorithm is clearly better or worse than the others overall.

scholarly journals Ensemble Postprocessing of Daily Precipitation Sums over Complex Terrain Using Censored High-Resolution Standardized Anomalies

2017 ◽  
Vol 145 (3) ◽  
pp. 955-969 ◽  
Author(s):  
Reto Stauffer ◽  
Nikolaus Umlauf ◽  
Jakob W. Messner ◽  
Georg J. Mayr ◽  
Achim Zeileis
Keyword(s):  
Daily Precipitation ◽  
Scale Effects ◽  
Large Fraction ◽  
New Method ◽  
Ensemble Prediction ◽  
Small Scale ◽  
Response Distribution ◽  
Ensemble Forecasts ◽  
Probabilistic Forecasts ◽  
Scale Properties

Probabilistic forecasts provided by numerical ensemble prediction systems have systematic errors and are typically underdispersive. This is especially true over complex topography with extensive terrain-induced small-scale effects, which cannot be resolved by the ensemble system. To alleviate these errors, statistical postprocessing methods are often applied to calibrate the forecasts. This article presents a new full-distributional spatial postprocessing method for daily precipitation sums based on the standardized anomaly model output statistics (SAMOS) approach. Observations and forecasts are transformed into standardized anomalies by subtracting the long-term climatological mean and dividing by the climatological standard deviation. This removes all site-specific characteristics from the data and makes it possible to fit one single regression model for all stations at once. As the model does not depend on the station locations, it directly allows the creation of probabilistic forecasts for any arbitrary location. SAMOS uses a left-censored power-transformed logistic response distribution to account for the large fraction of zero observations (dry days), the limitation to nonnegative values, and the positive skewness of the data. ECMWF reforecasts are used for model training and to correct the ECMWF ensemble forecasts with the big advantage that SAMOS does not require an extensive archive of past ensemble forecasts as only the most recent four reforecasts are needed, and it automatically adapts to changes in the ECMWF ensemble model. The application of the new method to the central Alps shows that the new method is able to depict the small-scale properties and returns accurate fully probabilistic spatial forecasts.

scholarly journals A Comparison of Precipitation Forecast Skill between Small Convection-Allowing and Large Convection-Parameterizing Ensembles

2009 ◽  
Vol 24 (4) ◽  
pp. 1121-1140 ◽  
Author(s):  
Adam J. Clark ◽  
William A. Gallus ◽  
Ming Xue ◽  
Fanyou Kong
Keyword(s):  
Wrf Model ◽  
Precipitation Forecast ◽  
Convective Precipitation ◽  
Weather Research And Forecasting ◽  
Lead Times ◽  
Grid Spacing ◽  
Ensemble Forecasts ◽  
Probabilistic Forecasts ◽  
Central United States ◽  
Statistical Consistency

Abstract An experiment has been designed to evaluate and compare precipitation forecasts from a 5-member, 4-km grid-spacing (ENS4) and a 15-member, 20-km grid-spacing (ENS20) Weather Research and Forecasting (WRF) model ensemble, which cover a similar domain over the central United States. The ensemble forecasts are initialized at 2100 UTC on 23 different dates and cover forecast lead times up to 33 h. Previous work has demonstrated that simulations using convection-allowing resolution (CAR; dx ∼ 4 km) have a better representation of the spatial and temporal statistical properties of convective precipitation than coarser models using convective parameterizations. In addition, higher resolution should lead to greater ensemble spread as smaller scales of motion are resolved. Thus, CAR ensembles should provide more accurate and reliable probabilistic forecasts than parameterized-convection resolution (PCR) ensembles. Computation of various precipitation skill metrics for probabilistic and deterministic forecasts reveals that ENS4 generally provides more accurate precipitation forecasts than ENS20, with the differences tending to be statistically significant for precipitation thresholds above 0.25 in. at forecast lead times of 9–21 h (0600–1800 UTC) for all accumulation intervals analyzed (1, 3, and 6 h). In addition, an analysis of rank histograms and statistical consistency reveals that faster error growth in ENS4 eventually leads to more reliable precipitation forecasts in ENS4 than in ENS20. For the cases examined, these results imply that the skill gained by increasing to CAR outweighs the skill lost by decreasing the ensemble size. Thus, when computational capabilities become available, it will be highly desirable to increase the ensemble resolution from PCR to CAR, even if the size of the ensemble has to be reduced.

scholarly journals Short-Term Probabilistic Forecasts of the 31 May 2013 Oklahoma Tornado and Flash Flood Event Using a Continuous-Update-Cycle Storm-Scale Ensemble System

2016 ◽  
Vol 31 (3) ◽  
pp. 957-983 ◽  
Author(s):  
Nusrat Yussouf ◽  
John S. Kain ◽  
Adam J. Clark
Keyword(s):  
Flash Flood ◽  
Stage Iv ◽  
Radar Data ◽  
Precipitation Forecast ◽  
Convective Precipitation ◽  
Flood Event ◽  
Forecast Period ◽  
Low Level ◽  
Probabilistic Forecasts ◽  
The Impact

Abstract A continuous-update-cycle storm-scale ensemble data assimilation (DA) and prediction system using the ARW model and DART software is used to generate retrospective 0–6-h ensemble forecasts of the 31 May 2013 tornado and flash flood event over central Oklahoma, with a focus on the prediction of heavy rainfall. Results indicate that the model-predicted probabilities of strong low-level mesocyclones correspond well with the locations of observed mesocyclones and with the observed damage track. The ensemble-mean quantitative precipitation forecast (QPF) from the radar DA experiments match NCEP’s stage IV analyses reasonably well in terms of location and amount of rainfall, particularly during the 0–3-h forecast period. In contrast, significant displacement errors and lower rainfall totals are evident in a control experiment that withholds radar data during the DA. The ensemble-derived probabilistic QPF (PQPF) from the radar DA experiment is more skillful than the PQPF from the no_radar experiment, based on visual inspection and probabilistic verification metrics. A novel object-based storm-tracking algorithm provides additional insight, suggesting that explicit assimilation and 1–2-h prediction of the dominant supercell is remarkably skillful in the radar experiment. The skill in both experiments is substantially higher during the 0–3-h forecast period than in the 3–6-h period. Furthermore, the difference in skill between the two forecasts decreases sharply during the latter period, indicating that the impact of radar DA is greatest during early forecast hours. Overall, the results demonstrate the potential for a frequently updated, high-resolution ensemble system to extend probabilistic low-level mesocyclone and flash flood forecast lead times and improve accuracy of convective precipitation nowcasting.

scholarly journals Generation of Scenarios from Calibrated Ensemble Forecasts with a Dual-Ensemble Copula-Coupling Approach

2016 ◽  
Vol 144 (12) ◽  
pp. 4737-4750 ◽  
Author(s):  
Zied Ben Bouallègue ◽  
Tobias Heppelmann ◽  
Susanne E. Theis ◽  
Pierre Pinson
Keyword(s):  
Probability Distributions ◽  
Forecast Error ◽  
Computational Cost ◽  
Joint Probability ◽  
Ensemble Prediction ◽  
Small Scale ◽  
Ensemble Forecasts ◽  
Ensemble Prediction System ◽  
Probabilistic Forecasts ◽  
Joint Probability Distributions

Abstract Probabilistic forecasts in the form of ensembles of scenarios are required for complex decision-making processes. Ensemble forecasting systems provide such products but the spatiotemporal structures of the forecast uncertainty is lost when statistical calibration of the ensemble forecasts is applied for each lead time and location independently. Nonparametric approaches allow the reconstruction of spatiotemporal joint probability distributions at a small computational cost. For example, the ensemble copula coupling (ECC) method rebuilds the multivariate aspect of the forecast from the original ensemble forecasts. Based on the assumption of error stationarity, parametric methods aim to fully describe the forecast dependence structures. In this study, the concept of ECC is combined with past data statistics in order to account for the autocorrelation of the forecast error. The new approach, called d-ECC, is applied to wind forecasts from the high-resolution Consortium for Small-Scale Modeling (COSMO) ensemble prediction system (EPS) run operationally at the German Weather Service (COSMO-DE-EPS). Scenarios generated by ECC and d-ECC are compared and assessed in the form of time series by means of multivariate verification tools and within a product-oriented framework. Verification results over a 3-month period show that the innovative method d-ECC performs as well as or even outperforms ECC in all investigated aspects.

scholarly journals Evaluation and Benchmarking of Operational Short-Range Ensemble Mean and Median Streamflow Forecasts for the Ohio River Basin

2018 ◽  
Vol 19 (10) ◽  
pp. 1689-1706 ◽  
Author(s):  
Thomas E. Adams III ◽  
Randel Dymond
Keyword(s):  
Real Time ◽  
Lead Time ◽  
Geographic Location ◽  
Ensemble Forecast ◽  
Precipitation Forecast ◽  
Ohio River ◽  
Forecast System ◽  
Ensemble Forecasts ◽  
Meteorological Model ◽  
Ensemble Mean

Abstract This study presents findings from a real-time forecast experiment that compares legacy deterministic hydrologic stage forecasts to ensemble mean and median stage forecasts from the NOAA/NWS Meteorological Model-Based Ensemble Forecast System (MMEFS). The NOAA/NWS Ohio River Forecast Center (OHRFC) area of responsibility defines the experimental region. Real-time forecasts from subbasins at 54 forecast point locations, ranging in drainage area, geographic location within the Ohio River valley, and watershed response time serve as the basis for analyses. In the experiment, operational hydrologic forecasts, with a 24-h quantitative precipitation forecast (QPF) and forecast temperatures, are compared to MMEFS hydrologic ensemble mean and median forecasts, with model forcings from the NOAA/NWS National Centers for Environmental Prediction (NCEP) North American Ensemble Forecast System (NAEFS), over the period from 30 November 2010 through 24 May 2012. Experiments indicate that MMEFS ensemble mean and median forecasts exhibit lower errors beginning at about lead time 90 h when forecasts at all locations are aggregated. With fast response basins that peak at ≤24 h, ensemble mean and median forecasts exhibit lower errors much earlier, beginning at about lead time 36 h, which suggests the viability of using MMEFS ensemble forecasts as an alternative to OHRFC legacy forecasts. Analyses show that ensemble median forecasts generally exhibit smaller errors than ensemble mean forecasts for all stage ranges. Verification results suggest that OHRFC MMEFS NAEFS ensemble forecasts are reasonable, but needed improvements are identified.

scholarly journals Relative impact of model quality and ensemble deficiencies on the performance of ensemble based probabilistic forecasts evaluated through the Brier score

2004 ◽  
Vol 11 (3) ◽  
pp. 399-409 ◽  
Author(s):  
F. Atger
Keyword(s):  
Forecast Skill ◽  
Brier Score ◽  
Relative Impact ◽  
Ensemble Spread ◽  
Model Quality ◽  
Ensemble Forecasts ◽  
Forecast Bias ◽  
Probabilistic Forecasts ◽  
Lower Extent ◽  
Ensemble Mean

Abstract. The relative impact of model quality and ensemble deficiencies, on the performance of ensemble based probabilistic forecasts, is investigated from a set of idealized experiments. Data are generated according to a statistical model, the validation of which is achieved by comparing generated data to ECMWF ensemble forecasts and analyses. The performance of probabilistic forecasts is evaluated through the reliability and resolution terms of the Brier score. Results are as follows. (i) Resolution appears essentially attributable to the average level of forecast skill. (ii) The lack of reliability comes primarily from forecast bias, and to a lower extent from the ensemble being systematically under-dispersive (or over-dispersive). (iii) Forecast skill contributes very little to reliability in the absence of forecast bias, and this impact is entirely due to the finiteness of the ensemble population. (iv) In the presence of forecast bias, reducing forecast skill leads to improve the reliability. This unexpected feature comes from the fact that lower forecast skill leads to a larger ensemble spread, that compensates for the strong proportion of outliers consequent to forecast bias. (v) The lack of ensemble skill, i.e. non systematic errors affecting both ensemble mean and ensemble spread, contributes little, but significantly, to the lack of reliability and resolution.

scholarly journals Impact of Model Resolution and Initial/Boundary Conditions in Forecasting Flood-Causing Precipitations

Atmosphere ◽  
2020 ◽  
Vol 11 (6) ◽  
pp. 592
Author(s):  
Francesco Ferrari ◽  
Federico Cassola ◽  
Peter Enos Tuju ◽  
Alessandro Stocchino ◽  
Paolo Brotto ◽  
...  
Keyword(s):  
Boundary Conditions ◽  
Mesoscale Model ◽  
Flash Flood ◽  
Late Summer ◽  
Initial Boundary ◽  
Small Scale ◽  
Topographic Effects ◽  
Model Resolution ◽  
Convective Systems ◽  
The Impact

In late summer and autumn Mediterranean coastal regions are quite regularly affected by small-scale, flood-producing convective systems. The complexity of mesoscale triggering mechanisms, related to low-level temperature gradients, moisture convergence, and topographic effects contributes to limit the predictability of such phenomena. In the present work, a severe convection episode associated to a flash flood occurred in Cannes (southern France) in October 2015, is investigated by means of numerical simulations with a state-of-the-art nonhydrostatic mesoscale model. In the modelling configuration operational at the University of Genoa precipitation maxima were underestimated and misplaced. The impact of model resolution as well as initial and boundary conditions on the quantitative precipitation forecasts is analyzed and discussed. In particular, the effect of ingesting a high-resolution satellite-derived sea surface temperature field is proven to be beneficial in terms of precipitation intensity and localization, especially when also associated with the most accurate lateral boundary conditions.

Sign in / Sign up

Export Citation Format

Share Document