scholarly journals Development of Verification Methodology for Extreme Weather Forecasts

2017 ◽  
Vol 32 (2) ◽  
pp. 479-491 ◽  
Author(s):  
Hong Guan ◽  
Yuejian Zhu
Keyword(s):  
Extreme Precipitation ◽  
Weather Forecast ◽  
Extreme Weather ◽  
Ensemble Forecast ◽  
Precipitation Forecast ◽  
Forecast System ◽  
Extreme Precipitation Events ◽  
Cold Events ◽  
Extreme Cold ◽  
Verification Methodology

Abstract In 2006, the statistical postprocessing of the National Centers for Environmental Prediction (NCEP) Global Ensemble Forecast System (GEFS) and North American Ensemble Forecast System (NAEFS) was implemented to enhance probabilistic guidance. Anomaly forecasting (ANF) is one of the NAEFS products, generated from bias-corrected ensemble forecasts and reanalysis climatology. The extreme forecast index (EFI), based on a raw ensemble forecast and model-based climatology, is another way to build an extreme weather forecast. In this work, the ANF and EFI algorithms are applied to extreme cold temperature and extreme precipitation forecasts during the winter of 2013/14. A highly correlated relationship between the ANF and EFI allows the determination of two sets of thresholds to identify extreme cold and extreme precipitation events for the two algorithms. An EFI of −0.78 (0.687) is approximately equivalent to a −2σ (0.95) ANF for the extreme cold event (extreme precipitation) forecast. The performances of the two algorithms in forecasting extreme cold events are verified against analysis for different model versions, reference climatology, and forecasts. The verification results during the winter of 2013/14 indicate that ANF forecasts more extreme cold events with a slightly higher skill than EFI. The bias-corrected forecast performs much better than the raw forecast. The current upgrade of the GEFS has a beneficial effect on the extreme cold weather forecast. Using the NCEP Climate Forecast System Reanalysis and Reforecast (CFSRR) as a climate reference gives a slightly better score than the 40-yr reanalysis. The verification methodology is also extended to an extreme precipitation case, showing a broad potential use in the future.

scholarly journals Extreme Precipitation in Models: An Evaluation

2016 ◽  
Vol 31 (6) ◽  
pp. 1853-1879 ◽  
Author(s):  
Gregory R. Herman ◽  
Russ S. Schumacher
Keyword(s):  
Extreme Precipitation ◽  
Wrf Model ◽  
Ensemble Forecast ◽  
Forecast Skill ◽  
Forecast System ◽  
Severe Storms ◽  
The North ◽  
Extreme Precipitation Events ◽  
The U.S ◽  
Precipitation Events

Abstract A continental United States (CONUS)-wide framework for analyzing quantitative precipitation forecasts (QPFs) from NWP models from the perspective of precipitation return period (RP) exceedances is introduced using threshold estimates derived from a combination of NOAA Atlas 14 and older sources. Forecasts between 2009 and 2015 from several different NWP models of varying configurations and spatial resolutions are analyzed to assess bias characteristics and forecast skill for predicting RP exceedances. Specifically, NOAA’s Global Ensemble Forecast System Reforecast (GEFS/R) and the National Severe Storms Laboratory WRF (NSSL-WRF) model are evaluated for 24-h precipitation accumulations. The climatology of extreme precipitation events for 6-h accumulations is also explored in three convection-allowing models: 1) NSSL-WRF, 2) the North American Mesoscale 4-km nest (NAM-NEST), and 3) the experimental High Resolution Rapid Refresh (HRRR). The GEFS/R and NSSL-WRF are both found to exhibit similar 24-h accumulation RP exceedance climatologies over the U.S. West Coast to those found in observations and are found to be approximately equally skillful at predicting these exceedance events in this region. In contrast, over the eastern two-thirds of the CONUS, GEFS/R struggles to predict the predominantly convectively driven extreme QPFs, predicting far fewer events than are observed and exhibiting inferior forecast skill to the NSSL-WRF. The NSSL-WRF and HRRR are found to produce 6-h extreme precipitation climatologies that are approximately in accord with those found in the observations, while NAM-NEST produces many more RP exceedances than are observed across all of the CONUS.

scholarly journals Short-Range Ensemble Forecasts of Precipitation Type

2005 ◽  
Vol 20 (4) ◽  
pp. 609-626 ◽  
Author(s):  
Matthew S. Wandishin ◽  
Michael E. Baldwin ◽  
Steven L. Mullen ◽  
John V. Cortinas
Keyword(s):  
Short Range ◽  
Ensemble Forecast ◽  
Ensemble Forecasting ◽  
Precipitation Forecast ◽  
Initial Condition ◽  
Forecast System ◽  
Ensemble Forecasts ◽  
Probabilistic Forecasts ◽  
Precipitation Type ◽  
Forecast Quality

Abstract Short-range ensemble forecasting is extended to a critical winter weather problem: forecasting precipitation type. Forecast soundings from the operational NCEP Short-Range Ensemble Forecast system are combined with five precipitation-type algorithms to produce probabilistic forecasts from January through March 2002. Thus the ensemble combines model diversity, initial condition diversity, and postprocessing algorithm diversity. All verification numbers are conditioned on both the ensemble and observations recording some form of precipitation. This separates the forecast of type from the yes–no precipitation forecast. The ensemble is very skillful in forecasting rain and snow but it is only moderately skillful for freezing rain and unskillful for ice pellets. However, even for the unskillful forecasts the ensemble shows some ability to discriminate between the different precipitation types and thus provides some positive value to forecast users. Algorithm diversity is shown to be as important as initial condition diversity in terms of forecast quality, although neither has as big an impact as model diversity. The algorithms have their individual strengths and weaknesses, but no algorithm is clearly better or worse than the others overall.

scholarly journals Assessing the Use of Satellite-Based Estimates and High-Resolution Precipitation Datasets for the Study of Extreme Precipitation Events over the Iberian Peninsula

Water ◽  
2018 ◽  
Vol 10 (11) ◽  
pp. 1688 ◽  
Author(s):  
Riccardo Hénin ◽  
Margarida Liberato ◽  
Alexandre Ramos ◽  
Célia Gouveia
Keyword(s):  
High Resolution ◽  
Iberian Peninsula ◽  
Real Time ◽  
Extreme Precipitation ◽  
Daily Precipitation ◽  
Weather Forecast ◽  
Winter Period ◽  
Medium Range Weather Forecast ◽  
Extreme Precipitation Events ◽  
Precipitation Events

An assessment of daily accumulated precipitation during extreme precipitation events (EPEs) occurring over the period 2000–2008 in the Iberian Peninsula (IP) is presented. Different sources for precipitation data, namely ERA-Interim and ERA5 reanalysis by the European Centre for Medium-Range Weather Forecast (ECMWF) and Tropical Rainfall Measuring Mission (TRMM) Multisatellite Precipitation Analysis (TMPA), both in near-real-time and post-real-time releases, are compared with the best ground-based high-resolution (0.2° × 0.2°) gridded precipitation dataset available for the IP (IB02). In this study, accuracy metrics are analysed for different quartiles of daily precipitation amounts, and additional insights are provided for a subset of EPEs extracted from an objective ranking of extreme precipitation during the extended winter period (October to March) over the IP. Results show that both reanalysis and multi-satellite datasets overestimate (underestimate) daily precipitation sums for the least (most) extreme events over the IP. In addition, it is shown that the TRMM TMPA precipitation estimates from the near-real-time product may be considered for EPEs assessment over these latitudes. Finally, it is found that the new ERA5 reanalysis accounts for large improvements over ERA-Interim and it also outperforms the satellite-based datasets.

Extreme Quantitative Precipitation Forecast Performance at the Weather Prediction Center from 2001 to 2011

2014 ◽  
Vol 29 (4) ◽  
pp. 894-911 ◽  
Author(s):  
Ellen M. Sukovich ◽  
F. Martin Ralph ◽  
Faye E. Barthold ◽  
David W. Reynolds ◽  
David R. Novak
Keyword(s):  
United States ◽  
Extreme Precipitation ◽  
Weather Prediction ◽  
Forecast Accuracy ◽  
Absolute Error ◽  
Probability Of Detection ◽  
Precipitation Forecast ◽  
Forecast Performance ◽  
Extreme Precipitation Events ◽  
Quantitative Precipitation Forecast

Abstract Extreme quantitative precipitation forecast (QPF) performance is baselined and analyzed by NOAA’s Hydrometeorology Testbed (HMT) using 11 yr of 32-km gridded QPFs from NCEP’s Weather Prediction Center (WPC). The analysis uses regional extreme precipitation thresholds, quantitatively defined as the 99th and 99.9th percentile precipitation values of all wet-site days from 2001 to 2011 for each River Forecast Center (RFC) region, to evaluate QPF performance at multiple lead times. Five verification metrics are used: probability of detection (POD), false alarm ratio (FAR), critical success index (CSI), frequency bias, and conditional mean absolute error (MAEcond). Results indicate that extreme QPFs have incrementally improved in forecast accuracy over the 11-yr period. Seasonal extreme QPFs show the highest skill during winter and the lowest skill during summer, although an increase in QPF skill is observed during September, most likely due to landfalling tropical systems. Seasonal extreme QPF skill decreases with increased lead time. Extreme QPF skill is higher over the western and northeastern RFCs and is lower over the central and southeastern RFC regions, likely due to the preponderance of convective events in the central and southeastern regions. This study extends the NOAA HMT study of regional extreme QPF performance in the western United States to include the contiguous United States and applies the regional assessment recommended therein. The method and framework applied here are readily applied to any gridded QPF dataset to define and verify extreme precipitation events.

scholarly journals Study of NWP parameterizations on extreme precipitation events over Basque Country

2016 ◽  
Vol 13 ◽  
pp. 137-144 ◽  
Author(s):  
Iván R. Gelpi ◽  
Santiago Gaztelumendi ◽  
Sheila Carreño ◽  
Roberto Hernández ◽  
Joseba Egaña
Keyword(s):  
Extreme Precipitation ◽  
Numerical Models ◽  
Basque Country ◽  
Wrf Model ◽  
Cumulus Parameterization ◽  
Precipitation Forecast ◽  
Weather Research And Forecasting ◽  
Forecasting Model ◽  
Extreme Precipitation Events ◽  
Precipitation Events

Abstract. The Weather Research and Forecasting model (WRF), like other numerical models, can make use of several parameterization schemes. The purpose of this study is to determine how available cumulus parameterization (CP) and microphysics (MP) schemes in the WRF model simulate extreme precipitation events in the Basque Country. Possible combinations among two CP schemes (Kain–Fritsch and Betts–Miller–Janjic) and five MP (WSM3, Lin, WSM6, new Thompson and WDM6) schemes were tested. A set of simulations, corresponding to 21st century extreme precipitation events that have caused significant flood episodes have been compared with point observational data coming from the Basque Country Automatic Weather Station Mesonetwork. Configurations with Kain–Fritsch CP scheme produce better quantity of precipitation forecast (QPF) than BMJ scheme configurations. Depending on the severity level and the river basin analysed different MP schemes show the best behaviours, demonstrating that there is not a unique configuration that solve exactly all the studied events.

scholarly journals Evaluation and Benchmarking of Operational Short-Range Ensemble Mean and Median Streamflow Forecasts for the Ohio River Basin

2018 ◽  
Vol 19 (10) ◽  
pp. 1689-1706 ◽  
Author(s):  
Thomas E. Adams III ◽  
Randel Dymond
Keyword(s):  
Real Time ◽  
Lead Time ◽  
Geographic Location ◽  
Ensemble Forecast ◽  
Precipitation Forecast ◽  
Ohio River ◽  
Forecast System ◽  
Ensemble Forecasts ◽  
Meteorological Model ◽  
Ensemble Mean

Abstract This study presents findings from a real-time forecast experiment that compares legacy deterministic hydrologic stage forecasts to ensemble mean and median stage forecasts from the NOAA/NWS Meteorological Model-Based Ensemble Forecast System (MMEFS). The NOAA/NWS Ohio River Forecast Center (OHRFC) area of responsibility defines the experimental region. Real-time forecasts from subbasins at 54 forecast point locations, ranging in drainage area, geographic location within the Ohio River valley, and watershed response time serve as the basis for analyses. In the experiment, operational hydrologic forecasts, with a 24-h quantitative precipitation forecast (QPF) and forecast temperatures, are compared to MMEFS hydrologic ensemble mean and median forecasts, with model forcings from the NOAA/NWS National Centers for Environmental Prediction (NCEP) North American Ensemble Forecast System (NAEFS), over the period from 30 November 2010 through 24 May 2012. Experiments indicate that MMEFS ensemble mean and median forecasts exhibit lower errors beginning at about lead time 90 h when forecasts at all locations are aggregated. With fast response basins that peak at ≤24 h, ensemble mean and median forecasts exhibit lower errors much earlier, beginning at about lead time 36 h, which suggests the viability of using MMEFS ensemble forecasts as an alternative to OHRFC legacy forecasts. Analyses show that ensemble median forecasts generally exhibit smaller errors than ensemble mean forecasts for all stage ranges. Verification results suggest that OHRFC MMEFS NAEFS ensemble forecasts are reasonable, but needed improvements are identified.

Sub-seasonal forecast capability for Arabian Peninsula convective extremes using convective-permitting regional climate modeling

2021 ◽  
Author(s):  
Hsin-I Chang ◽  
Christopher L Castro ◽  
Christoforus Bayu Risanto ◽  
Thang Luong ◽  
Ibrahim Hoteit
Keyword(s):  
Extreme Events ◽  
Arabian Peninsula ◽  
Regional Climate ◽  
Seasonal Forecast ◽  
Ensemble Forecast ◽  
Probability Of Detection ◽  
Precipitation Forecast ◽  
Operating Characteristics ◽  
Synoptic Patterns ◽  
Extreme Precipitation Events

<p>Severe weather associated with convective thunderstorms is becoming more intense globally and is also observed in the Arabian Peninsula (AP). AP convective extremes are often observed during winter season (October to March). Improvements in extreme weather forecast for sub-seasonal to seasonal forecast increase the preparedness of convective extremes and related hazards. We designed a series of ensemble forecast downscaling using the Weather Research and Forecasting model (WRF) at convective-permitting spatial scale. The driving global sub-seasonal to seasonal reforecast is provided by the European Centre for Medium-Range Weather Forecasts (ECMWF).</p><p>Sub-seasonal WRF simulations are performed on the AP’s top 20 extreme precipitation events reported in the last 20 years, downscaling from the 11 ECMWF hindcast ensemble members. Each of the events recorded at least 20 mm/day rainfall in the Jeddah station. Several aspects of the simulated events are evaluated: (1) Precipitation forecast capability: determine forecast window of opportunity in the regional climate model at 1-week, 2-week and 3-week lead time, identify the value added using convective-permitting type modeling; (2) Teleconnection pattern forecast capability: determine forecast skill for the dominant large scale pattern related to the convective extremes in the driving ECMWF reforecasts and ERA-Interim reanalysis data; (3) Dominant synoptic patterns associated with the AP’s top 20 extreme events: identify forecast capability for different synoptic-driven extreme events. Historic data analysis identified 3 general synoptic patterns that lead to precipitation extreme. The top 20 extreme events are parsed into the 3 synoptic groups. Sub-seasonal forecast evaluations are then performed with statistical analysis tools commonly used in operational forecast evaluation, such as Probability of Detection (POD), False Alarm Rate (FAR) and Relative Operating Characteristics (ROC); (4) Mesoscale convective system (MCS) tracking: objectively tracking the MCS clouds in satellite observation and WRF downscaled reforecasts using cloud top temperature and precipitation. Through the designed analyses, we can collectively show the ensemble forecast skills for the largest convective events in the AP and advancement in forecast capability at sub-seasonal time scale.</p>

scholarly journals Validation of subgrid scale ensemble precipitation forecasts based on the ECMWF’s ecPoint Rainfall project

Időjárás ◽  
2021 ◽  
Vol 125 (3) ◽  
pp. 397-418
Author(s):  
Boglárka Tóth ◽  
István Ihász
Keyword(s):  
Extreme Precipitation ◽  
Prediction Models ◽  
Weather Prediction ◽  
Precipitation Forecast ◽  
Time Range ◽  
Weather Forecasts ◽  
Extreme Precipitation Events ◽  
Operational Forecasting ◽  
Processed Products ◽  
Short Time

Nowadays, state-of-the-art numerical weather prediction models successfully predict the general weather characteristics several days ahead, but forecasting extreme precipitation is quite challenging even in the short time range. In the framework of the ecPoint Project, the European Centre for Medium-Range Weather Forecasts (ECMWF) developed a new innovative probabilistic post-processing tool which produces 4-day precipitation forecast as accurate as the raw ensemble forecast at day 1. In the framework of the scientific co-operation between ECMWF and the Hungarian Meteorological Service (OMSZ), we were invited to participate in the validation of the experimental products. Quasi operational post-processed products have been available since July 1, 2018. During our work, besides using different verification technics, a new ensemble meteogram was also developed which can support operational forecasters during extreme precipitation events. As a result of our work, products of the ecPoint Project have been included in the operational forecasting activity.

scholarly journals The Extreme Precipitation Forecast Table: improving situational awareness when heavy rain is a threat

2020 ◽  
pp. 93-104
Author(s):  
Diana R. Stovern ◽  
James A. Nelson ◽  
Stan Czyzyk ◽  
Mark Klein ◽  
Katie Landry-Guyton ◽  
...  
Keyword(s):  
Mississippi River ◽  
Extreme Precipitation ◽  
Situational Awareness ◽  
Weather Prediction ◽  
Extreme Rainfall ◽  
Weather Forecast ◽  
Heavy Rain ◽  
Precipitation Forecast ◽  
Lower Mississippi River ◽  
Quantitative Precipitation Estimates

A collaborative team of Science and Operations Officers from the National Weather Service (NWS) Weather Forecast Offices (WFOs), hydrologists from the Lower Mississippi River Forecast Center (LMRFC), and management from the Weather Prediction Center (WPC) worked together to develop and transition a tool into NWS operations called the Extreme Precipitation Forecast Table (EPFT). The EPFT was designed to help NWS forecasters improve their situational awareness (SA) when heavy rainfall threatens their county warning area. The EPFT compares Quantitative Precipitation Forecasts (QPF) to Average Recurrence Intervals (ARIs) from the NOAA Atlas-14 to alert forecasters to the potential for climatologically significant and extreme rainfall. A counterpart to the EPFT, called the Extreme Precipitation Assessment Table (EPAT), compares observed precipitation (i.e., Quantitative Precipitation Estimates [QPE]) to inform forecasters as to the climatological significance of impactful rain events. This paper presents cases demonstrating the usefulness of the EPFT and EPAT in helping forecasters improve their SA in real-time operational settings when heavy rain was a threat.

Sign in / Sign up

Export Citation Format

Share Document