scholarly journals The skill assessment of ENSO prediction issued by JMA ensemble prediction system and CFSv2

2021 ◽  
Vol 893 (1) ◽  
pp. 012047
Author(s):  
R Rahmat ◽  
A M Setiawan ◽  
Supari

Abstract Indonesian climate is strongly affected by El Niño-Southern Oscillation (ENSO) as one of climate-driven factor. ENSO prediction during the upcoming months or year is crucial for the government in order to design the further strategic policy. Besides producing its own ENSO prediction, BMKG also regularly releases the status and ENSO prediction collected from other climate centers, such as Japan Meteorological Agency (JMA) and National Oceanic and Atmospheric Administration (NOAA). However, the skill of these products is not well known yet. The aim of this study is to conduct a simple assessment on the skill of JMA Ensemble Prediction System (EPS) and NOAA Climate Forecast System version 2 (CFSv2) ENSO prediction using World Meteorological Organization (WMO) Standard Verification System for Long Range Forecast (SVS-LRF) method. Both ENSO prediction results also compared each other using Student's t-test. The ENSO predictions data were obtained from the ENSO JMA and ENSO NCEP forecast archive files, while observed Nino 3.4 were calculated from Centennial in situ Observation-Based Estimates (COBE) Sea Surface Temperature Anomaly (SSTA). Both ENSO prediction issued by JMA and NCEP has a good skill on 1 to 3 months lead time, indicated by high correlation coefficient and positive value of Mean Square Skill Score (MSSS). However, the skill of both skills significantly reduced for May-August target month. Further careful interpretation is needed for ENSO prediction issued on this mentioned period.

2007 ◽  
Vol 11 (2) ◽  
pp. 725-737 ◽  
Author(s):  
E. Roulin

Abstract. A hydrological ensemble prediction system, integrating a water balance model with ensemble precipitation forecasts from the European Centre for Medium-Range Weather Forecasts (ECMWF) Ensemble Prediction System (EPS), is evaluated for two Belgian catchments using verification methods borrowed from meteorology. The skill of the probability forecast that the streamflow exceeds a given level is measured with the Brier Skill Score. Then the value of the system is assessed using a cost-loss decision model. The verification results of the hydrological ensemble predictions are compared with the corresponding results obtained for simpler alternatives as the one obtained by using of the deterministic forecast of ECMWF which is characterized by a higher spatial resolution or by using of the EPS ensemble mean.


2010 ◽  
Vol 14 (8) ◽  
pp. 1639-1653 ◽  
Author(s):  
G. Thirel ◽  
E. Martin ◽  
J.-F. Mahfouf ◽  
S. Massart ◽  
S. Ricci ◽  
...  

Abstract. The use of ensemble streamflow forecasts is developing in the international flood forecasting services. Ensemble streamflow forecast systems can provide more accurate forecasts and useful information about the uncertainty of the forecasts, thus improving the assessment of risks. Nevertheless, these systems, like all hydrological forecasts, suffer from errors on initialization or on meteorological data, which lead to hydrological prediction errors. This article, which is the second part of a 2-part article, concerns the impacts of initial states, improved by a streamflow assimilation system, on an ensemble streamflow prediction system over France. An assimilation system was implemented to improve the streamflow analysis of the SAFRAN-ISBA-MODCOU (SIM) hydro-meteorological suite, which initializes the ensemble streamflow forecasts at Météo-France. This assimilation system, using the Best Linear Unbiased Estimator (BLUE) and modifying the initial soil moisture states, showed an improvement of the streamflow analysis with low soil moisture increments. The final states of this suite were used to initialize the ensemble streamflow forecasts of Météo-France, which are based on the SIM model and use the European Centre for Medium-range Weather Forecasts (ECMWF) 10-day Ensemble Prediction System (EPS). Two different configurations of the assimilation system were used in this study: the first with the classical SIM model and the second using improved soil physics in ISBA. The effects of the assimilation system on the ensemble streamflow forecasts were assessed for these two configurations, and a comparison was made with the original (i.e. without data assimilation and without the improved physics) ensemble streamflow forecasts. It is shown that the assimilation system improved most of the statistical scores usually computed for the validation of ensemble predictions (RMSE, Brier Skill Score and its decomposition, Ranked Probability Skill Score, False Alarm Rate, etc.), especially for the first few days of the time range. The assimilation was slightly more efficient for small basins than for large ones.


2009 ◽  
Vol 137 (8) ◽  
pp. 2592-2604 ◽  
Author(s):  
Munehiko Yamaguchi ◽  
Ryota Sakai ◽  
Masayuki Kyoda ◽  
Takuya Komori ◽  
Takashi Kadowaki

Abstract The Japan Meteorological Agency (JMA) Typhoon Ensemble Prediction System (TEPS) and its performance are described. In February 2008, JMA started an operation of TEPS that was designed for providing skillful tropical cyclone (TC) track predictions in both deterministic and probabilistic ways. TEPS consists of 1 nonperturbed prediction and 10 perturbed predictions based on the lower-resolution version (TL319L60) of the JMA Global Spectral Model (GSM; TL959L60) and a global analysis for JMA/GSM. A singular vector method is employed to create initial perturbations. Focusing on TCs in the western North Pacific Ocean and the South China Sea (0°–60°N, 100°E–180°), TEPS runs 4 times a day, initiated at 0000, 0600, 1200, and 1800 UTC with a prediction range of 132 h. The verifications of TEPS during the quasi-operational period from May to December 2007 indicate that the ensemble mean track predictions statistically have better performance as compared with the control (nonperturbed) predictions: the error reduction in the 5-day predictions is 40 km on average. Moreover, it is found that the ensemble spread of tracks is an indicator of position error, indicating that TEPS will be useful in presenting confidence information on TC track predictions. For 2008 when TEPS was in operational use, however, it was also found that the ensemble mean was significantly worse than the deterministic model (JMA/GSM) out to 84 h.


2010 ◽  
Vol 7 (2) ◽  
pp. 2455-2497 ◽  
Author(s):  
G. Thirel ◽  
E. Martin ◽  
J.-F. Mahfouf ◽  
S. Massart ◽  
S. Ricci ◽  
...  

Abstract. The use of ensemble streamflow forecasts is developing in the international flood forecasting services. Such systems can provide more accurate forecasts and useful information about the uncertainty of the forecasts, thus improving the assessment of risks. Nevertheless, these systems, like all hydrological forecasts, suffer from errors on initialization or on meteorological data, which lead to hydrological prediction errors. This article, which is the second part of a 2-part article, concerns the impacts of initial states, improved by a streamflow assimilation system, on an ensemble streamflow prediction system over France. An assimilation system was implemented to improve the streamflow analysis of the SAFRAN-ISBA-MODCOU (SIM) hydro-meteorological suite, which initializes the ensemble streamflow forecasts at Météo-France. This assimilation system, using the Best Linear Unbiased Estimator (BLUE) and modifying the initial soil moisture states, showed an improvement of the streamflow analysis with low soil moisture increments. The final states of this suite were used to initialize the ensemble streamflow forecasts of Météo-France, which are based on the SIM model and use the European Centre for Medium-range Weather Forecasts (ECMWF) 10-day Ensemble Prediction System (EPS). Two different configurations of the assimilation system were used in this study: the first with the classical SIM model and the second using improved soil physics in ISBA. The effects of the assimilation system on the ensemble streamflow forecasts were assessed for these two configurations, and a comparison was made with the original (i.e. without data assimilation and without the improved physics) ensemble streamflow forecasts. It is shown that the assimilation system improved most of the statistical scores usually computed for the validation of ensemble predictions (RMSE, Brier Skill Score and its decomposition, Ranked Probability Skill Score, False Alarm Rate, etc.), especially for the first few days of the time range. The assimilation was slightly more efficient for small basins than for large ones.


2006 ◽  
Vol 3 (4) ◽  
pp. 1369-1406 ◽  
Author(s):  
E. Roulin

Abstract. A hydrological ensemble prediction system, integrating a water balance model with ensemble precipitation forecasts from the European Centre for Medium-Range Weather Forecasts (ECMWF) Ensemble Prediction System (EPS), is evaluated for two Belgian catchments using verification methods borrowed from meteorology. The skill of the probability forecast that the streamflow exceeds a given level is measured with the Brier Skill Score. Then the value of the system is assessed using a cost-loss decision model. The verification results of the hydrological ensemble predictions are compared with the corresponding results obtained for simpler alternatives as the one obtained by using of the deterministic forecast of ECMWF which is characterized by a higher spatial resolution or by using of the EPS ensemble mean.


2021 ◽  
Vol 36 (5) ◽  
pp. 1759-1778
Author(s):  
Jinxiao Li ◽  
Qing Bao ◽  
Yimin Liu ◽  
Guoxiong Wu ◽  
Lei Wang ◽  
...  

AbstractThere is a distinct gap between tropical cyclone (TC) prediction skill and the societal demand for accurate predictions, especially in the western Pacific (WP) and North Atlantic (NA) basins, where densely populated areas are frequently affected by intense TC events. In this study, seasonal prediction skill for TC activity in the WP and NA of the fully coupled FGOALS-f2 V1.0 dynamical prediction system is evaluated. In total, 36 years of monthly hindcasts from 1981 to 2016 were completed with 24 ensemble members. The FGOALS-f2 V1.0 system has been used for real-time predictions since June 2017 with 35 ensemble members, and has been operationally used in the two operational prediction centers of China. Our evaluation indicates that FGOALS-f2 V1.0 can reasonably reproduce the density of TC genesis locations and tracks in the WP and NA. The model shows significant skill in terms of the TC number correlation in the WP (0.60) and the NA (0.61) from 1981 to 2015; however, the model underestimates accumulated cyclone energy. When the number of ensemble members was increased from 2 to 24, the correlation coefficients clearly increased (from 0.21 to 0.60 in the WP, and from 0.18 to 0.61 in the NA). FGOALS-f2 V1.0 also successfully reproduces the genesis potential index pattern and the relationship between El Niño–Southern Oscillation and TC activity, which is one of the dominant contributors to TC seasonal prediction skill. However, the biases in large-scale factors are barriers to the improvement of the seasonal prediction skill, e.g., larger wind shear, higher relative humidity, and weaker potential intensity of TCs. For real-time predictions in the WP, FGOALS-f2 V1.0 demonstrates a skillful prediction for track density in terms of landfalling TCs, and the model successfully forecasts the correct sign of seasonal anomalies of landfalling TCs for various regions in China.


2012 ◽  
Vol 4 (1) ◽  
pp. 65
Author(s):  
Xiao Yu-Hua ◽  
He Guang-Bi ◽  
Chen Jing ◽  
Deng Guo

2012 ◽  
Vol 27 (3) ◽  
pp. 757-769 ◽  
Author(s):  
James I. Belanger ◽  
Peter J. Webster ◽  
Judith A. Curry ◽  
Mark T. Jelinek

Abstract This analysis examines the predictability of several key forecasting parameters using the ECMWF Variable Ensemble Prediction System (VarEPS) for tropical cyclones (TCs) in the North Indian Ocean (NIO) including tropical cyclone genesis, pregenesis and postgenesis track and intensity projections, and regional outlooks of tropical cyclone activity for the Arabian Sea and the Bay of Bengal. Based on the evaluation period from 2007 to 2010, the VarEPS TC genesis forecasts demonstrate low false-alarm rates and moderate to high probabilities of detection for lead times of 1–7 days. In addition, VarEPS pregenesis track forecasts on average perform better than VarEPS postgenesis forecasts through 120 h and feature a total track error growth of 41 n mi day−1. VarEPS provides superior postgenesis track forecasts for lead times greater than 12 h compared to other models, including the Met Office global model (UKMET), the Navy Operational Global Atmospheric Prediction System (NOGAPS), and the Global Forecasting System (GFS), and slightly lower track errors than the Joint Typhoon Warning Center. This paper concludes with a discussion of how VarEPS can provide much of this extended predictability within a probabilistic framework for the region.


Sign in / Sign up

Export Citation Format

Share Document