scholarly journals Assessing the Skill and Reliability of Seasonal Climate Forecasts in Sahelian West Africa

2020 ◽  
Vol 35 (3) ◽  
pp. 1035-1050 ◽  
Author(s):  
Jennifer S. R. Pirret ◽  
Joseph D. Daron ◽  
Philip E. Bett ◽  
Nicolas Fournier ◽  
Andre Kamga Foamouhoue

Abstract Seasonal climate forecasts have the potential to support planning decisions and provide advanced warning to government, industry, and communities to help reduce the impacts of adverse climatic conditions. Assessing the reliability of seasonal forecasts, generated using different models and methods, is essential to ensure their appropriate interpretation and use. Here we assess the reliability of forecasts for seasonal total precipitation in Sahelian West Africa, a region of high year-to-year climate variability. Through digitizing forecasts issued from the regional climate outlook forum in West Africa known as Prévisions Climatiques Saisonnières en Afrique Soudano-Sahélienne (PRESASS), we assess their reliability by comparing them to the Climate Hazards Group Infrared Precipitation with Stations (CHIRPS) project observational data over the past 20 years. The PRESASS forecasts show positive skill and reliability, but a bias toward lower forecast probabilities in the below-normal precipitation category. In addition, we assess the reliability of seasonal precipitation forecasts for the same region using available global dynamical forecast models. We find all models have positive skill and reliability, but this varies geographically. On average, NCEP’s CFS and ECMWF’s SEAS5 systems show greater skill and reliability than the Met Office’s GloSea5, and in turn than Météo-France’s Sys5, but one key caveat is that model performance might depend on the meteorological situation. We discuss the potential for improving use of dynamical model forecasts in the regional climate outlook forums, to improve the reliability of seasonal forecasts in the region and the objectivity of the seasonal forecasting process used in the PRESASS regional climate outlook forum.

2020 ◽  
Vol 12 (1) ◽  
pp. 3-14 ◽  
Author(s):  
D. H. Cobon ◽  
R. Darbyshire ◽  
J. Crean ◽  
S. Kodur ◽  
M. Simpson ◽  
...  

AbstractSeasonal climate forecasts (SCFs) provide opportunities for pastoralists to align production decisions to climatic conditions, as SCFs offer economic value by increasing certainty about future climatic states at decision-making time. Insufficient evidence about the economic value of SCFs was identified as a major factor limiting adoption of SCFs in Australia and abroad. This study examines the value of SCFs to beef production system management in northern Australia by adopting a theoretical probabilistic climate forecast system. Stocking rate decisions in October, before the onset of the wet season, were identified by industry as a key climate sensitive decision. The analysis considered SCF value across economic drivers (steer price in October) and environmental drivers (October pasture availability). A range in forecast value was found ($0–$14 per head) dependent on pasture availability, beef price, and SCF skill. Skillful forecasts of future climate conditions offered little value with medium or high pasture availability, as in these circumstances pastures were rarely overutilized. In contrast, low pasture availability provided conditions for alternative optimal stocking rates and for SCFs to be valuable. Optimal stocking rates under low pasture availability varied the most with climate state (i.e., wet or dry), indicating that producers have more to gain from a skillful SCF at these times. Although the level of pasture availability in October was the major determinant of stocking rate decisions, beef price settings were also found to be important. This analysis provides insights into the potential value of SCFs to extensive beef enterprises and can be used by pastoralists to evaluate the cost benefit of using a SCF in annual management.


2020 ◽  
Vol 148 (1) ◽  
pp. 437-456 ◽  
Author(s):  
Andrew Schepen ◽  
Yvette Everingham ◽  
Quan J. Wang

Abstract Multivariate seasonal climate forecasts are increasingly required for quantitative modeling in support of natural resources management and agriculture. GCM forecasts typically require postprocessing to reduce biases and improve reliability; however, current seasonal postprocessing methods often ignore multivariate dependence. In low-dimensional settings, fully parametric methods may sufficiently model intervariable covariance. On the other hand, empirical ensemble reordering techniques can inject desired multivariate dependence in ensembles from template data after univariate postprocessing. To investigate the best approach for seasonal forecasting, this study develops and tests several strategies for calibrating seasonal GCM forecasts of rainfall, minimum temperature, and maximum temperature with intervariable dependence: 1) simultaneous calibration of multiple climate variables using the Bayesian joint probability modeling approach; 2) univariate BJP calibration coupled with an ensemble reordering method (the Schaake shuffle); and 3) transformation-based quantile mapping, which borrows intervariable dependence from the raw forecasts. Applied to Australian seasonal forecasts from the ECMWF System4 model, univariate calibration paired with empirical ensemble reordering performs best in terms of univariate and multivariate forecast verification metrics, including the energy and variogram scores. However, the performance of empirical ensemble reordering using the Schaake shuffle is influenced by the selection of historical data in constructing a dependence template. Direct multivariate calibration is the second-best method, with its far superior performance in in-sample testing vanishing in cross validation, likely because of insufficient data relative to the number of parameters. The continued development of multivariate forecast calibration methods will support the uptake of seasonal climate forecasts in complex application domains such as agriculture and hydrology.


2020 ◽  
Author(s):  
Tanja Portele ◽  
Christof Lorenz ◽  
Patrick Laux ◽  
Harald Kunstmann

<p>Semi-arid regions are the regions mostly affected by drought. In these climatically sensitive regions, the frequency and intensity of drought and hot extremes is projected to increase. With increasing precipitation variability in semi-arid regions, sustainable water management is required. Proactive drought and extreme event preparedness, as well as damage mitigation could be provided by the use of seasonal climate forecasts. However, their probabilistic nature, the lack of clear action derivations and institutional conservatism impedes their application in decision making of the water management sector. Using the latest global seasonal climate forecast product (SEAS5) at 35 km resolution and 7 months forecast horizon of the European Centre for Medium-Range Weather Forecasts, we show that seasonal-forecast-based actions offer potential economic benefit and allow for climate proofing in semi-arid regions in the case of drought and extreme events. Our analysis includes 7 semi-arid, in parts highly managed river basins with extents from tens of thousands to millions of square kilometers in Africa, Asia and South America. The value of the forecast-based action is derived from the skill measures of hit (worthy action) and false alarm (action in vain) rate and is related to economic expenses through ratios of associated costs and losses of an early action. For water management policies, forecast probability triggers for early action plans can be offered based on expense minimization and event maximization criteria. Our results show that even high lead times and long accumulation periods attain value for a range of users and cost-loss situations. For example, in the case of extreme wet conditions (monthly precipitation above 90<sup>th</sup> percentile), seasonal-forecast-based action in 5 out of 7 regions can still achieve more than 50 % of saved expenses of a perfect forecast at 6 months in advance. The utility of seasonal forecasts strongly depends on the user, the cost-loss situation, the region and the concrete application. In general, seasonal forecasts allow decision makers to save expenses, and to adapt to and mitigate damages of extreme events related to climate change.</p>


2002 ◽  
Vol 34 (3) ◽  
pp. 603-632 ◽  
Author(s):  
Harvey S.J. Hill ◽  
James W. Mjelde

Use of seasonal climate forecasts is a rapidly evolving area. Effective research and application of climate forecasts require close cooperation between scientists in diverse disciplines and decision makers. Successful collaboration requires all players to at least partially understand each other's perspectives. Issues associated with seasonal forecasts, through a selected review of both physical and social sciences literature, is presented. Our hope is that the review will improve research in this area by stimulating further collaborations.


2008 ◽  
Vol 47 (5) ◽  
pp. 1269-1286 ◽  
Author(s):  
Francisco J. Meza ◽  
James W. Hansen ◽  
Daniel Osgood

Abstract Advanced information in the form of seasonal climate forecasts has the potential to improve farmers’ decision making, leading to increases in farm profits. Interdisciplinary initiatives seeking to understand and exploit the potential benefits of seasonal forecasts for agriculture have produced a number of quantitative ex-ante assessments of the economic value of seasonal climate forecasts. The realism, robustness, and credibility of such assessments become increasingly important as efforts shift from basic research toward applied research and implementation. This paper surveys published evidence about the economic value of seasonal climate forecasts for agriculture, characterizing the agricultural systems, approaches followed, and scales of analysis. The climate forecast valuation literature has contributed insights into the influence of forecast characteristics, risk attitudes, insurance, policy, and the scale of adoption on the value of forecasts. Key innovations in the more recent literature include explicit treatment of the uncertainty of forecast value estimates, incorporation of elicited management responses into bioeconomic modeling, and treatment of environmental impacts, in addition to financial outcomes of forecast response. It is argued that the picture of the value of seasonal forecasts for agriculture is still incomplete and often biased, in part because of significant gaps in published valuation research. Key gaps include sampling of a narrow range of farming systems and locations, incorporation of an overly restricted set of potential management responses, failure to consider forecast responses that could lead to “regime shifts,” and failure to incorporate state-of-the-art developments in seasonal forecasting. This paper concludes with six recommendations to enhance the realism, robustness, and credibility of ex-ante valuation of seasonal climate forecasts.


2014 ◽  
Vol 11 (96) ◽  
pp. 20131162 ◽  
Author(s):  
A. Weisheimer ◽  
T. N. Palmer

Seasonal climate forecasts are being used increasingly across a range of application sectors. A recent UK governmental report asked: how good are seasonal forecasts on a scale of 1–5 (where 5 is very good), and how good can we expect them to be in 30 years time? Seasonal forecasts are made from ensembles of integrations of numerical models of climate. We argue that ‘goodness’ should be assessed first and foremost in terms of the probabilistic reliability of these ensemble-based forecasts; reliable inputs are essential for any forecast-based decision-making. We propose that a ‘5’ should be reserved for systems that are not only reliable overall, but where, in particular, small ensemble spread is a reliable indicator of low ensemble forecast error. We study the reliability of regional temperature and precipitation forecasts of the current operational seasonal forecast system of the European Centre for Medium-Range Weather Forecasts, universally regarded as one of the world-leading operational institutes producing seasonal climate forecasts. A wide range of ‘goodness’ rankings, depending on region and variable (with summer forecasts of rainfall over Northern Europe performing exceptionally poorly) is found. Finally, we discuss the prospects of reaching ‘5’ across all regions and variables in 30 years time.


2017 ◽  
Vol 6 ◽  
pp. 1-11 ◽  
Author(s):  
Cocou Jaurès Amegnaglo ◽  
Kwabena Asomanin Anaman ◽  
Akwasi Mensah-Bonsu ◽  
Edwards Ebo Onumah ◽  
Fulbert Amoussouga Gero

2008 ◽  
Vol 30 (3) ◽  
pp. 361 ◽  
Author(s):  
D. H. Cobon ◽  
K. L. Bell ◽  
J. N. Park ◽  
D. U. Keogh

Survey methods were engaged to measure the change in use and knowledge of climate information by pastoralists in western Queensland. The initial mail survey was undertaken in 2000–01 (n = 43) and provided a useful benchmark of pastoralists climate knowledge. Two years of climate applications activities were completed and clients were re-surveyed in 2003 (n = 49) to measure the change in knowledge and assess the effectiveness of the climate applications activities. Two methods were used to assess changes in client knowledge, viz., self-assessment and test questions. We found that the use of seasonal climate forecasts in decision making increased from 36% in 2001 (n = 42) to 51% in 2003 (n = 49) (P = 0.07). The self-assessment technique was unsatisfactory as a measure of changing knowledge over short periods (1–3 years), but the test question technique was successful and indicated an improvement in climate knowledge among respondents. The increased levels of use of seasonal climate forecasts in management and improved knowledge was partly attributed to the climate applications activities of the project. Further, those who used seasonal forecasting (n = 25) didn’t understand key components of forecasts (e.g. probability, median) better than those who didn’t use seasonal forecasts (n = 24) (P > 0.05). This identifies the potential for misunderstanding and misinterpretation of forecasts among users and highlights the need for providers of forecasts to understand the difficulties and prepare simply written descriptions of forecasts and disseminate these with the maps showing probabilities. The most preferred means of accessing climate information were internet, email, ‘The Season Ahead’ newsletter and newspaper. The least preferred were direct contact with extension officers and attending field days and group meetings. Eighty-six percent of respondents used the internet and 67% used ADSL broadband internet (April 2003). Despite these findings, extension officers play a key role in preparing and publishing the information on the web, in emails and newsletters. We also believe that direct contact with extension officers trained in climate applications is desirable in workshop-like events to improve knowledge of the difficult concepts underpinning climate forecasts, which may then stimulate further adoption.


2020 ◽  
Author(s):  
Andrea Alessandri ◽  
Franco Catalano ◽  
Matteo De Felice ◽  
Kristian Nielsen ◽  
Alberto Troccoli ◽  
...  

<p>A key objective of the Added Value of Seasonal Climate Forecasts for Integrated Risk Management Decisions (SECLI-FIRM, www.secli-firm.eu) project is the optimisation of the performance of seasonal climate forecasts provided by many producing centers, in a Grand Multi-Model approach, for predictands relevant for the specific case studies considered in SECLI-FIRM.</p><p>The Grand Multi-Model Ensemble (MME) consists of the five Seasonal Prediction Systems (SPSs) provided by the European Copernicus C3S and a selection of other five SPSs independently developed by centres outside Europe, four by the North American (NMME) plus the SPS by the Japan Meteorological Agency (JMA).</p><p>All the possible multi-model combinations have been evaluated showing that, in general, only a limited number of SPSs is required to obtain the maximum attainable performance. Although the selection of models that perform better is usually different depending on the region/phenomenon under consideration, it is shown that the performance of the Grand-MME seasonal predictions is enhanced with the increase of the independence of the contributing SPSs, i.e. by mixing European SPSs with those from NMME-JMA.</p><p>Starting from the definition of the Brier score a novel metric has been developed, named the Brier score covariance (BScov), which estimates the relative independence of the prediction systems. BScov is used to quantify independence among the SPSs and, together with probabilistic skill metrics, used to develop a strategy for the identification of the combinations that optimize the probabilistic performance of seasonal predictions for the study cases.</p>


Sign in / Sign up

Export Citation Format

Share Document