Forecasting performance measures – what are their practical meaning?

Author(s):  
Ronald K. Klimberg ◽  
George P. Sillup ◽  
Kevin J. Boyle ◽  
Vinay Tavva

Forecasting plays a crucial role in determining the direction of future trends and in making necessary investment decisions. This research presents the forecasting performance of three multivariate GARCH models: SGARCH, EGARCH, and GJR-GARCH based on Gaussian and Student’s t-distribution. The forecasting ability of the models is evaluated on the basis of forecasting performance measures: MAE, SSE, MSE, and RMSE. This is done by examining the hedged portfolios of three indices of NSE: NIFTY50, BANKNIFTY, and NIFTYIT. Daily data from Jan 2006 to Dec 2017 is taken and forecasts are conducted using out of sample data from Jan 2016-Dec 2017. Minimum mean square error (MMSE) forecasting method is used to generate conditional variance and covariance forecasts which in turn generate hedge ratios and corresponding hedged portfolio. Minimum variance hedge ratio framework of Ederington (1979) is used for hedging. The in-sample analysis shows that SGARCH with both the distribution performed better than the other models while out-of-sample analysis provides mixed results. EGARCH model assigns the lowest hedge ratio to NIFTY50 and BANKNIFTY while SGARCH model assigns the lowest hedge ratio to NIFTYIT. Forecasting performance measures show the least value for SGARCH and EGARCH model. In future these models are able to reduce maximum risk from the spot market. The results of this research has important implications for financial decision and policy makers.


2017 ◽  
Vol 6 (2) ◽  
pp. 75-82 ◽  
Author(s):  
Ryan Miller ◽  
Harrison Schwarz ◽  
Ismael S. Talke

Abstract Popularity trends of the NFL and NBA are fun and interesting for casual fans while also of critical importance for advertisers and businesses with an interest in the sports leagues. Sports leagues have clear and distinct seasons and these have a major impact on when each league is most popular. To measure the popularity of each league, we used search data from Google Trends that gives real-time and historical data on the relative popularity of search words. By using search volume to measure popularity, the times of year, a sport is popular relative to its season can be explained. It is also possible to forecast how sport leagues are trending relative to each other. We compared and discussed three different univariate models both theoretically and empirically: the trend plus seasonality regression, Holt- Winters Multiplicative (HWMM), and Seasonal Autoregressive Integrated Moving Average (SARIMA) models to determine the popularity trends. For each league, the six forecasting performance measures used in this study indicated HWMM gave the most accurate predictions.


2005 ◽  
Vol 25 (1) ◽  
pp. 43
Author(s):  
Leonardo Souza ◽  
Alvaro Veiga ◽  
Marcelo C. Medeiros

The important issue of forecasting volatilities brings the difficult task of back-testing the forecasting performance. As volatility cannot be observed directly, one has to use an observable proxy for volatility or a utility function to assess the prediction quality. This kind of procedure can easily lead to poor assessment. The goal of this paper is to compare different volatility models and different performance measures using White’s Reality Check. The Reality Check consists of a non-parametric test that checks if any of a number of concurrent methods yields forecasts significantly better than a given benchmark method. For this purpose, a Monte Carlo simulation is carried out with four different processes, one of them a Gaussian white noise and the others following GARCH specifications. Two benchmark methods are used: the naive (predicting the out-of-sample volatility by in-sample variance) and the Riskmetrics method


Sign in / Sign up

Export Citation Format

Share Document