Testing model adequacy for some Markov regression models for time series

Biometrika ◽  
1991 ◽  
Vol 78 (1) ◽  
pp. 83-89 ◽  
Author(s):  
W. K. LI
2019 ◽  
Vol 23 (10) ◽  
pp. 4323-4331 ◽  
Author(s):  
Wouter J. M. Knoben ◽  
Jim E. Freer ◽  
Ross A. Woods

Abstract. A traditional metric used in hydrology to summarize model performance is the Nash–Sutcliffe efficiency (NSE). Increasingly an alternative metric, the Kling–Gupta efficiency (KGE), is used instead. When NSE is used, NSE = 0 corresponds to using the mean flow as a benchmark predictor. The same reasoning is applied in various studies that use KGE as a metric: negative KGE values are viewed as bad model performance, and only positive values are seen as good model performance. Here we show that using the mean flow as a predictor does not result in KGE = 0, but instead KGE =1-√2≈-0.41. Thus, KGE values greater than −0.41 indicate that a model improves upon the mean flow benchmark – even if the model's KGE value is negative. NSE and KGE values cannot be directly compared, because their relationship is non-unique and depends in part on the coefficient of variation of the observed time series. Therefore, modellers who use the KGE metric should not let their understanding of NSE values guide them in interpreting KGE values and instead develop new understanding based on the constitutive parts of the KGE metric and the explicit use of benchmark values to compare KGE scores against. More generally, a strong case can be made for moving away from ad hoc use of aggregated efficiency metrics and towards a framework based on purpose-dependent evaluation metrics and benchmarks that allows for more robust model adequacy assessment.


Pathogens ◽  
2021 ◽  
Vol 10 (4) ◽  
pp. 480
Author(s):  
Rania Kousovista ◽  
Christos Athanasiou ◽  
Konstantinos Liaskonis ◽  
Olga Ivopoulou ◽  
George Ismailos ◽  
...  

Acinetobacter baumannii is one of the most difficult-to-treat pathogens worldwide, due to developed resistance. The aim of this study was to evaluate the use of widely prescribed antimicrobials and the respective resistance rates of A. baumannii, and to explore the relationship between antimicrobial use and the emergence of A. baumannii resistance in a tertiary care hospital. Monthly data on A. baumannii susceptibility rates and antimicrobial use, between January 2014 and December 2017, were analyzed using time series analysis (Autoregressive Integrated Moving Average (ARIMA) models) and dynamic regression models. Temporal correlations between meropenem, cefepime, and ciprofloxacin use and the corresponding rates of A. baumannii resistance were documented. The results of ARIMA models showed statistically significant correlation between meropenem use and the detection rate of meropenem-resistant A. baumannii with a lag of two months (p = 0.024). A positive association, with one month lag, was identified between cefepime use and cefepime-resistant A. baumannii (p = 0.028), as well as between ciprofloxacin use and its resistance (p < 0.001). The dynamic regression models offered explanation of variance for the resistance rates (R2 > 0.60). The magnitude of the effect on resistance for each antimicrobial agent differed significantly.


2015 ◽  
Vol 7 (2) ◽  
pp. 262-279 ◽  
Author(s):  
Zhichao Guo ◽  
Yuanhua Feng ◽  
Thomas Gries

Purpose – The purpose of this paper is to investigate changes of China’s agri-food exports to Germany caused by China’s accession to WTO and the global financial crisis in a quantitative way. The paper aims to detect structural breaks and compare differences before and after the change points. Design/methodology/approach – The structural breaks detection procedures in this paper can be applied to find out two different types of change points, i.e. in the middle and at the end of one time series. Then time series and regression models are used to compare differences of trade relationship before and after the detected change points. The methods can be employed in any economic series and work well in practice. Findings – The results indicate that structural breaks in 2002 and 2009 are caused by China’s accession to WTO and the financial crisis. Time series and regression models show that the development of China’s exports to Germany in agri-food products has different features in different sub-periods. Before 1999, there is no significant relationship between China’s exports to Germany and Germany’s imports from the world. Between 2002 and 2008 the former depends on the latter very strongly, and China’s exports to Germany developed quickly and stably. It decreased, however suddenly in 2009, caused by the great reduction of Germany’s imports from the world in that year. But China’s market share in Germany still had a small gain. Analysis of two categories in agri-food trade also leads to similar conclusions. Comparing the two events we see rather different patterns even if they both indicate structural breaks in the development of China’s agri-food exports to Germany. Originality/value – This paper partly originally proposes two statistical algorithms for detecting different kinds of structural breaks in the middle part and at the end of a short-time series, respectively.


Author(s):  
Rati WONGSATHAN

The novel coronavirus 2019 (COVID-19) pandemic was declared a global health crisis. The real-time accurate and predictive model of the number of infected cases could help inform the government of providing medical assistance and public health decision-making. This work is to model the ongoing COVID-19 spread in Thailand during the 1st and 2nd phases of the pandemic using the simple but powerful method based on the model-free and time series regression models. By employing the curve fitting, the model-free method using the logistic function, hyperbolic tangent function, and Gaussian function was applied to predict the number of newly infected patients and accumulate the total number of cases, including peak and viral cessation (ending) date. Alternatively, with a significant time-lag of historical data input, the regression model predicts those parameters from 1-day-ahead to 1-month-ahead. To obtain optimal prediction models, the parameters of the model-free method are fine-tuned through the genetic algorithm, whereas the generalized least squares update the parameters of the regression model. Assuming the future trend continues to follow the past pattern, the expected total number of patients is approximately 2,689 - 3,000 cases. The estimated viral cessation dates are May 2, 2020 (using Gaussian function), May 4, 2020 (using a hyperbolic function), and June 5, 2020 (using a logistic function), whereas the peak time occurred on April 5, 2020. Moreover, the model-free method performs well for long-term prediction, whereas the regression model is suitable for short-term prediction. Furthermore, the performances of the regression models yield a highly accurate forecast with lower RMSE and higher R2 up to 1-week-ahead. HIGHLIGHTS COVID-19 model for Thailand during the first and second phases of the epidemic The model-free method using the logistic function, hyperbolic tangent function, and Gaussian function  applied to predict the basic measures of the outbreak Regression model predicts those measures from one-day-ahead to one-month-ahead The parameters of the model-free method are fine-tuned through the genetic algorithm  GRAPHICAL ABSTRACT


Sign in / Sign up

Export Citation Format

Share Document