scholarly journals 15. Temporal Trends in Effect Sizes: Causes, Detection, and Implications

Keyword(s):  
Author(s):  
Julia Koricheva ◽  
Michael D. Jennions ◽  
Joseph Lau

The general aim of meta-analysis is to combine scientific evidence scattered through a number of individual studies addressing the same topic. Evidence, however, is not static and tends to evolve over time due to changes in research methods, changes in the characteristics of the subjects being studied, for example. A number of recent studies in ecology and evolution have shown that temporal trends in effect sizes are common and often quite dramatic in these fields. Temporal changes in effect sizes could jeopardize the stability of conclusions (i.e., the conclusions of meta-analyses on the same topic conducted in different years might differ). For these reasons, this chapter is devoted to temporal changes in effect sizes. It first summarizes the findings of studies that examined temporal changes in the magnitude and direction of effect sizes in ecology, evolutionary biology, medicine, and the social sciences. It then discusses their possible causes, methods of detection, and implications for the interpretation of the results of the meta-analysis.


2020 ◽  
Vol 29 (2) ◽  
pp. 206-217
Author(s):  
Jianyuan Ni ◽  
Monica L. Bellon-Harn ◽  
Jiang Zhang ◽  
Yueqing Li ◽  
Vinaya Manchaiah

Objective The objective of the study was to examine specific patterns of Twitter usage using common reference to tinnitus. Method The study used cross-sectional analysis of data generated from Twitter data. Twitter content, language, reach, users, accounts, temporal trends, and social networks were examined. Results Around 70,000 tweets were identified and analyzed from May to October 2018. Of the 100 most active Twitter accounts, organizations owned 52%, individuals owned 44%, and 4% of the accounts were unknown. Commercial/for-profit and nonprofit organizations were the most common organization account owners (i.e., 26% and 16%, respectively). Seven unique tweets were identified with a reach of over 400 Twitter users. The greatest reach exceeded 2,000 users. Temporal analysis identified retweet outliers (> 200 retweets per hour) that corresponded to a widely publicized event involving the response of a Twitter user to another user's joke. Content analysis indicated that Twitter is a platform that primarily functions to advocate, share personal experiences, or share information about management of tinnitus rather than to provide social support and build relationships. Conclusions Twitter accounts owned by organizations outnumbered individual accounts, and commercial/for-profit user accounts were the most frequently active organization account type. Analyses of social media use can be helpful in discovering issues of interest to the tinnitus community as well as determining which users and organizations are dominating social network conversations.


2020 ◽  
Vol 29 (3) ◽  
pp. 1574-1595
Author(s):  
Chaleece W. Sandberg ◽  
Teresa Gray

Purpose We report on a study that replicates previous treatment studies using Abstract Semantic Associative Network Training (AbSANT), which was developed to help persons with aphasia improve their ability to retrieve abstract words, as well as thematically related concrete words. We hypothesized that previous results would be replicated; that is, when abstract words are trained using this protocol, improvement would be observed for both abstract and concrete words in the same context-category, but when concrete words are trained, no improvement for abstract words would be observed. We then frame the results of this study with the results of previous studies that used AbSANT to provide better evidence for the utility of this therapeutic technique. We also discuss proposed mechanisms of AbSANT. Method Four persons with aphasia completed one phase of concrete word training and one phase of abstract word training using the AbSANT protocol. Effect sizes were calculated for each word type for each phase. Effect sizes for this study are compared with the effect sizes from previous studies. Results As predicted, training abstract words resulted in both direct training and generalization effects, whereas training concrete words resulted in only direct training effects. The reported results are consistent across studies. Furthermore, when the data are compared across studies, there is a distinct pattern of the added benefit of training abstract words using AbSANT. Conclusion Treatment for word retrieval in aphasia is most often aimed at concrete words, despite the usefulness and pervasiveness of abstract words in everyday conversation. We show the utility of AbSANT as a means of improving not only abstract word retrieval but also concrete word retrieval and hope this evidence will help foster its application in clinical practice.


Methodology ◽  
2019 ◽  
Vol 15 (3) ◽  
pp. 97-105
Author(s):  
Rodrigo Ferrer ◽  
Antonio Pardo

Abstract. In a recent paper, Ferrer and Pardo (2014) tested several distribution-based methods designed to assess when test scores obtained before and after an intervention reflect a statistically reliable change. However, we still do not know how these methods perform from the point of view of false negatives. For this purpose, we have simulated change scenarios (different effect sizes in a pre-post-test design) with distributions of different shapes and with different sample sizes. For each simulated scenario, we generated 1,000 samples. In each sample, we recorded the false-negative rate of the five distribution-based methods with the best performance from the point of view of the false positives. Our results have revealed unacceptable rates of false negatives even with effects of very large size, starting from 31.8% in an optimistic scenario (effect size of 2.0 and a normal distribution) to 99.9% in the worst scenario (effect size of 0.2 and a highly skewed distribution). Therefore, our results suggest that the widely used distribution-based methods must be applied with caution in a clinical context, because they need huge effect sizes to detect a true change. However, we made some considerations regarding the effect size and the cut-off points commonly used which allow us to be more precise in our estimates.


2019 ◽  
Vol 50 (5-6) ◽  
pp. 292-304 ◽  
Author(s):  
Mario Wenzel ◽  
Marina Lind ◽  
Zarah Rowland ◽  
Daniela Zahn ◽  
Thomas Kubiak

Abstract. Evidence on the existence of the ego depletion phenomena as well as the size of the effects and potential moderators and mediators are ambiguous. Building on a crossover design that enables superior statistical power within a single study, we investigated the robustness of the ego depletion effect between and within subjects and moderating and mediating influences of the ego depletion manipulation checks. Our results, based on a sample of 187 participants, demonstrated that (a) the between- and within-subject ego depletion effects only had negligible effect sizes and that there was (b) large interindividual variability that (c) could not be explained by differences in ego depletion manipulation checks. We discuss the implications of these results and outline a future research agenda.


1993 ◽  
Vol 32 (01) ◽  
pp. 79-81 ◽  
Author(s):  
P. Millard ◽  
S. McClean

Abstract:The flow of patients through geriatric hospitals has been previously described in terms of acute and long-stay states where the bed occupancy at a census point is modelled by a mixed exponential model. Using data for sixteen years the model was fitted to successive annual census points, in order to provide a description of temporal trends. While the number of acute patients has remained fairly stable during the period, the model shows that there has been a decrease in the number of long-stay patients. Mean lengths of stay in our geriatric hospital before death or discharge have decreased during the study period for both acute and long-stay patients.Using these fits of the mixed exponential model to census data, a method is provided for predicting future turnover of patients. These predictions are reasonably good, except when the turnover patterns go through a period of flux in which assumption of stability no longer holds. Overall, a methodology is presented which relates census analysis to the behaviour of admission cohorts, thus producing a means of predicting future behaviour of patients and identifying where there is a change in patterns.


Sign in / Sign up

Export Citation Format

Share Document