Using a corpus in creating and evaluating a DCT

2020 ◽  
Vol 2 (1) ◽  
pp. 80-120 ◽  
Author(s):  
Brett J. Hashimoto ◽  
Kyra Nelson

Abstract Discourse Completion Tasks (DCTs) have been one of the most popular tools in pragmatics research. Yet, many have criticized DCTs for their lack of authenticity (e.g., Culpeper, Mackey, & Taguchi, 2018; Nguyen, 2019). We propose that corpora can serve as resources in designing and evaluating DCTs. We created a DCT using advice-seeking prompts from the Q+A corpus (Baker & Egbert, 2016). Then, we administered the DCT to 33 participants. We evaluated the DCT by (1) comparing the linguistic form and the semantic content of the participants’ DCT responses (i.e., advice-giving expressions) with authentic data from the corpus; and (2) interviewing the participants about the instrument quality. Chi-square tests between DCT data and corpus data revealed no significant differences in advice-giving expressions in terms of both the overall level of directness (χ2 [2, N = 660] = 6.94, p = .03, V = .10) and linguistic realization (χ2 [8, N = 660] = 17.75, p = .02, V = .16), and showed a significant difference but small effect size in terms of semantic content (χ2 [6, N = 512] = 30.35, p < .01, V = .24). Taken together with the interview data, our findings indicate that corpora are useful in designing DCTs.

2021 ◽  
Vol 11 ◽  
Author(s):  
Martin Götze ◽  
Matthias W. Hoppe

The relative age effect (RAE) is associated with (dis)advantages in competitive sports. While the RAE in elite male soccer reveals a skewed birthdate distribution in relation to a certain cut-off date, research of RAE in elite female soccer is affected by small number of samples and conflicting results. The purpose of this study was to investigate the RAE in elite adult German soccer regarding gender and competition level. The sample comprised 680 female and 1,083 male players of the two top German leagues during the 2019/20 season and German national teams (A-Team to Under 19). Differences between the observed and expected birthdate distributions were analyzed using chi-square statistics and effect sizes followed by calculating odds ratios. Results showed a statistically significant RAE with small effect size across all players included for both genders (female players: P &lt; 0.001, W = 0.16, male players: P &lt; 0.001, W = 0.23). The identified RAE was based on an over-representation of players born at the beginning of the year. According to gender and competition level, RAEs were more pronounced in German male soccer. While significant RAEs were found among males in the first two leagues (first league: P &lt; 0.001, W = 0.19, second league: P &lt; 0.001, W = 0.26), the RAE of females was more pronounced in the second league (first league: P = 0.080, W = 0.16, second league: P = 0.002, W = 0.20). The analysis of RAE regarding the national teams revealed a statistically significant RAE with large effect size for only the youngest investigated age group of male players (Under 19: P = 0.022, W = 0.52). Our data show an RAE in female and male German adult soccer, which could be accompanied by a loss of valuable elite players during the youth phase of the career. Consequently, the pool of talented players at the adult level would be limited.


10.2196/12967 ◽  
2019 ◽  
Vol 21 (8) ◽  
pp. e12967 ◽  
Author(s):  
Bhone Myint Kyaw ◽  
Pawel Posadzki ◽  
Sophie Paddock ◽  
Josip Car ◽  
James Campbell ◽  
...  

Background Effective communication skills are essential in diagnosis and treatment processes and in building the doctor-patient relationship. Objective Our aim was to evaluate the effectiveness of digital education in medical students for communication skills development. Broadly, we assessed whether digital education could improve the quality of future doctors’ communication skills. Methods We performed a systematic review and searched seven electronic databases and two trial registries for randomized controlled trials (RCTs) and cluster RCTs (cRCTs) published between January 1990 and September 2018. Two reviewers independently screened the citations, extracted data from the included studies, and assessed the risk of bias. We also assessed the quality of evidence using the Grading of Recommendations, Assessment, Development, and Evaluations assessment (GRADE). Results We included 12 studies with 2101 medical students, of which 10 were RCTs and two were cRCTs. The digital education included online modules, virtual patient simulations, and video-assisted oral feedback. The control groups included didactic lectures, oral feedback, standard curriculum, role play, and no intervention as well as less interactive forms of digital education. The overall risk of bias was high, and the quality of evidence ranged from moderate to very low. For skills outcome, meta-analysis of three studies comparing digital education to traditional learning showed no statistically significant difference in postintervention skills scores between the groups (standardized mean difference [SMD]=–0.19; 95% CI –0.9 to 0.52; I2=86%, N=3 studies [304 students]; small effect size; low-quality evidence). Similarly, a meta-analysis of four studies comparing the effectiveness of blended digital education (ie, online or offline digital education plus traditional learning) and traditional learning showed no statistically significant difference in postintervention skills between the groups (SMD=0.15; 95% CI –0.26 to 0.56; I2=86%; N=4 studies [762 students]; small effect size; low-quality evidence). The additional meta-analysis of four studies comparing more interactive and less interactive forms of digital education also showed little or no difference in postintervention skills scores between the two groups (SMD=0.12; 95% CI: –0.09 to 0.33; I2=40%; N=4 studies [893 students]; small effect size; moderate-quality evidence). For knowledge outcome, two studies comparing the effectiveness of blended online digital education and traditional learning reported no difference in postintervention knowledge scores between the groups (SMD=0.18; 95% CI: –0.2 to 0.55; I2=61%; N=2 studies [292 students]; small effect size; low-quality evidence). The findings on attitudes, satisfaction, and patient-related outcomes were limited or mixed. None of the included studies reported adverse outcomes or economic evaluation of the interventions. Conclusions We found low-quality evidence showing that digital education is as effective as traditional learning in medical students’ communication skills training. Blended digital education seems to be at least as effective as and potentially more effective than traditional learning for communication skills and knowledge. We also found no difference in postintervention skills between more and less interactive forms of digital education. There is a need for further research to evaluate the effectiveness of other forms of digital education such as virtual reality, serious gaming, and mobile learning on medical students’ attitude, satisfaction, and patient-related outcomes as well as the adverse effects and cost-effectiveness of digital education.


2018 ◽  
Vol 63 (1) ◽  
pp. 43-51 ◽  
Author(s):  
Charlini S. Hartz ◽  
Márcio A. G. Sindorf ◽  
Charles R. Lopes ◽  
José Batista ◽  
Marlene A. Moreno

Abstract Inspiratory muscle training (IMT) is a strategy that has been used to improve performance in different sports modalities. This study investigated the effects of an IMT program on respiratory muscle strength and resistance as well as aerobic physical performance (PP) of handball athletes. Nineteen 20 ± 3 year-old male athletes were allocated into an experimental (EG, n = 10) or a placebo group (PG, n = 9). Their respiratory muscle strength was evaluated by measuring the maximum inspiratory and expiratory pressures (MIP and MEP), muscular respiratory resistance by maximum voluntary ventilation (MVV) and aerobic PP by the cardiopulmonary exercise test. The study was designed to evaluate the effects of a 12-week IMT program with five sessions a week. A significant difference was observed in the pre and post IMT values of the MIP (170 ± 34 to 262 ± 33 cmH2O) and MEP (177 ± 36 to 218 ± 37 cmH2O) in the EG, and MIP (173 ± 45 to 213 ± 21 cmH2O) in the PG, with a large effect size for the MIP, when the groups were compared. MVV showed a significant increase (162 ± 24 to 173 ± 30 L) in the EG, with a small effect size. There was a significant difference in maximum oxygen uptake (54 ± 8 to 60 ± 7 ml/kg/min) in aerobic PP. Oxygen uptake at the respiratory compensation point (RCP) (46 ± 6 to 50 ± 5 ml/kg/min), with a moderate effect size for both variables, was observed in the EG after IMT. We concluded that IMT provided a significant increase in respiratory muscle strength and resistance, contributing to increased aerobic PP in the EG, which suggests that IMT could be incorporated in handball players’ training.


2021 ◽  
Vol 26 (3) ◽  
pp. 72-80
Author(s):  
Aleksandra Stoiljković ◽  
Slavica Tomić ◽  
Ozren Uzelac

Capital structure refers to the combination of debt and equity that the company uses to finance overall operations and growth. One of the most common problems of small enterprises is difficult access to various sources of financing, which is certainly reflected in their capital structure. Deciding on capital structure is one of the most important activities in the company, given that it significantly determines the performance of the company, but also the competitiveness and sustainability of the business. The aim of the study was to investigate whether there is a significant difference in financial performance between enterprises belonging to different leverage levels. Financial leverage was calculated by dividing total debts to total assets and based on leverage the companies are divided into 3 groups. Using ANOVA analysis, we found that the only difference in financial performance indicators was observed with NPM (but with a small effect size: eta square = 0.0470), whereas no statistically significant difference was observed between the groups in the ROE and ROA indicators.


Author(s):  
Ailene Lumanog ◽  
Myrna O. Medrano

The skills-based learning material was made and studied by the researcher due to sudden changes in education in a time of the pandemic. The main focus of this study is to determine the effectiveness of the skills-based learning material for English 9. This study used the pretest-posttest non-equivalent control group design, which falls under the quasi-experimental design. On the test of significant difference between the formative mean scores of the experimental and comparison groups, it was found out that the formative tests had a significant effect on the respondents' learning performance at p 0.01 level. Additionally, the posttest mean scores of each group; got the 0.01 level of significance, as well as the pretest and posttest mean scores of each group. Moreover, based on the computed Cohen's d value of 1.16, the effect size of the learning material to the students' performance is large compared to the comparison group that shows a small effect size at 0.31 Cohen's d value. Generally, there is a significant difference between the formative test of the two groups with the average and high mean scores, respectively. There is also a significant difference between the posttest mean scores of the two groups and as well between the pre-test and post-test mean scores. Moreover, Cohen's effect size value of 1.16 suggested a large effect of the material on the respondents' learning performance. As for recommendations, there is a need for the teacher to incorporate the 21st Century Skills into learning competencies.  


Author(s):  
Marcelo Vilhena Silva ◽  
Raphael Brito e Sousa ◽  
Gibson Moreira Praça ◽  
Juan Carlos Pérez Morales ◽  
Mauro Heleno Chagas ◽  
...  

This study aimed to compare technical actions of soccer players from different playing position during small-sided games in which teams were composed of players from the same position (e.g., three defenders). In total, 14 U-14 soccer players (14.43 ± 0.16 years), four defenders, four midfielders and four forwards, as well as 2 non-evaluated goalkeepers, participated in this study. The incidence of technical actions performed by players was analyzed through proportion chi-square test and omega effect sizes, and significance level was set at 5%. Results showed no differences in technical actions performed by players from different playing positions (p>0.05, small effect size). Thus, it is suggested that the 3v3 small-sided game, with teams composed of athletes with the same playing position, is characterized by a more general training stimulus, which can be particularly useful during the first years of deliberate practice.


2019 ◽  
Vol 21 (2) ◽  
pp. 64-103 ◽  
Author(s):  
John Read ◽  
Irving Kirsch ◽  
Laura McGrath

BackgroundElectroconvulsive therapy (ECT) is still being administered to approximately a million people annually. There have been no ECT versus simulated ECT (SECT) studies since 1985. The five meta-analyses of ECT versus SECT studies all claim that ECT is more effective than SECT for its primary target, severe depression. This review assesses the quality of those meta-analyses and of the 11 studies on which they are based.MethodsThe meta-analyses were evaluated primarily in terms of whether they considered the quality of the studies they included, but also in terms of whether they addressed efficacy beyond end of treatment. The methodological rigor of the 11 studies included by one or more of the meta-analyses was assessed using a 24-point Quality scale developed for this review.ResultsThe five meta-analyses include between 1 and 7 of the 11 studies. The meta-analyses pay little or no attention to the multiple limitations of the studies they include. The 11 studies have a mean Quality score of 12.3 out of 24. Eight scored 13 or less. Only four studies describe their processes of randomization and testing the blinding. None convincingly demonstrate that they are double-blind. Five selectively report their findings. Only four report any ratings by patients. None assess Quality of Life. The studies are small, involving an average of 37 people. Four of the 11 found ECT significantly superior to SECT at the end of treatment, five found no significant difference and two found mixed results (including one where the psychiatrists reported a difference but patients did not). Only two higher Quality studies report follow-up data, one produced a near-zero effect size (.065) in the direction of ECT, and the other a small effect size (.299) in favor of SECT.ConclusionsThe quality of most SECT–ECT studies is so poor that the meta-analyses were wrong to conclude anything about efficacy, either during or beyond the treatment period. There is no evidence that ECT is effective for its target demographic—older women, or its target diagnostic group—severely depressed people, or for suicidal people, people who have unsuccessfully tried other treatments first, involuntary patients, or children and adolescents. Given the high risk of permanent memory loss and the small mortality risk, this longstanding failure to determine whether or not ECT works means that its use should be immediately suspended until a series of well designed, randomized, placebo-controlled studies have investigated whether there really are any significant benefits against which the proven significant risks can be weighed.


Author(s):  
Bhone Myint Kyaw ◽  
Pawel Posadzki ◽  
Sophie Paddock ◽  
Josip Car ◽  
James Campbell ◽  
...  

BACKGROUND Effective communication skills are essential in diagnosis and treatment processes and in building the doctor-patient relationship. OBJECTIVE Our aim was to evaluate the effectiveness of digital education in medical students for communication skills development. Broadly, we assessed whether digital education could improve the quality of future doctors’ communication skills. METHODS We performed a systematic review and searched seven electronic databases and two trial registries for randomized controlled trials (RCTs) and cluster RCTs (cRCTs) published between January 1990 and September 2018. Two reviewers independently screened the citations, extracted data from the included studies, and assessed the risk of bias. We also assessed the quality of evidence using the Grading of Recommendations, Assessment, Development, and Evaluations assessment (GRADE). RESULTS We included 12 studies with 2101 medical students, of which 10 were RCTs and two were cRCTs. The digital education included online modules, virtual patient simulations, and video-assisted oral feedback. The control groups included didactic lectures, oral feedback, standard curriculum, role play, and no intervention as well as less interactive forms of digital education. The overall risk of bias was high, and the quality of evidence ranged from moderate to very low. For skills outcome, meta-analysis of three studies comparing digital education to traditional learning showed no statistically significant difference in postintervention skills scores between the groups (standardized mean difference [SMD]=–0.19; 95% CI –0.9 to 0.52; I2=86%, N=3 studies [304 students]; small effect size; low-quality evidence). Similarly, a meta-analysis of four studies comparing the effectiveness of blended digital education (ie, online or offline digital education plus traditional learning) and traditional learning showed no statistically significant difference in postintervention skills between the groups (SMD=0.15; 95% CI –0.26 to 0.56; I2=86%; N=4 studies [762 students]; small effect size; low-quality evidence). The additional meta-analysis of four studies comparing more interactive and less interactive forms of digital education also showed little or no difference in postintervention skills scores between the two groups (SMD=0.12; 95% CI: –0.09 to 0.33; I2=40%; N=4 studies [893 students]; small effect size; moderate-quality evidence). For knowledge outcome, two studies comparing the effectiveness of blended online digital education and traditional learning reported no difference in postintervention knowledge scores between the groups (SMD=0.18; 95% CI: –0.2 to 0.55; I2=61%; N=2 studies [292 students]; small effect size; low-quality evidence). The findings on attitudes, satisfaction, and patient-related outcomes were limited or mixed. None of the included studies reported adverse outcomes or economic evaluation of the interventions. CONCLUSIONS We found low-quality evidence showing that digital education is as effective as traditional learning in medical students’ communication skills training. Blended digital education seems to be at least as effective as and potentially more effective than traditional learning for communication skills and knowledge. We also found no difference in postintervention skills between more and less interactive forms of digital education. There is a need for further research to evaluate the effectiveness of other forms of digital education such as virtual reality, serious gaming, and mobile learning on medical students’ attitude, satisfaction, and patient-related outcomes as well as the adverse effects and cost-effectiveness of digital education.


2021 ◽  
Author(s):  
Ahmed Mohamed Hussein Unshur ◽  
Nasreldein Ahmed Idriss Aldouma

This study aimed at revealing the relationship between health risk perception and sense of responsibility among international students at International University of Africa in light of the COVID-19 pandemic, and determining the level of health risk perception and differences according to variables of gender, age, specialization, and continent. The study followed descriptive correlational method, and a sample of (n = 149) students were selected through purposive sampling. Two scales were designed and used to measure health risk perception and sense of responsibility. The study reached the following results: The level of health risk perception among the international students was high. There was a weak positive correlation between health risk perception and sense of responsibility among the international students. There was statistically significant difference with a medium effect size in level of health risk perception among the international students according to the gender variable. There was statistically significant difference with a small effect size in level of health risk perception according to the specialization variable. There were no statistically significant differences in level of health risk perception according to the variables of age and continent. The study concluded with a number of recommendations and some suggestion for future research.


2018 ◽  
Author(s):  
Geke Romijn ◽  
Neeltje Batelaan ◽  
Robin Kok ◽  
Jeroen Koning ◽  
Anton van Balkom ◽  
...  

BACKGROUND Ample studies show the high potential of Internet-delivered cognitive behavioural therapy (iCBT) for anxiety disorders. However, evidence for its effectiveness in routine care is scarce. We conducted a meta-analysis to compare results obtained in trials with open recruitment to results obtained in trials with clinical service recruitment and updated previous findings. OBJECTIVE The present study thus aims 1) to update the current evidence on iCBT for anxiety disorders by assessing overall efficacy and 2) to assess whether open recruitment results are comparable to those with recruitment in a routine care context. METHODS Randomised controlled trials were included in which the effects of iCBT for anxiety disorders were compared to wait-list controls (WLC) or face-to-face (f2f) CBT controls. Pooled effect sizes based on anxiety measures (primary outcome), depression and quality of life measures (secondary outcomes) were computed. RESULTS We included 42 studies with 53 comparisons (43 open recruitment comparisons and 10 clinical recruitment comparisons). Overall effect size of (1) iCBT versus WLC was g=0.72 (p<.001) and (2) iCBT versus f2f CBT g=0.12 (p=0.11). Subgroup analyses revealed (3) iCBT clinical recruitment studies with WLC as comparator: g=0.29 (p<0.01), while iCBT open recruitment studies with WLC comparators showed a higher significant effect of g=0.76 (p<0.001). (4) Clinical recruitment studies comparing iCBT to f2f CBT revealed a non-significant and small effect size g=0.06 (p=0.51) while open recruitment studies comparing iCBT to f2f CBT showed an effect of g=0.19 (p=0.09). Comparing clinical recruitment trials with open recruitment trials showed a significant difference in effect size (p<.001) based on WLC comparators, and no significant difference (p=0.38) based on f2f CBT comparators. CONCLUSIONS iCBT is effective in samples recruited in routine clinical practice, but effect sizes are smaller than those found in open recruitment trials. More studies with routine care populations are needed to further validate these findings.


Sign in / Sign up

Export Citation Format

Share Document