scholarly journals Implementing Confidence Assessment in Low-Stakes, Formative Mathematics Assessments

Author(s):  
Colin Foster

AbstractConfidence assessment (CA) involves students stating alongside each of their answers a confidence rating (e.g. 0 low to 10 high) to express how certain they are that their answer is correct. Each student’s score is calculated as the sum of the confidence ratings on the items that they answered correctly, minus the sum of the confidence ratings on the items that they answered incorrectly; this scoring system is designed to incentivize students to give truthful confidence ratings. Previous research found that secondary-school mathematics students readily understood the negative-marking feature of a CA instrument used during one lesson, and that they were generally positive about the CA approach. This paper reports on a quasi-experimental trial of CA in four secondary-school mathematics lessons (N = 475 students) across time periods ranging from 3 weeks up to one academic year, compared to business-as-usual controls. A meta-analysis of the effect sizes across the four schools gave an aggregated Cohen’s d of –0.02 [95% CI –0.22, 0.19] and an overall Bayes Factor B01 of 8.48. This indicated substantial evidence for the null hypothesis that there was no difference between the attainment gains of the intervention group and the control group, relative to the alternative hypothesis that the gains were different. I conclude that incorporating confidence assessment into low-stakes classroom mathematics formative assessments does not appear to be detrimental to students’ attainment, and I suggest reasons why a clear positive outcome was not obtained.

2021 ◽  
pp. postgradmedj-2021-140287
Author(s):  
Ahmad Fariz Malvi Zamzam Zein ◽  
Catur Setiya Sulistiyana ◽  
Wilson Matthew Raffaello ◽  
Arief Wibowo ◽  
Raymond Pranata

PurposeThis systematic review and meta-analysis aimed to evaluate the effect of sofosbuvir/daclatasvir (SOF/DCV) on mortality, the need for intensive care unit (ICU) admission or invasive mechanical ventilation (IMV) and clinical recovery in patients with COVID-19.MethodsWe performed a systematic literature search through the PubMed, Scopus and Embase from the inception of databases until 6 April 2021. The intervention group was SOF/DCV, and the control group was standard of care. The primary outcome was mortality, defined as clinically validated death. The secondary outcomes were (1) the need for ICU admission or IMV and (2) clinical recovery. The pooled effect estimates were reported as risk ratios (RRs).ResultsThere were four studies with a total of 231 patients in this meta-analysis. Three studies were randomised controlled trial, and one study was non-randomised. SOF/DCV was associated with lower mortality (RR: 0.31 (0.12, 0.78); p=0.013; I2: 0%) and reduced need for ICU admission or IMV (RR: 0.35 (0.18, 0.69); p=0.002; I2: 0%). Clinical recovery was achieved more frequently in the SOF/DCV (RR: 1.20 (1.04, 1.37); p=0.011; I2: 21.1%). There was a moderate certainty of evidence for mortality and need for ICU/IMV outcome, and a low certainty of evidence for clinical recovery. The absolute risk reductions were 140 fewer per 1000 for mortality and 186 fewer per 1000 for the need for ICU/IMV. The increase in clinical recovery was 146 more per 1000.ConclusionSOF/DCV may reduce mortality rate and need for ICU/IMV in patients with COVID-19 while increasing the chance for clinical recovery.Protocol registrationPROSPERO: CRD42021247510.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Duygu Akçay ◽  
Nuray Barış

Purpose The purpose of this paper is to evaluate the impact of interventions focused on reducing screen time in children. Design/methodology/approach Studies that aim to investigate the effects of interventions aimed at reducing the time spent in front of the screen (i.e. screen time). A Random-effects model was used to calculate the pooled standard mean differences. The outcome was to evaluate the screen time in children in the 0–18 age range. A subgroup analysis was performed to reveal the extent to which the overall effect size varied by subgroups (participant age, duration of intervention and follow). Findings For the outcome, the meta-analysis included 21 studies, and the standard difference in mean change in screen time in the intervention group compared with the control group was −0.16 (95% confidence interval [CI], −0.21 to −0.12) (p < 0.001). The effect size was found to be higher in long-term (=7 months) interventions and follow-ups (p < 0.05). Originality/value Subgroup analysis showed that a significant effect of screen time reduction was observed in studies in which the duration of intervention and follow-up was =7 months. As the evidence base grows, future researchers can contribute to these findings by conducting a more comprehensive analysis of effect modifiers and optimizing interventions to reduce screen time.


2021 ◽  
Author(s):  
Neil McLatchie ◽  
Manuela Thomae

Thomae and Viki (2013) reported that increased exposure to sexist humour can increase rape proclivity among males, specifically those who score high on measures of Hostile Sexism. Here we report two pre-registered direct replications (N = 530) of Study 2 from Thomae and Viki (2013) and assess replicability via (i) statistical significance, (ii) Bayes factors, (iii) the small-telescope approach, and (iv) an internal meta-analysis across the original and replication studies. The original results were not supported by any of the approaches. Combining the original study and the replications yielded moderate evidence in support of the null over the alternative hypothesis with a Bayes factor of B = 0.13. In light of the combined evidence, we encourage researchers to exercise caution before claiming that brief exposure to sexist humour increases male’s proclivity towards rape, until further pre-registered and open research demonstrates the effect is reliably reproducible.


2021 ◽  
Vol 2021 ◽  
pp. 1-11
Author(s):  
Menglin Li ◽  
Yunyun Liu ◽  
Haoran Wang ◽  
Shuzhen Zheng ◽  
Yinhe Deng ◽  
...  

Objective. To systematically evaluate the efficacy and safety of acupuncture for patients with recurrent implantation failure (RIF) undergoing in vitro fertilization-embryo transfer (IVF-ET) and hopefully provide reliable guidance for clinicians and patients. Methods. Through searching domestic and foreign medical journals, the literature of randomized controlled trials (RCTs) of acupuncture for RIF undergoing IVF-ET was collected. RevMan 5.3 software was used for meta-analysis and Cochrane’s risk of bias assessment tool was used to evaluate the quality of the included studies. Results. Seven documents meeting the criteria were finally included. The results showed that the intervention group contributes more in outcomes including clinical pregnancy rate (RR = 1.90, 95% CI (1.51, 2.40), P < 0.05 ), biochemical pregnancy rate (RR = 1.59, 95% CI (1.27, 1.99), P < 0.05 ), embryo implantation rate (RR = 1.89, 95% CI (1.47, 2.45), P < 0.05 ), and endometrial thickness (MD = 1.11, 95% CI (0.59, 1.63), P < 0.05 ) when compared with the control group, and the difference is statistically significant. In terms of the number of embryo transfers and the type of endometrium, the difference between the acupuncture group and the control group was not statistically significant. Conclusion. Acupuncture therapy on patients with RIF can improve the pregnancy outcome of patients. It is a relatively effective treatment with satisfactory safety and suitable for clinical application. However, as the quality of the included studies is not good enough, the conclusion of this meta-analysis should be treated with caution. More double-blind RCTs equipped with high quality and large samples are expected for the improvement of the level of evidence.


Sign in / Sign up

Export Citation Format

Share Document