scholarly journals Assessment of individual competence

2021 ◽  
Vol 31 (1) ◽  
pp. e41736
Author(s):  
Jimmie Leppink

Aims: the assessment of individual competence in medical education is about finding a balance between having sufficient resources to make valid and reliable decisions and not using more resources than necessary. Sequential assessment, in which more resources are used for borderline performing candidates than for poorly or clearly satisfactorily performing candidates, can be used to achieve that balance. Although sequential assessment is commonly associated with larger groups of candidates to be assessed, in many practical settings numbers of candidates may be small.Objective: this article presents a single case design with a statistical model for the assessment of individual competence that can be used regardless of the number of candidates.Method: a worked example of a solution that can be used for an individual candidate, using simulated data in the zero-cost Open Source statistical program R version 4.0.5., is provided.Results: the aforementioned solution provides statistics that can be used to make pass/fail decisions at the level of the individual candidate as well as to make decisions regarding the length and timing of an exam (or parts thereof) for the individual candidate.Conclusion: the solution provided can help to reduce resources needed for assessment to a considerable extent while maximizing resources for borderline candidates. This facilitates both decision making and cost reduction in assessment.

2020 ◽  
Vol 2020 ◽  
pp. 1-11
Author(s):  
María Camino Gómez-Pérez ◽  
Azucena García-Palacios ◽  
Diana Castilla ◽  
Irene Zaragozá ◽  
Carlos Suso-Ribera

Objective. Overall, the literature on the effectiveness of psychological treatments in general and those for fibromyalgia in particular has been dominated by research designs that focus on large groups and explore changes on average, so the treatment impact at the individual level remains unclear. In this quasi-experimental, replicated single-case design, we will test the feasibility and effectiveness of a brief acceptance and committed therapy intervention using ecological momentary assessment supported by technology. Methods. The sample comprised 7 patients (3 in the individual condition and 4 in the group condition) who received a brief, 5-week psychological treatment. Patient evolution was assessed one week prior to treatment onset and during the whole study with a smartphone app. Because ecological momentary assessment and the use of an app are not frequent practices in routine care, we also evaluated the feasibility of this assessment methodology (i.e., compliance with the app). Change was investigated with a nonoverlap of all pairs index. Outcomes were pain interference with sleep and social activities, fatigue, sadness, and pain intensity. Results. Patient change was not uniform across outcomes. Four patients (two in each condition) showed relatively moderate levels of change (approximately 60% nonoverlap in several outcomes). The remaining patients showed more modest improvements which affected a reduced number of outcomes. Based on nonoverlapping indices, there was no clear evidence in favor of any treatment format. Conclusions. An alternative design to large-scale trials, one that focuses on the individual change, exists and it can be implemented in pain research. The use of technology (e.g., smartphones) simplifies such designs by facilitating ecological momentary assessment. Based on our findings showing that changes were not homogeneous across patients or outcomes, more single-case designs and patient-centered analyses (e.g., responder and moderation analyses) are required.


2020 ◽  
Vol 51 (1) ◽  
pp. 165-175 ◽  
Author(s):  
Lindsey A. Peters-Sanders ◽  
Elizabeth S. Kelley ◽  
Christa Haring Biel ◽  
Keri Madsen ◽  
Xigrid Soto ◽  
...  

Purpose This study evaluated the effects of an automated, small-group intervention designed to teach preschoolers challenging vocabulary words. Previous studies have provided evidence of efficacy. In this study, we evaluated the effects of the program after doubling the number of words taught from 2 to 4 words per book. Method Seventeen preschool children listened to 1 prerecorded book per week for 9 weeks. Each storybook had embedded, interactive lessons for 4 target vocabulary words. Each lesson provided repeated exposures to words and their definitions, child-friendly contexts, and multiple opportunities for children to respond verbally to instructional prompts. Participants were asked to define the weekly targeted vocabulary before and after intervention. A repeated acquisition single-case design was used to examine the effects of the books and embedded lessons on learning of target vocabulary words. Results Treatment effects were observed for all children across many of the books. Learning of at least 2 points (i.e., 1 word) was replicated for 74.5% of 149 books tested across the 17 participants. On average, children learned to define 47% of the target vocabulary words (17 out of 36). Conclusions Results support including 4 challenging words per book, as children learned substantially more words when 4 words were taught, in comparison to previous studies. Within an iterative development process, results of the current study take us 1 step closer to creating an optimal vocabulary intervention that supports the language development of at-risk children.


2020 ◽  
Vol 63 (12) ◽  
pp. 4148-4161
Author(s):  
Christine S.-Y. Ng ◽  
Stephanie F. Stokes ◽  
Mary Alt

Purpose We report on a replicated single-case design study that measured the feasibility of an expressive vocabulary intervention for three Cantonese-speaking toddlers with small expressive lexicons relative to their age. The aim was to assess the cross-cultural and cross-linguistic feasibility of an intervention method developed for English-speaking children. Method A nonconcurrent multiple-baseline design was used with four baseline data points and 16 intervention sessions per participant. The intervention design incorporated implicit learning principles, high treatment dosage, and control of the phonological neighborhood density of the stimuli. The children (24–39 months) attended 7–9 weeks of twice weekly input-based treatment in which no explicit verbal production was required from the child. Each target word was provided as input a minimum of 64 times in at least two intervention sessions. Treatment feasibility was measured by comparison of how many of the target and control words the child produced across the intervention period, and parent-reported expressive vocabulary checklists were completed for comparison of pre- and postintervention child spoken vocabulary size. An omnibus effect size for the treatment effect of the number of target and control words produced across time was calculated using Kendall's Tau. Results There was a significant treatment effect for target words learned in intervention relative to baselines, and all children produced significantly more target than control words across the intervention period. The effect of phonological neighborhood density on expressive word production could not be evaluated because two of the three children learned all target words. Conclusion The results provide cross-cultural evidence of the feasibility of a model of intervention that incorporated a high-dosage, cross-situational statistical learning paradigm to teach spoken word production to children with small expressive lexicons.


2018 ◽  
Vol 47 (3) ◽  
pp. 303-317
Author(s):  
H.M. Bowers ◽  
A.L. Wroe

Background: Previous research suggests benefits of targeting beliefs about the unacceptability of emotions in treatment for irritable bowel syndrome (IBS). Aims: The current study developed and tested an intervention focusing on beliefs and behaviours around emotional expression. Method: Four participants with IBS attended five group sessions using cognitive behavioural techniques focusing on beliefs about the unacceptability of expressing emotions. Bi-weekly questionnaires were completed and a group interview was conducted. This study used an AB design with four participants. Results: Averages indicate that participants showed decreases in beliefs about unacceptability of emotions and emotional suppression during the intervention, although this was not reflected in any of the individual trends in Beliefs about Emotions Scale scores and was significant in only one individual case for Courtauld Emotional Control Scale scores. Affective distress and quality of life improved during follow-up, with only one participant not improving with regard to distress. Qualitative data suggest that participants felt that the intervention was beneficial, referencing the value in sharing their emotions. Conclusions: This study suggests the potential for beliefs about emotions and emotional suppression to be addressed in cognitive behavioural interventions in IBS. That beliefs and behaviours improved before outcomes suggests they may be important processes to investigate in treatment for IBS.


2014 ◽  
Vol 68 (2) ◽  
pp. 203-211 ◽  
Author(s):  
L. Gustafsson ◽  
A. Walter ◽  
K. Bower ◽  
A. Slaughter ◽  
M. Hoyle

Sign in / Sign up

Export Citation Format

Share Document