Using Rating Scales in a Clinical Context

Author(s):  
Frank C. Verhulst ◽  
Jan Van der Ende
CJEM ◽  
2020 ◽  
Vol 22 (S1) ◽  
pp. S79-S79
Author(s):  
T. Robinson ◽  
N. Wagner ◽  
A. Szulewski ◽  
N. Dudek ◽  
W. Cheung ◽  
...  

Introduction: Competency based medical education (CBME) has triggered widespread utilization of workplace-based assessment (WBA) tools in postgraduate training programs. These WBAs predominately use rating scales with entrustment anchors, such as the Ottawa Surgical Competency Operating Room Evaluation (O-SCORE). However, little is known about the factors that influence a supervising physician's decision to assign a particular rating on scales using entrustment anchors. This study aimed to identify the factors that influence supervisors’ ratings of trainees using WBA tools with entrustment anchors at the time of assessment and to explore the experiences with and challenges of using entrustment anchors in the emergency department (ED). Methods: A convenience sample of full-time emergency medicine (EM) faculty were recruited from two sites within a single academic Canadian EM hospital system. Fifty semi-structured interviews were conducted with EM physicians within two hours of completing a WBA for an EM trainee. Interviews were audio-recorded, transcribed verbatim, and independently analyzed by two members of the research team. Themes were stratified by trainee level, rating and task. Results: Interviews involved 73% (27/37) of all EM staff and captured assessments completed on 83% (37/50) of EM trainees. The mean WBA rating of studied samples was 4.34 ± 0.77 (2 to 5), which was similar to the mean rating of all WBAs completed during the study period. Overall, six major factors were identified that influenced staff WBA ratings: amount of guidance required, perceived competence through discussion and questioning, trainee experience, clinical context, past experience working with the trainee, and perceived confidence. The majority of staff denied struggling to assign ratings. However, when they did struggle, it involved the interpretation of WBA anchors and their application to the clinical context in the ED. Conclusion: Several factors appear to be taken into account by clinical supervisors when they make decisions regarding the particular rating that they will assign a trainee on a WBA that uses entrustment anchors. Not all of these factors are specific to that particular clinical encounter. The results from this study further our understanding on the use of entrustment anchors within the ED and may facilitate faculty development regarding WBA completion as we move forward in CBME.


Author(s):  
Carl L. von Baeyer ◽  
Mark A. Connelly

Self-report is the primary source of information for assessment of pain and measurement of its intensity in most children aged 4 years and older. This chapter provides an overview of the variables addressed in assessment, specific tools used to obtain self-reports, and interpretation of self-reports in relation to observation, parent report, and clinical context. Challenges include establishing whether children are able to understand and use self-report scales and interpreting self-reported pain scores, especially when they conflict with clinicians’ observations and with the clinical context. Recent developments in assessing pain in children by self-report are introduced, including newly established strong psychometric support for numerical rating scales, development of electronic apps, and investigation of self-report scales for preschool-age children.


2019 ◽  
Vol 28 (2S) ◽  
pp. 915-924 ◽  
Author(s):  
Kristie A. Spencer ◽  
Mallory Dawson

Purpose This preliminary study examined whether speech profiles exist for adults with hereditary ataxia based on 2 competing frameworks: a pattern of instability/inflexibility or a pattern of differential subsystem involvement. Method Four dysarthria experts rated the speech samples of 8 adults with dysarthria from hereditary ataxia using visual analog scales and presence/severity rating scales of speech characteristics. Speaking tasks included diadochokinetics, sustained phonation, and a monologue. Results Speech profiles aligned with the instability/inflexibility framework, with the pattern of instability being the most common. Speech profiles did not emerge for the majority of speakers using the differential subsystem framework. Conclusions The findings extend previous research on pure ataxic dysarthria and suggest a possible framework for understanding the speech heterogeneity associated with the ataxias. The predominance of the instability profile is consistent with the notion of impaired feedforward control in speakers with cerebellar disruption.


2012 ◽  
Vol 21 (4) ◽  
pp. 136-143
Author(s):  
Lynn E. Fox

Abstract The self-anchored rating scale (SARS) is a technique that augments collaboration between Augmentative and Alternative Communication (AAC) interventionists, their clients, and their clients' support networks. SARS is a technique used in Solution-Focused Brief Therapy, a branch of systemic family counseling. It has been applied to treating speech and language disorders across the life span, and recent case studies show it has promise for promoting adoption and long-term use of high and low tech AAC. I will describe 2 key principles of solution-focused therapy and present 7 steps in the SARS process that illustrate how clinicians can use the SARS to involve a person with aphasia and his or her family in all aspects of the therapeutic process. I will use a case study to illustrate the SARS process and present outcomes for one individual living with aphasia.


2017 ◽  
Vol 2 (11) ◽  
pp. 79-90
Author(s):  
Courtney G. Scott ◽  
Trina M. Becker ◽  
Kenneth O. Simpson

The use of computer monitors to provide technology-based written feedback during clinical sessions, referred to as “bug-in-the-eye” (BITi) feedback, recently emerged in the literature with preliminary evidence to support its effectiveness (Carmel, Villatte, Rosenthal, Chalker & Comtois, 2015; Weck et al., 2016). This investigation employed a single-subject, sequential A-B design with two participants to observe the effects of implementing BITi feedback using a smartwatch on the clinical behavior of student clinicians (SCs). Baseline and treatment data on the stimulus-response-consequence (S-R-C) contingency completion rates of SCs were collected using 10 minute segments of recorded therapy sessions. All participants were students enrolled in a clinical practicum experience in a communication disorders and sciences (CDS) program. A celeration line, descriptive statistics, and stability band were used to analyze the data by slope, trend, and variability. Results demonstrated a significant correlative relationship between BITi feedback with a smartwatch and an increase in positive clinical behaviors. Based on qualitative interviews and exit rating scales, SCs reported BITi feedback was noninvasive and minimally distracting. Preliminary evidence suggests BITi feedback with a smartwatch may be an effective tool for providing real-time clinical feedback.


2003 ◽  
Vol 32 (2) ◽  
pp. 241-262 ◽  
Author(s):  
Lisa Marie Angello ◽  
Robert J. Volpe ◽  
James C. DiPerna ◽  
Sammi P. Gureasko-Moore ◽  
David P. Gureasko-Moore ◽  
...  

Crisis ◽  
1999 ◽  
Vol 20 (3) ◽  
pp. 115-120 ◽  
Author(s):  
Stephen Curran ◽  
Michael Fitzgerald ◽  
Vincent T Greene

There are few long-term follow-up studies of parasuicides incorporating face-to-face interviews. To date no study has evaluated the prevalence of psychiatric morbidity at long-term follow-up of parasuicides using diagnostic rating scales, nor has any study examined parental bonding issues in this population. We attempted a prospective follow-up of 85 parasuicide cases an average of 8½ years later. Psychiatric morbidity, social functioning, and recollections of the parenting style of their parents were assessed using the Clinical Interview Schedule, the Social Maladjustment Scale, and the Parental Bonding Instrument, respectively. Thirty-nine persons in total were interviewed, 19 of whom were well and 20 of whom had psychiatric morbidity. Five had died during the follow-up period, 3 by suicide. Migration, refusals, and untraceability were common. Parasuicide was associated with parental overprotection during childhood. Long-term outcome is poor, especially among those who engaged in repeated parasuicides.


2001 ◽  
Vol 17 (1) ◽  
pp. 25-35 ◽  
Author(s):  
G. Leonard Burns ◽  
James A. Walsh ◽  
David R. Patterson ◽  
Carol S. Holte ◽  
Rita Sommers-Flanagan ◽  
...  

Summary: Rating scales are commonly used to measure the symptoms of attention deficit/hyperactivity disorder (ADHD), oppositional defiant disorder (ODD), and conduct disorder (CD). While these scales have positive psychometric properties, the scales share a potential weakness - the use of vague or subjective rating procedures to measure symptom occurrence (e. g., never, occasionally, often, and very often). Rating procedures based on frequency counts for a specific time interval (e. g., never, once, twice, once per month, once per week, once per day, more than once per day) are less subjective and provide a conceptually better assessment procedure for these symptoms. Such a frequency count procedure was used to obtain parent ratings on the ADHD, ODD, and CD symptoms in a normative (nonclinical) sample of 3,500 children and adolescents. Although the current study does not provide a direct comparison of the two types of rating procedures, the results suggest that the frequency count procedure provides a potentially more useful way to measure these symptoms. The implications of the results are noted for the construction of rating scales to measure the ADHD, ODD, and CD symptoms.


Crisis ◽  
2003 ◽  
Vol 24 (2) ◽  
pp. 73-78 ◽  
Author(s):  
Yves Sarfati ◽  
Blandine Bouchaud ◽  
Marie-Christine Hardy-Baylé

Summary: The cathartic effect of suicide is traditionally defined as the existence of a rapid, significant, and spontaneous decrease in the depressive symptoms of suicide attempters after the act. This study was designed to investigate short-term variations, following a suicide attempt by self-poisoning, of a number of other variables identified as suicidal risk factors: hopelessness, impulsivity, personality traits, and quality of life. Patients hospitalized less than 24 hours after a deliberate (moderate) overdose were presented with the Montgomery-Asberg Depression and Impulsivity Rating Scales, Hopelessness scale, MMPI and World Health Organization's Quality of Life questionnaire (abbreviated versions). They were also asked to complete the same scales and questionnaires 8 days after discharge. The study involved 39 patients, the average interval between initial and follow-up assessment being 13.5 days. All the scores improved significantly, with the exception of quality of life and three out of the eight personality traits. This finding emphasizes the fact that improvement is not limited to depressive symptoms and enables us to identify the relative importance of each studied variable as a risk factor for attempted suicide. The limitations of the study are discussed as well as in particular the nongeneralizability of the sample and setting.


Sign in / Sign up

Export Citation Format

Share Document