“You Say Severe, I Say Mild”: Toward an Empirical Classification of Dysarthria Severity

2021 ◽  
pp. 1-18
Author(s):  
Kaila L. Stipancic ◽  
Kira M. Palmer ◽  
Hannah P. Rowe ◽  
Yana Yunusova ◽  
James D. Berry ◽  
...  
Keyword(s):  
Speech Intelligibility ◽  
Interrater Reliability ◽  
Reliability And Validity ◽  
Roc Curves ◽  
Speaking Rate ◽  
Response Options ◽  
Cutoff Points ◽  
Healthy Control ◽  
Dysarthric Speech ◽  
Surrogate Measures

Purpose: The main purpose of this study was to create an empirical classification system for speech severity in patients with dysarthria secondary to amyotrophic lateral sclerosis (ALS) by exploring the reliability and validity of speech-language pathologists' (SLPs') ratings of dysarthric speech. Method: Ten SLPs listened to speech samples from 52 speakers with ALS and 20 healthy control speakers. SLPs were asked to rate the speech severity of the speakers using five response options: normal, mild, moderate, severe, and profound. Four severity-surrogate measures were also calculated: SLPs transcribed the speech samples for the calculation of speech intelligibility and rated the effort it took to understand the speakers on a visual analog scale. In addition, speaking rate and intelligible speaking rate were calculated for each speaker. Intrarater and interrater reliability were calculated for each measure. We explored the validity of clinician-based severity ratings by comparing them to the severity-surrogate measures. Receiver operating characteristic (ROC) curves were conducted to create optimal cutoff points for defining dysarthria severity categories. Results: Intrarater and interrater reliability for the clinician-based severity ratings were excellent and were comparable to reliability for the severity-surrogate measures explored. Clinician severity ratings were strongly associated with all severity-surrogate measures, suggesting strong construct validity. We also provided a range of values for each severity-surrogate measure within each severity category based on the cutoff points obtained from the ROC analyses. Conclusions: Clinician severity ratings of dysarthric speech are reliable and valid. We discuss the underlying challenges that arise when selecting a stratification measure and offer recommendations for a classification scheme when stratifying patients and research participants into speech severity categories.

Effects of Temporal Alterations on Speech Intelligibility in Parkinsonian Dysarthria

1994 ◽  
Vol 37 (2) ◽  
pp. 244-253 ◽  
Author(s):  
Vicki L. Hammen ◽  
Kathryn M. Yorkston ◽  
Fred D. Minifie
Keyword(s):  
Signal Processing ◽  
Digital Signal Processing ◽  
Speech Intelligibility ◽  
Digital Signal ◽  
Speaking Rate ◽  
Speech Signals ◽  
Idiopathic Parkinson’S Disease ◽  
Rate Condition ◽  
Idiopathic Parkinson's Disease ◽  
Dysarthric Speech

The effect of two types of temporal alterations, paced and synthetic, on the intelligibility of parkinsonian dysarthric speech was investigated. Six speakers with idiopathic Parkinson’s disease served as subjects. Paced temporal alterations were created by slowing each speaker to 60% of his/her habitual speaking rate. The synthetic alterations were created by modifying the habitual rate speech samples using digital signal processing. Three types of synthetic alterations were examined: Pause Altered, Speech Duration Altered, and Pause and Speech Duration Altered. The 60% of habitual speaking rate condition was more intelligible than the synthetic conditions. In addition, none of the synthetic alterations were found to be more intelligible than samples produced at habitual speaking rates. The results suggest that simple alterations of speech signals do not explain the differences in intelligibility that have been observed when parkinsonian dysarthric speakers reduce speaking rates. Reasons for the failure of synthetic alterations to increase speech intelligibility scores are discussed.

Assessing Stressors Related to Migration in Patients With Psychiatric Disorders

2012 ◽  
Vol 28 (4) ◽  
pp. 262-269 ◽  
Author(s):  
Matthias Johannes Müller ◽  
Suzan Kamcili-Kubach ◽  
Songül Strassheim ◽  
Eckhardt Koch
Keyword(s):  
Interrater Reliability ◽  
Item Analysis ◽  
Global Assessment Of Functioning ◽  
Family Conflicts ◽  
Response Options ◽  
Reliability Indices ◽  
Dsm Iv ◽  
Functional Relevance ◽  
Sum Scores ◽  
Gaf Scores

A 10-item instrument for the assessment of probable migration-related stressors was developed based on previous work (MIGSTR10) and interrater reliability was tested in a chart review study. The MIGSTR10 and nine nonspecific stressors of the DSM-IV Axis IV (DSMSTR9) were put into a questionnaire format with categorical and dimensional response options. Charts of 100 inpatients (50 Turkish migrants [MIG], 50 native German patients [CON]) with affective or anxiety disorder were reviewed by three independent raters and MIGSTR10, DSMSTR9, and Global Assessment of Functioning scale (GAF) scores were obtained. Interrater reliability indices (ICC) of items and sum scores were calculated. The prevalence of single migration-related stressors in MIG ranged from 15% to 100% (CON 0–92%). All items of the MIGSTR10 (ICC 0.58–0.92) and the DSMSTR9 (ICC 0.56–0.96) reached high to very high interrater agreement (p < .0005). The item analysis of the MIGSTR10 revealed sufficient internal consistency (Cronbach’s α = 0.68/0.69) and only one item (“family conflicts”) without substantial correlation with the remaining scale. Correlation analyses showed a significant overlap of dimensional MIGSTR10 scores (r² = 0.25; p < .01) and DSMSTR9 scores (r² = 9%; p < .05) with GAF scores in MIG indicating functional relevance. MIGSTR10 is considered a feasible, economic, and reliable instrument for the assessment of stressors potentially related to migration.

Development and Initial Validation of a Project-Based Rubric to Assess the Systems-Based Practice Competency of Residents in the Clinical Chemistry Rotation of a Pathology Residency

2014 ◽  
Vol 138 (6) ◽  
pp. 809-813
Author(s):  
Carolyn R. Vitek ◽  
Jane C. Dale ◽  
Henry A. Homburger ◽  
Sandra C. Bryant ◽  
Amy K. Saenger ◽  
...  
Keyword(s):  
Critical Thinking ◽  
Interrater Reliability ◽  
Clinical Chemistry ◽  
Core Competencies ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Thinking Skills ◽  
Project Evaluation ◽  
Critical Thinking Skills

Context.— Systems-based practice (SBP) is 1 of 6 core competencies required in all resident training programs accredited by the Accreditation Council for Graduate Medical Education. Reliable methods of assessing resident competency in SBP have not been described in the medical literature. Objective.— To develop and validate an analytic grading rubric to assess pathology residents' analyses of SBP problems in clinical chemistry. Design.— Residents were assigned an SBP project based upon unmet clinical needs in the clinical chemistry laboratories. Using an iterative method, we created an analytic grading rubric based on critical thinking principles. Four faculty raters used the SBP project evaluation rubric to independently grade 11 residents' projects during their clinical chemistry rotations. Interrater reliability and Cronbach α were calculated to determine the reliability and validity of the rubric. Project mean scores and range were also assessed to determine whether the rubric differentiated resident critical thinking skills related to the SBP projects. Results.— Overall project scores ranged from 6.56 to 16.50 out of a possible 20 points. Cronbach α ranged from 0.91 to 0.96, indicating that the 4 rubric categories were internally consistent without significant overlap. Intraclass correlation coefficients ranged from 0.63 to 0.81, indicating moderate to strong interrater reliability. Conclusions.— We report development and statistical analysis of a novel SBP project evaluation rubric. The results indicate the rubric can be used to reliably assess pathology residents' critical thinking skills in SBP.

Reliability and Validity Analyses of the Youth Level of Service/Case Management Inventory

2005 ◽  
Vol 32 (3) ◽  
pp. 329-344 ◽  
Author(s):  
Fred Schmidt ◽  
Robert D. Hoge ◽  
Lezlie Gomes
Keyword(s):  
Juvenile Offenders ◽  
Case Management ◽  
Interrater Reliability ◽  
Assessment Tool ◽  
Reliability And Validity ◽  
Level Of Service ◽  
Risk Level ◽  
Criminogenic Needs ◽  
Health Assessments ◽  
Males And Females

The Youth Level of Service/Case Management Inventory (YLS/CMI) is a structured assessment tool designed to facilitate the effective intervention and rehabilitation of juvenile offenders by assessing each youth’s risk level and criminogenic needs. The present study examined the YLS/CMI’s reliability and validity in a sample of 107 juvenile offenders who were court-referred for mental health assessments. Results demonstrated the YLS/CMI’s internal consistency and interrater reliability. Moreover, the instrument’s predictive validity was substantiated on a number of recidivism measures for both males and females. Limitations of the current findings are discussed.

scholarly journals Examining Interrater Reliability and Validity of a Paediatric Cardiopulmonary Physiotherapy Discharge Tool

2014 ◽  
Vol 66 (2) ◽  
pp. 153-159 ◽  
Author(s):  
Jamil Lati ◽  
Vanessa Pellow ◽  
Jeannine Sproule ◽  
Dina Brooks ◽  
Cindy Ellerton
Keyword(s):  
Interrater Reliability ◽  
Reliability And Validity

scholarly journals Burnout in dental students: effectiveness of different methods

2013 ◽  
Vol 42 (5) ◽  
pp. 324-329 ◽  
Author(s):  
Juliana Alvares Duarte Bonini Campos ◽  
Paula Cristina Jordani ◽  
Miriane Lucindo Zucoloto ◽  
Fernanda Salloume Sampaio Bonafé ◽  
João Maroco
Keyword(s):  
Undergraduate Students ◽  
Gold Standard ◽  
Reliability And Validity ◽  
Roc Curves ◽  
Maslach Burnout Inventory ◽  
Dental Students ◽  
Burnout Syndrome ◽  
Screening Methods ◽  
Student Survey ◽  
Adequate Reliability

OBJECTIVE: This study was proposed to estimate the effectiveness of different screening methods of the Burnout Syndrome among dental students. MATERIAL AND METHOD: The Burnout Syndrome assessment was performed using the Oldenburg Inventory-Student survey (OLBI-SS) and the Copenhagen Inventory-Student survey (CBI‑SS). The Maslach Burnout Inventory-Student survey (MBI-SS) was used as the gold standard. The psychometric properties of the instruments were measured. The second-order hierarchical model was estimated to calculate the overall scores for OLBI-SS and CBI-SS, and ROC curves were constructed and the areas were estimated (AUROC). RESULT: A total of 235 undergraduate students participated in this study. The instruments showed an adequate reliability and validity; however three questions had to be removed from OLBI-SS and one from CBI-SS. The Exhaustion dimension of OLBI-SS, and Personal Burnout and Study related Burnout of CBI-SS presented a good discriminating capacity. CONCLUSION: CBI-SS showed higher discriminating capacity, than OLBI-SS, to identify the Burnout Syndrome (DAUROC=.172 [.103-.240]; p<.05).

Increasing the Precision of Dysarthric Speech Intelligibility and Severity Level Estimate

2021 ◽  
pp. 670-679
Author(s):  
Mohammad Soleymanpour ◽  
Michael T. Johnson ◽  
Jeffrey Berry
Keyword(s):  
Speech Intelligibility ◽  
Severity Level ◽  
Dysarthric Speech

Validation of Sherouk's Critical Thinking Test (SH-CTT)

2017 ◽  
Vol 8 (3) ◽  
pp. 14-24
Author(s):  
Sherouk J. Kadhm
Keyword(s):  
Critical Thinking ◽  
Reliability And Validity ◽  
Thinking Skills ◽  
Critical Thinking Skills ◽  
Arabic Version ◽  
Leadership Selection ◽  
Response Options ◽  
Academic Environments ◽  
Latent Constructs ◽  
Confirmatory Factor

This study aimed to examine the psychometric properties (reliability and validity) of the Arabic version of Sherouk's Critical Thinking Test. This test has four parts, each of which provides a story that is divided into an introduction and a scene; each story is then followed by a list of sensitive questions featuring two response options (Agree/Disagree). A sample of 158 university students participated in this study. The results showed that the reliability of the entire scale was 0.885, and the reliability of each of its four parts was 0.885, 0.829, 0.772, and 0.721, respectively. Confirmatory factor analysis of the collected data revealed a good fit with the latent constructs (CMIN/DF: 1.446; CMIN/DF: 1.357; CMIN/DF: 1.417; and CMIN/DF: 1.151) for parts one to four, respectively. The test's adaptability was considered when designing this instrument, and examinees were invited to review it. This paper recommended using this instrument in the fields of performance, leadership, selection, training, and improvement, and it was also created as a tool to measure individuals' critical thinking skills and abilities in organizations, companies, and academic environments. The English and German versions of this test were also examined; these versions are now currently available for use.

scholarly journals Teleassessment of Gait and Gait Aids: Validity and Interrater Reliability

2020 ◽  
Vol 100 (4) ◽  
pp. 708-717
Author(s):  
Kavita Venkataraman ◽  
Kristopher Amis ◽  
Lawrence R Landerman ◽  
Kevin Caves ◽  
Gerald C Koh ◽  
...  
Keyword(s):  
Repeated Measures ◽  
Interrater Reliability ◽  
Video Quality ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Slow Motion ◽  
Frame Rate ◽  
Normal Speed ◽  
Lower Frame ◽  
Rehabilitation Needs

Abstract Background Gait and mobility aid assessments are important components of rehabilitation. Given the increasing use of telehealth to meet rehabilitation needs, it is important to examine the feasibility of such assessments within the constraints of telerehabilitation. Objective The objective of this study was to examine the reliability and validity of the Tinetti Performance-Oriented Mobility Assessment gait scale (POMA-G) and cane height assessment under various video and transmission settings to demonstrate the feasibility of teleassessment. Design This repeated-measures study compared the test performances of in-person, slow motion (SM) review, and normal-speed (NS) video ratings at various fixed frame rates (8, 15, and 30 frames per second) and bandwidth (128, 384, and 768 kB/s) configurations. Methods Overall bias, validity, and interrater reliability were assessed for in-person, SM video, and NS video ratings, with SM video rating as the gold standard, as well as for different frame rate and bandwidth configurations within NS videos. Results There was moderate to good interrater reliability for the POMA-G (intraclass correlation coefficient [ICC] = 0.66–0.77 across all configurations) and moderate validity for in-person (β = 0.62; 95% confidence interval [CI] = 0.37–0.87) and NS video (β = 0.74; 95% CI = 0.67–0.80) ratings compared with the SM video rating. For cane height, interrater reliability was good (ICC = 0.66–0.77), although it was significantly lower at the lowest frame rate (8 frames per second) (ICC = 0.66; 95% CI = 0.54–0.76) and bandwidth (128 kB/s) (ICC = 0.69; 95% CI = 0.57–0.78) configurations. Validity for cane height was good for both in-person (β = 0.80; 95% CI = 0.62–0.98) and NS video (β = 0.86; 95% CI = 0.81–0.90) ratings compared with SM video rating. Limitations Some lower frame rate and bandwidth configurations may limit the reliability of remote cane height assessments. Conclusions Teleassessment for POMA-G and cane height using typically available internet and video quality is feasible, valid, and reliable.

scholarly journals Vowel Acoustics in Dysarthria: Speech Disorder Diagnosis and Classification

2014 ◽  
Vol 57 (1) ◽  
pp. 57-67 ◽  
Author(s):  
Kaitlin L. Lansford ◽  
Julie M. Liss
Keyword(s):  
Neurological Disease ◽  
Classification Scheme ◽  
Function Analysis ◽  
Group Differences ◽  
Means Testing ◽  
Healthy Control ◽  
History Of ◽  
Diagnosis And Classification ◽  
Dysarthric Speech ◽  
Second Formant

Purpose The purpose of this study was to determine the extent to which vowel metrics are capable of distinguishing healthy from dysarthric speech and among different forms of dysarthria. Method A variety of vowel metrics were derived from spectral and temporal measurements of vowel tokens embedded in phrases produced by 45 speakers with dysarthria and 12 speakers with no history of neurological disease. Via means testing and discriminant function analysis (DFA), the acoustic metrics were used to (a) detect the presence of dysarthria and (b) classify the dysarthria subtype. Results Significant differences between dysarthric and healthy control speakers were revealed for all vowel metrics. However, the results of the DFA demonstrated some metrics (particularly metrics that capture vowel distinctiveness) to be more sensitive and specific predictors of dysarthria. Only the vowel metrics that captured slope of the second formant (F2) demonstrated between-group differences across the dysarthrias. However, when subjected to DFA, these metrics proved unreliable classifiers of dysarthria subtype. Conclusion The results of these analyses suggest that some vowel metrics may be useful clinically for the detection of dysarthria but may not be reliable indicators of dysarthria subtype using the current dysarthria classification scheme.

Sign in / Sign up

Export Citation Format

Share Document