Repeatability of Commonly Used Speech and Language Features for Clinical Applications

Introduction: Changes in speech have the potential to provide important information on the diagnosis and progression of various neurological diseases. Many researchers have relied on open-source speech features to develop algorithms for measuring speech changes in clinical populations as they are convenient and easy to use. However, the repeatability of open-source features in the context of neurological diseases has not been studied. Methods: We used a longitudinal sample of healthy controls, individuals with amyotrophic lateral sclerosis, and individuals with suspected frontotemporal dementia, and we evaluated the repeatability of acoustic and language features separately on these 3 data sets. Results: Repeatability was evaluated using intraclass correlation (ICC) and the within-subjects coefficient of variation (WSCV). In 3 sets of tasks, the median ICC were between 0.02 and 0.55, and the median WSCV were between 29 and 79%. Conclusion: Our results demonstrate that the repeatability of speech features extracted using open-source tool kits is low. Researchers should exercise caution when developing digital health models with open-source speech features. We provide a detailed summary of feature-by-feature repeatability results (ICC, WSCV, SE of measurement, limits of agreement for WSCV, and minimal detectable change) in the online supplementary material so that researchers may incorporate repeatability information into the models they develop.

Download Full-text

07 Examination of Reliability and Validity of Index of Postural Stability for Patients with Neurological Diseases

Age and Ageing ◽

10.1093/ageing/afz164.07 ◽

2019 ◽

Vol 48 (Supplement_4) ◽

pp. iv1-iv2

Author(s):

Hisashi Mochizuki

Keyword(s):

Neurological Disease ◽

Postural Stability ◽

Neurological Diseases ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Minimal Detectable Change ◽

Altman Plot ◽

Bland Altman Plot ◽

Functional Reach Test ◽

Balance Ability

Abstract Purpose The purpose of this study was to examine the reliability and validity of the Index of Postural Stability for patients with neurological disease. Methods The Index of postural stability (IPS) is a logarithmic value of the ratio between the stability limit and the area of centre of pressure (COP) in standing position, and is based on a probabilistic idea. Subjects were 75 patients with neurological disease (mean age; 63±12 years, 47 with Parkinson's disease, 9 with multiple sclerosis, 8 with Parkinsonism and others 11). Balance ability of subjects were assessed using IPS, Berg balance scale (BBS), Timed Up and Go Test(TUG), Functional Reach Test(FR), and gait ability of subjects were assessed using Functional Gait Category(FAC). IPS was assessed twice at intervals of about 30 minutes. Reliability of IPS was examined using Intraclass correlation coefficient (ICC), Bland-Altman plot and minimal detectable change (MDC). Validity of IPS was examined using correlation coefficients with BBS, TUG, FRT, and FAC. Results IPS showed significant and moderate correlation with BBS (r = 0.54), FR (r = 0.36), TUG (r =-0.43). IPS and FAC showed strong correlation (rs= 0.64). ICC of 2 separate measurements was 0.96. From the results of Bland-Altman plot, IPS had no additional error or proportional error (95%CI:-0.048~0.034, r=-0.0088, p=0.94). The MDC of IPS was 0.34. Discussion Since IPS has high reproducibility and does not have additional errors or proportional errors, and is also significantly related to other evaluation indexes of balance ability, it is considered that IPS may be a useful evaluation index of balance ability for patients with neurological diseases.

Download Full-text

CellTool: an open source software combining bio-image analysis and mathematical modeling

10.1101/454256 ◽

2018 ◽

Author(s):

Georgi Danovski ◽

Teodora Dyankova ◽

Stoyno Stoynov

Keyword(s):

Mathematical Modeling ◽

Image Analysis ◽

Open Source ◽

Open Source Software ◽

Time Lapse ◽

Supplementary Information ◽

Data Sets ◽

Link Type ◽

Sample Data ◽

Supplementary Material

AbstractSummaryWe present CellTool, a stand-alone open source software with a Graphical User Interface for image analysis, optimized for measurement of time-lapse microscopy images. It combines data management, image processing, mathematical modeling and graphical presentation of data in a single package. Multiple image filters, segmentation and particle tracking algorithms, combined with direct visualization of the obtained results make CellTool an ideal application for rapid execution of complex tasks. In addition, the software allows for the fitting of the obtained results to predefined or custom mathematical models. Importantly, CellTool provides a platform for easy implementation of custom image analysis packages written on a variety of programing languages.Availability and ImplementationCellTool is a free software available for MS Windows OS under the terms of the GNU General Public License. Executables and source files, supplementary information and sample data sets are freely available for download at URL: https://dnarepair.bas.bg/software/CellTool/[email protected]; [email protected];Supplementary informationSupplementary data are available at URL: https://dnarepair.bas.bg/software/CellTool/Program/CellTool_UserGuide.pdf

Download Full-text

Mills' syndrome. A clinical case of a rare degenerative pathology of the central nervous system

Spravočnik vrača obŝej praktiki (Journal of Family Medicine) ◽

10.33920/med-10-2004-07 ◽

2020 ◽

pp. 57-60

Author(s):

Konstantin Gulyabin

Keyword(s):

Central Nervous System ◽

Nervous System ◽

Neurological Diseases ◽

Cortical Atrophy ◽

Primary Lateral Sclerosis ◽

System A ◽

The Central Nervous System ◽

Primary Lateral ◽

Lateral Sclerosis ◽

Mills Syndrome

Mills' syndrome is a rare neurological disorder. Its nosological nature is currently not completely determined. Nevertheless, Mills' syndrome is considered to be a rare variant of the degenerative pathology of the central nervous system – a variant of focal cortical atrophy. The true prevalence of this pathology is unknown, since this condition is more often of a syndrome type, observed in the clinical picture of a number of neurological diseases (primary lateral sclerosis, frontotemporal dementia, etc.) and is less common in isolated form.

Download Full-text

Cross-cultural translation and validation of the Spanish version of the patellofemoral pain and osteoarthritis subscale of the KOOS (KOOS-PF)

BMC Research Notes ◽

10.1186/s13104-021-05619-3 ◽

2021 ◽

Vol 14 (1) ◽

Author(s):

Juan Pablo Martinez-Cano ◽

Daniel Vernaza-Obando ◽

Julián Chica ◽

Andrés Mauricio Castro

Keyword(s):

Intraclass Correlation ◽

Patellofemoral Pain ◽

Spanish Version ◽

Minimal Detectable Change ◽

Global Rating ◽

Minimal Important Change ◽

Specific Patient ◽

Retest Reliability ◽

Patient Reported ◽

Test Retest Reliability

Abstract Objective The aim of this study was to translate to Spanish the patellofemoral pain and osteoarthritis subscale of the knee injury and osteoarthritis outcome score (KOOS-PF) and validate this Spanish version of a disease-specific patient-reported outcome measure (PROM) for patellofemoral pain. Results The KOOS-PF was translated to Spanish and sixty patients with patellofemoral pain and/or osteoarthritis accepted to complete the questionnaire. 1-week later 58 patients answered the questions again for the test–retest reliability validation and finally 55 patients completed 1-month later for the responsiveness assessment. The Spanish version showed very good internal consistency (Cronbach’s alpha: 0.93) and test–retest reliability (intraclass correlation coefficient: 0.82). Responsiveness was confirmed, showing a strong correlation with the global rating of change (GROC) score (r 0.64). The minimal detectable change was 11.1 points, the minimal important change was 17.2 points, and there were no floor or ceiling effects for the score.

Download Full-text

Human Monocytes Plasticity in Neurodegeneration

Biomedicines ◽

10.3390/biomedicines9070717 ◽

2021 ◽

Vol 9 (7) ◽

pp. 717

Author(s):

Ilenia Savinetti ◽

Angela Papagna ◽

Maria Foti

Keyword(s):

Neurodegenerative Disorders ◽

Current Knowledge ◽

Neurological Diseases ◽

Surface Marker ◽

First Line ◽

Surface Marker Expression ◽

Physiological Properties ◽

Attractive Therapeutic Target ◽

The Brain ◽

Lateral Sclerosis

Monocytes play a crucial role in immunity and tissue homeostasis. They constitute the first line of defense during the inflammatory process, playing a role in the pathogenesis and progression of diseases, making them an attractive therapeutic target. They are heterogeneous in morphology and surface marker expression, which suggest different molecular and physiological properties. Recent evidences have demonstrated their ability to enter the brain, and, as a consequence, their hypothetical role in different neurodegenerative diseases. In this review, we will discuss the current knowledge about the correlation between monocyte dysregulation in the brain and/or in the periphery and neurological diseases in humans. Here we will focus on the most common neurodegenerative disorders, such as Alzheimer’s disease, Parkinson’s disease, amyotrophic lateral sclerosis and multiple sclerosis.

Download Full-text

Cerebrospinal Fluid Chitinases as Biomarkers for Amyotrophic Lateral Sclerosis

Diagnostics ◽

10.3390/diagnostics11071210 ◽

2021 ◽

Vol 11 (7) ◽

pp. 1210

Author(s):

Júlia Costa ◽

Marta Gromicho ◽

Ana Pronto-Laborinho ◽

Conceição Almeida ◽

Ricardo A. Gomes ◽

...

Keyword(s):

Amyotrophic Lateral Sclerosis ◽

Cerebrospinal Fluid ◽

Motor Neurons ◽

Neurological Diseases ◽

Disease Diagnosis ◽

Enzyme Linked Immunosorbent Assay ◽

Progression Rate ◽

Therapeutic Trials ◽

Als Patients ◽

Lateral Sclerosis

Amyotrophic lateral sclerosis (ALS) is a neurodegenerative neuromuscular disease that affects motor neurons controlling voluntary muscles. Survival is usually 2–5 years after onset, and death occurs due to respiratory failure. The identification of biomarkers would be very useful to help in disease diagnosis and for patient stratification based on, e.g., progression rate, with implications in therapeutic trials. Neurofilaments constitute already-promising markers for ALS and, recently, chitinases have emerged as novel marker targets for the disease. Here, we investigated cerebrospinal fluid (CSF) chitinases as potential markers for ALS. Chitotriosidase (CHIT1), chitinase-3-like protein 1 (CHI3L1), chitinase-3-like protein 2 (CHI3L2) and the benchmark marker phosphoneurofilament heavy chain (pNFH) were quantified by an enzyme-linked immunosorbent assay (ELISA) from the CSF of 34 ALS patients and 24 control patients with other neurological diseases. CSF was also analyzed by UHPLC-mass spectrometry. All three chitinases, as well as pNFH, were found to correlate with disease progression rate. Furthermore, CHIT1 was elevated in ALS patients with high diagnostic performance, as was pNFH. On the other hand, CHIT1 correlated with forced vital capacity (FVC). The three chitinases correlated with pNFH, indicating a relation between degeneration and neuroinflammation. In conclusion, our results supported the value of CHIT1 as a diagnostic and progression rate biomarker, and its potential as respiratory function marker. The results opened novel perspectives to explore chitinases as biomarkers and their functional relevance in ALS.

Download Full-text

Test–Retest Reliability of the Mini-BESTest in People With Mild to Moderate Multiple Sclerosis

Physical Therapy ◽

10.1093/ptj/pzab045 ◽

2021 ◽

Author(s):

A Wallin ◽

M Kierkegaard ◽

E Franzén ◽

S Johansson

Keyword(s):

Multiple Sclerosis ◽

Measurement Errors ◽

Balance Control ◽

Intraclass Correlation ◽

Repeated Measurements ◽

Minimal Detectable Change ◽

Detectable Change ◽

Limits Of Agreement ◽

Retest Reliability ◽

Test Retest Reliability

Abstract Objective The mini-BESTest is a balance measure for assessment of the underlying physiological systems for balance control in adults. Evaluations of test–retest reliability of the mini-BESTest in larger samples of people with multiple sclerosis (MS) are lacking. The purpose of this study was to investigate test–retest reliability of the mini-BESTest total and section sum scores and individual items in people with mild to moderate overall MS disability. Methods This study used a test–retest design in a movement laboratory setting. Fifty-four people with mild to moderate overall MS disability according to the Expanded Disability Status scale (EDSS) were included, with 28 in the mild subgroup (EDSS 2.0–3.5) and 26 in the moderate subgroup (EDSS 4.0–5.5). Test–retest reliability of the mini-BESTest was evaluated by repeated measurements taken 1 week apart. Reliability and measurement error were analyzed. Results Test–retest reliability for the total scores were considered good to excellent, with intraclass correlation coefficients of .88 for the whole sample, .83 for the mild MS subgroup, and .80 for the moderate MS subgroup. Measurement errors were small, with standard error of measurement and minimal detectable change of 1.3 and 3.5, respectively, in mild MS, and 1.7 and 4.7, respectively, in moderate MS. The limits of agreement were − 3.4 and 4.6. Test–retest reliability for the section scores were fair to good or excellent; weighted kappa values ranged from .62 to .83. All items but 1 showed fair to good or excellent test–retest reliability, and percentage agreement ranged from 61% to 100%. Conclusions The mini-BESTest demonstrated good to excellent test–retest reliability and small measurement errors and is recommended for use in people with mild to moderate MS. Impact Knowledge of limits of agreement and minimal detectable change contribute to interpretability of the mini-BESTest total score. The findings of this study enhance the clinical usefulness of the test for evaluation of balance control and for designing individually customized balance training with high precision and accuracy in people with MS.

Download Full-text

Psychometric Properties of the MyotonPRO in Dementia Patients with Paratonia

Gerontology ◽

10.1159/000485462 ◽

2017 ◽

Vol 64 (4) ◽

pp. 401-412 ◽

Cited By ~ 5

Author(s):

Hans Drenth ◽

Sytse U. Zuidema ◽

Wim P. Krijnen ◽

Ivan Bautmans ◽

Cees van der Schans ◽

...

Keyword(s):

Psychometric Properties ◽

Correlation Coefficient ◽

Intraclass Correlation ◽

Correlation Coefficients ◽

Functional Mobility ◽

Future Research ◽

Minimal Detectable Change ◽

Muscle Properties ◽

Dementia Patients ◽

Longitudinal Outcome

Background: Paratonia is a distinctive form of hypertonia, causing loss of functional mobility in early stages of dementia to severe high muscle tone and pain in the late stages. For assessing and evaluating therapeutic interventions, objective instruments are required. Objective: Determine the psychometric properties of the MyotonPRO, a portable device that objectively measures muscle properties, in dementia patients with paratonia. Methods: Muscle properties were assessed with the MyotonPRO by 2 assessors within one session and repeated by the main researcher after 30 min and again after 6 months. Receiver operating characteristic curves were constructed for all MyotonPRO outcomes to discriminate between participants with (n = 70) and without paratonia (n = 82). In the participants with paratonia, correlation coefficients were established between the MyotonPRO outcomes and the Modified Ashworth Scale for paratonia (MAS-P) and muscle palpation. In participants with paratonia, reliability (intraclass correlation coefficient) and agreement values (standard error of measurement and minimal detectable change) were established. Longitudinal outcome from participants with paratonia throughout the study (n = 48) was used to establish the sensitivity for change (correlation coefficient) and responsiveness (minimal clinical important difference). Results: Included were 152 participants with dementia (mean [standard deviation] age of 83.5 [98.2]). The area under the curve ranged from 0.60 to 0.67 indicating the MyotonPRO is able to differentiate between participants with and without paratonia. The MyotonPRO explained 10-18% of the MAS-P score and 8-14% of the palpation score. Interclass correlation coefficients for interrater reliability ranged from 0.57 to 0.75 and from 0.54 to 0.71 for intrarater. The best agreement values were found for tone, elasticity, and stiffness. The change between baseline and 6 months in the MyotonPRO outcomes explained 8-13% of the change in the MAS-P scores. The minimal clinically important difference values were all smaller than the measurement error. Conclusion: The MyotonPRO is potentially applicable for cross-sectional studies between groups of paratonia patients and appears less suitable to measure intraindividual changes in paratonia. Because of the inherent variability in movement resistance in paratonia, the outcomes from the MyotonPRO should be interpreted with care; therefore, future research should focus on additional guidelines to increase the clinical interpretation and improving reproducibility.

Download Full-text

Psychometric Analysis of an Ecological Vocal Effort Scale in Individuals With and Without Vocal Hyperfunction During Activities of Daily Living

American Journal of Speech-Language Pathology ◽

10.1044/2021_ajslp-21-00111 ◽

2021 ◽

pp. 1-16

Author(s):

Katherine L. Marks ◽

Alessandra Verdi ◽

Laura E. Toles ◽

Kaila L. Stipancic ◽

Andrew J. Ortiz ◽

...

Keyword(s):

Construct Validity ◽

Intraclass Correlation ◽

Muscle Tension ◽

Voice Rehabilitation ◽

Minimal Detectable Change ◽

Retest Reliability ◽

Vocal Hyperfunction ◽

Before And After ◽

Vocal Effort ◽

Test Retest Reliability

Objective The purpose of this study was to examine the psychometric properties of an ecological vocal effort scale linked to a voicing task. Method Thirty-eight patients with nodules, 18 patients with muscle tension dysphonia, and 45 vocally healthy control individuals participated in a week of ambulatory voice monitoring. A global vocal status question was asked hourly throughout the day. Participants produced a vowel–consonant–vowel syllable string and rated the vocal effort needed to produce the task on a visual analog scale. Test–retest reliability was calculated for a subset using the intraclass correlation coefficient, ICC(A, 1). Construct validity was assessed by (a) comparing the weeklong vocal effort ratings between the patient and control groups and (b) comparing weeklong vocal effort ratings before and after voice rehabilitation in a subset of 25 patients. Cohen's d, the standard error of measurement ( SEM ), and the minimal detectable change (MDC) assessed sensitivity. The minimal clinically important difference (MCID) assessed responsiveness. Results Test–retest reliability was excellent, ICC(A, 1) = .96. Weeklong mean effort was statistically higher in the patients than in controls ( d = 1.62) and lower after voice rehabilitation ( d = 1.75), supporting construct validity and sensitivity. SEM was 4.14, MDC was 11.47, and MCID was 9.74. Since the MCID was within the error of the measure, we must rely upon the MDC to detect real changes in ecological vocal effort. Conclusion The ecological vocal effort scale offers a reliable, valid, and sensitive method of monitoring vocal effort changes during the daily life of individuals with and without vocal hyperfunction.

Download Full-text

Reliability and responsiveness of incremental shuttle walk test to estimate exercise capacity in patients with pulmonary arterial hypertension

Comparative Exercise Physiology ◽

10.3920/cep190056 ◽

2020 ◽

Vol 16 (3) ◽

pp. 179-185

Author(s):

R. Ishrat ◽

A. Mujaddadi ◽

M.S. Ali ◽

D. Talwar ◽

M.E. Hussain

Keyword(s):

Pulmonary Arterial Hypertension ◽

Arterial Hypertension ◽

Exercise Capacity ◽

Intraclass Correlation ◽

World Health ◽

Minimal Detectable Change ◽

Walk Test ◽

Cross Sectional ◽

Suitable Alternative ◽

Pulmonary Arterial

The purpose of the present study was to evaluate the reliability and responsiveness of the incremental shuttle walk test (ISWT) to estimate exercise capacity in patients with pulmonary arterial hypertension (PAH). This was a cross-sectional longitudinal study performed on stable PAH patients (n=30, mean age ± standard deviation, 60±13.6 years) with World Health Organization functional class II & III. Reliability was assessed by comparing the distance covered between ISWT-1 (initial) and ISWT-2 (retest). Responsiveness was determined by comparing the distance covered in the ISWT-3 post pulmonary rehabilitation (PR) to the ISWT-1. The distance covered between ISWT-1 (177±87.85 m) and ISWT-2 (191.67±96.39 m) was not statistically significant. The result of the relative reliability has shown to be excellent with an intraclass correlation coefficient (ICC2,1 = 0.98, 95%CI = 0.95-0.99). Absolute reliability was evaluated through the standard error of the measurement and minimal detectable change at a 95% confidence interval (MDC95) were 12.29 and 33.9 m, respectively. Bland Altman plot showed good agreement between the two ISWTs. Following PR, the effect size (ES=0.78) and standardised response mean (SRM=1.50) were moderate and large respectively. ISWT is considered to be a reliable and responsive measure to estimate exercise capacity in patients with PAH. The ISWT may be considered a suitable alternative tool over a 6-min walk test and in the absence of equipment availability or expertise for conducting cardiopulmonary exercise test for the assessment of exercise capacity in these patients.

Download Full-text