scholarly journals Remote Assessment of Pediatric Patients with Daytime Sleepiness and Healthy Controls: A Pilot Study of Feasibility and Reliability

2021 ◽  
Vol 8 ◽  
pp. 2329048X2110480
Author(s):  
Jennifer Worhach ◽  
Madeline Boduch ◽  
Bo Zhang ◽  
Kiran Maski
Keyword(s):  
Pilot Study ◽  
Daytime Sleepiness ◽  
Block Design ◽  
Intraclass Correlation ◽  
Cognitive Testing ◽  
Design Matrix ◽  
Healthy Controls ◽  
Good Reliability ◽  
Testing Conditions ◽  
Matrix Reasoning

We assessed the reliability of cognitive testing for children and adolescents ages 8 to 19 years of age with narcolepsy or subjective daytime sleepiness compared to healthy controls. Forty-six participants took part in the study ( n = 18 narcolepsy type 1, n = 6 subjective daytime sleepiness, and n = 22 healthy controls). Participants completed verbal (vocabulary testing) and non-verbal intelligence quotient (IQ) tasks (block design, matrix reasoning) from the Wechsler Abbreviated Scale of Intelligence- Second Edition (WASI-II) in-person or remotely through a HIPAA compliant telehealth platform with conditions counterbalanced. We found that vocabulary T-scores showed good reliability with intraclass correlation coefficient (ICC) of 0.76 (95% CI: 0.64, 0.85) between remote and in-person testing conditions. Matrix Reasoning T-scores showed moderate reliability (ICC 0.69, 95% CI: 0.68, 0.90) and Block Design T-scores was poor between testing conditions. Overall, the results of this pilot study support the feasibility and reliability of verbal and non-verbal IQ scores collected by telehealth.

scholarly journals Remote Assessment of Cognition in Kids and Adolescents with Daytime Sleepiness: A pilot study of feasibility and reliability

2021 ◽  
Author(s):  
Jennifer Worhach ◽  
Madeline Boduch ◽  
Bo Zhang ◽  
Kiran Maski
Keyword(s):  
Pilot Study ◽  
Daytime Sleepiness ◽  
Block Design ◽  
Intraclass Correlation ◽  
Design Matrix ◽  
Healthy Controls ◽  
Verbal Iq ◽  
Testing Conditions ◽  
Iq Scores ◽  
Matrix Reasoning

In this pilot study, we assessed the reliability of cognitive testing for kids and adolescents ages 8-19 years of age with narcolepsy or subjective daytime sleepiness compared to healthy controls. Forty-six participants took part in the study (n=18 with narcolepsy type 1, n=6 with subjective daytime sleepiness, and n= 22 healthy controls recruited from the community). Participants completed verbal (vocabulary testing) and non-verbal intelligence quotient (IQ) tasks (block design, matrix reasoning) from the Weschler Abbreviated Scale of Intelligence- Second Edition (WASI-II) in-person or remotely in their home through a HIPAA compliant telehealth web platform with conditions counterbalanced. We found that vocabulary T-scores showed good reliability with intraclass correlation coefficient (ICC) of 0.76 (95% CI: 0.64, 0.85) between remote and in-person testing conditions. Matrix Reasoning T-scores showed moderate reliability ( ICC 0.69, 95% CI: 0.68, 0.90) and Block Design T-scores was poor between testing conditions. Bland-Altman plots showed outliers on vocabulary and matrix reasoning tasks performed better on remote assessments. Overall, the results of this pilot study support the feasibility and reliability of verbal and non-verbal IQ scores collected by telehealth. Use of telehealth to collect verbal and non-verbal IQ scores may offer a means to acquire cognitive data for pediatric sleep research through the COVID-19 pandemic and beyond.

scholarly journals EXCELLENT RELIABILITY OF SEMI-QUANTITATIVE NAILFOLD CAPILLAROSCOPY IN PATIENTS WITH SYSTEMIC SCLEROSIS – A PILOT STUDY

2016 ◽  
Vol 25 (4) ◽  
pp. 194-198
Author(s):  
Ana Maria Gheorghiu ◽  
◽  
Raida Oneata ◽  
Mihai Bojinca ◽  
Rucsandra Dobrota ◽  
...  
Keyword(s):  
Systemic Sclerosis ◽  
Pilot Study ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Nailfold Capillaroscopy ◽  
Qualitative Assessment ◽  
Rater Agreement ◽  
Quality Of Data ◽  
Good Test ◽  
Good Reliability

Background. Semi-quantitative nailfold capillaroscopy (NFC) scoring represents a promising tool for assessing disease activity, severity and change in systemic sclerosis (SSc), however there is no consensus yet over which capillaroscopy abnormalities should be analyzed and how. Objective. Investigation of the reliability of the qualitative and semi-quantitative scoring of NFC assessment between two raters and test-retest for each rater in a SSc cohort. Methods. This is a single-center pilot study where 2 raters assessed the NFC images of 48 consecutive patients with SSc. Data were analyzed in 3 ways: 1. qualitatively by “normal”/“abnormal” category; 2. qualitatively by the following categories: “early”, “active”, “late” SSc patterns, “normal”, and unclassifiable in any pattern, and step; 3. Semi-quantitatively by calculating the mean score for capillary loss, disorganization of the microvascular array, giant capillaries, microhaemorrhages and capillary ramifications and combinations of giant capillaries and microhaemorrhages (as a surrogate for vascular activity). Disorganization and ramifications (surrogate for vascular damage) were also assessed. Variables for all steps were calculated for all fingers and for each finger. Inter-rater/intra-rater agreement was assessed by Cohen’s kappa coefficients for qualitative variables and by intraclass correlation coefficients (ICC) for mean score values of abnormalities. Results. Inter-rater reliability ranged from good to excellent agreement for mean score values of abnormalities in all fingers (ICC coefficients 0.745 to 0.897) and was excellent for activity (ICC coefficient of 0.923) and damage combinations (ICC coefficient of 0.918). Assessment of abnormalities in a qualitative manner (normal/abnormal or with capillaroscopy patterns) showed weaker inter-rater agreement than the semi-quantitative assessment (k coefficient <0.7). Intra-rater variability was good to excellent for mean score values of abnormalities and activity and damage combinations in all fingers and separate fingers for both raters; for qualitative assessment, only one of the raters had good test-retest reliability. Conclusion. Reliability of NFC assessment is essential in SSc trials/clinical practice to ensure quality of data. This pilot study demonstrates very good reliability between raters of the semi-quantitative NFC assessment in a SSc cohort. Combinations of NFC abnormalities had very good reliability and might be preferred because they are less time consuming.

scholarly journals Comparison of a tridimensional cephalometric analysis performed on 3T-MRI compared with CBCT: a pilot study in adults

2019 ◽  
Vol 20 (1) ◽  
Author(s):  
Cinzia Maspero ◽  
Andrea Abate ◽  
Francesca Bellincioni ◽  
Davide Cavagnetto ◽  
Valentina Lanteri ◽  
...  
Keyword(s):  
Pilot Study ◽  
Radiation Exposure ◽  
Intraclass Correlation ◽  
Maxillofacial Surgery ◽  
Three Dimensional ◽  
Small Sample ◽  
Cephalometric Analysis ◽  
Good Reliability ◽  
3T Mri ◽  
Similar Range

Abstract Objective Since the introduction of cone-beam computed tomography (CBCT) in dentistry, this technology has enabled distortion-free three-dimensional cephalometric analysis for orthodontic and orthognathic surgery diagnosis. However, CBCT is associated with significantly higher radiation exposure than traditional routine bidimensional examinations for orthodontic diagnosis, although low-dose protocols have markedly reduced radiation exposure over time. The objective of this preliminary feasibility study is to compare the accuracy and diagnostic capabilities of an already-validated three-dimensional cephalometric analysis on CBCT to those of an analysis on 3-T magnetic resonance imaging (3T-MRI) to assess whether the latter can deliver a comparable quality of information while avoiding radiation exposure. Materials and methods In order to test the feasibility of three-dimensional cephalometry on 3T-MRI, 18 subjects (4 male; 14 female) with mean age 37.8 ± SD 10.2, who had undergone both maxillofacial CBCT and maxillofacial 3T-MRI for various purposes within 1 month, were selected from the archive of the Department of Dentistry and Maxillofacial Surgery of Fondazione Ospedale Policlinico Maggiore, IRCCS, Milano, Italy. A three-dimensional cephalometric analysis composed of ten midsagittal and four bilateral landmarks and 24 measurements (11 angular, 13 linear) was performed on both scans using Mimics Research® v. 17.0 (NV, Technologielaan 15, 3001 Leuven, Belgium). Cephalometric analysis was performed twice by two independent orthodontists for each scan, and each orthodontist repeated the measurements 3 weeks later. Statistical analysis was performed with SPSS® 20.00 for Windows (IBM® Corporation, Sommers, NY, USA). A Bland-Altman test for each cephalometric value was performed to assess the agreement between the procedures. The intraclass correlation coefficient (ICC) was used to assess interobserver and intraobserver reliability. The coefficient of variation was used to evaluate precision. Results Both procedures showed good reliability, with mean intraobserver ICCs of 0.977/0.971 for CBCT and 0.881/0.912 for MRI. The average interobserver ICCs were 0.965 for CBCT and 0.833 for MRI. A Bland-Altman analysis for the cephalometric tracing revealed a similar range of agreement between the two modalities; the bias range (mean ± SD) was − 0.25–0.66 mm (0.174 ± 0.31) for distances and − 0.41–0.54° (0.12 ± 0.33) for angles. Conclusions Within the main limitation of this pilot study, that is, the small sample, it is possible to state that cephalometric measurements on 3T-MRI seem to possess adequate reliability and repeatability and that they show satisfying agreement with values measured on CBCTs. An MRI examination does not expose patients to ionizing radiation and could provide an alternative to CBCT for three-dimensional cephalometrics in the future.

Assessing Early Childhood Fluid Reasoning in Low- and Middle-Income Nations: Validity of the Wechsler Preschool and Primary Scale of Intelligence Across Seven MAL-ED Sites

2019 ◽  
Vol 38 (2) ◽  
pp. 256-262 ◽  
Author(s):  
Linda Ruan-Iu ◽  
Laura L. Pendergast ◽  
Muneera Rasheed ◽  
Fahmida Tofail ◽  
Erling Svensen ◽  
...  
Keyword(s):  
Block Design ◽  
Design Matrix ◽  
Enteric Disease ◽  
Middle Income ◽  
Primary Scale ◽  
Fluid Reasoning ◽  
Picture Completion ◽  
Multiple Indicator ◽  
Mimic Modeling ◽  
Matrix Reasoning

An adapted version of the Wechsler Preschool and Primary Scale of Intelligence—Third Edition (WPPSI-III) was administered to assess cognitive functioning among 1,253 5-year-old children from the Malnutrition and Enteric Disease (MAL-ED) study—an international, multisite study investigating multiple aspects of child development. In this study, the factor structure and invariance of the WPPSI-III were examined across seven international research sites located in Bangladesh, Brazil, India, Nepal, Pakistan, South Africa, and Tanzania. Using a multiple indicator multiple cause (MIMIC) modeling approach, the findings supported the validity of a fluid reasoning dimension (comprised of block design, matrix reasoning, and picture completion subscales) across each of the seven sites, although the scores were noninvariant. Accordingly, these scores are recommended for research purposes and understanding relationships between variables but not for mean comparisons or clinical purposes.

scholarly journals Influence of chronotype on daily mood fluctuations: pilot study in patients with depression

BJPsych Open ◽  
2020 ◽  
Vol 6 (2) ◽  
Author(s):  
Konstantin F. Brückmann ◽  
Jürgen Hennig ◽  
Matthias J. Müller ◽  
Stanislava Fockenberg ◽  
Anne-Marthe Schmidt ◽  
...  
Keyword(s):  
Clinical Trials ◽  
Pilot Study ◽  
Negative Affect ◽  
Clinical Setting ◽  
Early Morning ◽  
Healthy Controls ◽  
Patient Subgroup ◽  
Depression Risk ◽  
Gender And Age ◽  
The Relationship

Summary Depression risk is associated with a late chronotype pattern often described as an ‘evening chronotype’. Fluctuations in mood over consecutive days have not yet been measured according to chronotype in in-patients with depression. A total of 30 in-patients with depression and 32 healthy controls matched for gender and age completed a chronotype questionnaire and twice-daily ratings on mood for 10 consecutive days (registered in the German Clinical Trials Register: DRKS00010215). The in-patients had Saturdays and Sundays as hospital-leave days. The relationship between chronotype and daily mood was mediated by the weekday–weekend schedule with higher levels of negative affect in the evening-chronotype patient subgroup at weekends. Results are discussed with respect to a probably advantageous standardised clinical setting with early morning routines, especially for patients with evening chronotypes.

scholarly journals Piloting the Play Cycle Observation Method in ‘real time’: Recording children’s Play Cycles in pre-school provision

2020 ◽  
pp. 1476718X2096985
Author(s):  
Pete King ◽  
LaDonna Atkins ◽  
Brandon Burr
Keyword(s):  
Pilot Study ◽  
Real Time ◽  
School Setting ◽  
Early Years ◽  
Good Reliability ◽  
Rater Reliability ◽  
Children's Play ◽  
Observational Tool ◽  
Observation Method ◽  
And Training

The Play Cycle Observation Method (PCOM) is an observational tool developed to focus on the process of play and has shown good reliability when watching videos of children playing. This study piloted use of the PCOM in ‘real time’ in a pre-school setting where 3-year-old children play. The results from two independent observers not familiar with the concept of the Play Cycle or the PCOM found good inter-rater reliability using Cohen Kappa (k) when observing play cues to form play cycles, as well as observing play cues within established play cycles. In addition, the recording of the nature of the play cues and play returns, the play frame and how the play cycle finishes (annihilation) were shown to be consistent between the two inter-rater observers. The results of this pilot study indicate the PCOM can be used as an observational tool to record the process of play by both students and practitioners working in a range of contexts including playwork, childcare, early years and statutory education. The PCOM can also be used as a teaching and training aid for trainers and lecturers.

scholarly journals Eccentric Force-Velocity Characteristics during a Novel Squat Protocol in Trained Rugby Union Athletes—Pilot Study

2021 ◽  
Vol 6 (2) ◽  
pp. 32
Author(s):  
Conor McNeill ◽  
C. Martyn Beaven ◽  
Daniel T. McMaster ◽  
Nicholas Gill
Keyword(s):  
Pilot Study ◽  
Dynamic Performance ◽  
Intraclass Correlation ◽  
Rugby Union ◽  
Mean Velocity ◽  
Force Development ◽  
Back Squat ◽  
Force Velocity ◽  
Force Time ◽  
Change In Mean

Eccentric strength characteristics have been shown to be important factors in physical performance. Many eccentric tests have been performed in isolation or with supramaximal loading. The purpose of this study was to investigate within- and between- session reliability of an incremental eccentric back squat protocol. Force plates and a linear position transducer captured force-time-displacement data across six loading conditions, separated by at least seven days. The reliability of eccentric specific measurements was assessed using coefficient of variation (CV), change in mean, and intraclass correlation coefficient (ICC). Eccentric peak force demonstrated good ICC (≥0.82) and TE (≤7.3%) for each load. Variables based on mean data were generally less reliable (e.g., mean rate of force development, mean force, mean velocity). This novel protocol meets acceptable levels of reliability for different eccentric-specific measurements although the extent to which these variables affect dynamic performance requires further research.

scholarly journals Psychometric assessment of the PROMIS Fatigue Short Form 6a in women with moderate-to-severe endometriosis-associated pain

2020 ◽  
Vol 4 (1) ◽  
Author(s):  
Robin Pokrzywinski ◽  
Ahmed M. Soliman ◽  
Eric Surrey ◽  
Michael C. Snabes ◽  
Karin S. Coyne
Keyword(s):  
Internal Consistency ◽  
Short Form ◽  
Intraclass Correlation ◽  
Change Score ◽  
Reproductive Age ◽  
Phase Iii ◽  
Controlled Clinical Trial ◽  
Double Blind ◽  
Good Reliability ◽  
Global Impression Of Change

Abstract Background Endometriosis is a common problem in women of reproductive age and has impacts on health-related quality of life and productivity. Fatigue is an important part of the burden of endometriosis, it is not often included as an endpoint in clinical trials. Objectives The study assessed the psychometric properties of the PROMIS Fatigue Short Form 6a in women with moderate-to-severe endometriosis-associated pain. Methods In a phase III double-blind, placebo-controlled clinical trial (NCT01620528), women aged 18–49 years with moderate-to-severe endometriosis-related pain were randomized to elagolix 150 mg once daily, elagolix 200 mg twice daily, or placebo for 6 months. PROMIS Fatigue and dysmenorrhea and non-menstrual pelvic pain (NMPP) scores were assessed at baseline and months 1, 3, and 6, and Patient Global Impression of Change (PGIC) was assessed at months 1, 3, and 6. Reliability (internal consistency and test-retest reliability), construct validity (convergent and known groups validity), and responsiveness were evaluated. Results The analysis included 871 women, mean age 31.5 years. Internal consistency supported a single concept (Cronbach’s alpha 0.93). For the 238 patients with no change in PGIC at month 1, the intraclass correlation coefficient for the PROMIS Fatigue T-score was 0.7 and paired t-test statistically significant (2.84, p = 0.0049). Correlations with other measures were expected to be fairly low as concepts were not redundant. The PROMIS Fatigue discriminated among known groups with mean scores of 55.3, 62.3, and 65.8 at month 3 (PGIC improvement, no change, worsening, respectively). Statically significant discrimination, and change score responsiveness, were seen using clinically relevant anchors (dysmenorrhea and NMPP) at months 3 and 6 between responders and non-responders. Anchor-based (PGIC) responsiveness showed significant improvement from baseline to months 3 and 6 (p < 0.0001). Conclusions PROMIS Fatigue has good reliability, validity, and responsiveness in women with moderate-to-severe endometriosis-associated pain.

A new visual feedback-based system for the assessment of pinch force, endurance, accuracy and precision. A test-retest reliability study

Hand Therapy ◽  
2021 ◽  
pp. 175899832110025
Author(s):  
Alberto Dottor ◽  
Eleonora Camerone ◽  
Mirko Job ◽  
Diletta Barbiani ◽  
Elisa Frisaldi ◽  
...  
Keyword(s):  
Visual Feedback ◽  
Intraclass Correlation ◽  
Precision Grip ◽  
Voluntary Contraction ◽  
Good Reliability ◽  
Retest Reliability ◽  
Relative Reliability ◽  
Time Accuracy ◽  
In The Beginning ◽  
Test Retest Reliability

Introduction Given that pinch is a precision grip involved in sustained submaximal activities, a Sustained Contraction (SC) task could be associated to Maximal Voluntary Contraction (MVC). To better evaluate the thumb-index system, the test-retest reliability of pinch MVC and SC, measured by a visual feedback-based pinch gauge was assessed. Methods 26 healthy participants performed MVC and SC in two separate sessions. SC required to maintain 40%MVC as long as possible and it was evaluated in terms of time, accuracy (Mean Distance between force trace and target force, MD), precision (Coefficient of Variability of force trace, CV). MD and CV analyses were conducted dividing the SC task into three equivalent time stages (beginning, middle, exhaustion). Relative Reliability (RR) was measured by Intraclass Correlation Coefficient, and Absolute Reliability (AR) was measured by Standard Error of Measurement and by Bland-Altman plot. Results MVC and Time showed high RR and AR in both hands. RR of MD and CV in right hand was excellent in the beginning and middle stages, and fair in the exhaustion one, showing decreasing reliability as fatigue increases. In the left hand RR of MD and CV was generally lower. MD showed excellent reliability in the beginning stage and good reliability in the other stages. CV showed fair relative reliability at both beginning and middle stages, excellent in the last one. Conversely, it was observed high AR of MD and CV in all stages in both hands. Conclusions All indices are reliable to assess motor control of thumb-index pinch in both hands.

scholarly journals Reliability and Change in Erosion Measurements by High-Resolution peripheral Quantitative Computed Tomography in a Longitudinal Dataset of Rheumatoid Arthritis Patients

2020 ◽  
pp. jrheum.191391 ◽  
Author(s):  
Stephanie Finzel ◽  
Sarah L. Manske ◽  
Cheryl Barnabe ◽  
Andrew J. Burghardt ◽  
Hubert Marotte ◽  
...  
Keyword(s):  
Rheumatoid Arthritis ◽  
Computed Tomography ◽  
High Resolution ◽  
Intraclass Correlation ◽  
Quantitative Computed Tomography ◽  
Correlation Coefficients ◽  
Peripheral Quantitative Computed Tomography ◽  
Good Reliability ◽  
Change Over Time ◽  
Over Time

Objective The aim of this multi-reader exercise was to assess the reliability and change over time of erosion measurements in rheumatoid arthritis (RA) patients using high-resolution peripheral quantitative computed tomography (HR-pQCT). Methods HR-pQCT scans of 23 patients with RA were assessed at baseline and 12 months. Four experienced readers examined the dorsal, palmar, radial, and ulnar surfaces of the metacarpal head (MH) and phalangeal base (PB) of the 2nd and 3rd digits, blinded to time order. In total, 368 surfaces (23 patients x16 surfaces) were evaluated per time point to characterize cortical breaks as pathological (erosion) or physiological, and to quantify erosion width and depth. Reliability was evaluated by intraclass correlation coefficients (ICC), percentage agreement, and Light’s kappa; change over time was defined by means ± SD of erosion numbers and dimensions. Results ICCs for the mean measurements of width and depth of the pathological breaks ranged between 0.819 - 0.883, and 0.771 - 0.907 respectively. Most physiological cortical breaks were found at the palmar PB, whereas most pathological cortical breaks were located at the radial MH. There was a significant increase in both the numbers and the dimensions of erosions between baseline and follow-up (p=0.0001 for erosion numbers, width, and depth in axial plane, and p=0.001 for depth in perpendicular plane). Conclusion This exercise confirmed good reliability of HR-pQCT erosion measurements and their ability to detect change over time.

Sign in / Sign up

Export Citation Format

Share Document