Interrater Reliability and Internal Consistency of the Just Write! Functional Handwriting Assessment

2021 ◽  
Vol 75 (Supplement_2) ◽  
pp. 7512500059p1-7512500059p1
Author(s):  
Tiffany Bolton ◽  
Brittney Stevenson ◽  
William Janes
Keyword(s):  
Internal Consistency ◽  
Interrater Reliability ◽  
Quantitative Measure ◽  
Preschool Age ◽  
Age Group ◽  
General Lack ◽  
Primary Author

Abstract Date Presented Accepted for AOTA INSPIRE 2021 but unable to be presented due to online event limitations. The requirements for handwriting performance continue to increase for children entering kindergarten. There is a general lack of consensus on a quantitative measure of handwriting specifically in the preschool age group. The Just Write! is a tool written by the researchers to measure functional handwriting and shows promising results in the initial standardization phase. Primary Author and Speaker: Tiffany Bolton Additional Authors and Speakers: Brittney Stevenson, William Janes

scholarly journals The Family Psychoeducation Fidelity Scale: Psychometric Properties

2020 ◽  
Vol 47 (6) ◽  
pp. 894-900 ◽  
Author(s):  
I. Joa ◽  
J. O. Johannessen ◽  
K. S. Heiervang ◽  
A. A. Sviland ◽  
H. A. Nordin ◽  
...  
Keyword(s):  
Psychometric Properties ◽  
Internal Consistency ◽  
Interrater Reliability ◽  
Review Process ◽  
Trial Registration ◽  
Family Psychoeducation ◽  
Time Points ◽  
The Family ◽  
Fidelity Scale

Abstract This study examined psychometric properties and feasibility of the Family Psychoeducation (FPE) Fidelity Scale. Fidelity assessors conducted reviews using the FPE fidelity scale four times over 18 months at five sites in Norway. After completing fidelity reviews, assessors rated feasibility of the fidelity review process. The FPE fidelity scale showed excellent interrater reliability (.99), interrater item agreement (88%), and internal consistency (mean = .84 across four time points). By the 18-month follow-up, all five sites increased fidelity and three reached adequate fidelity. Fidelity assessors rated feasibility as excellent. The FPE fidelity scale has good psychometric properties and is feasible for evaluating the implementation of FPE programs. Trial registration ClinicalTrials.gov Identifier: NCT03271242.

The Head Control Scale: Interrater Reliability Among Therapy Students

2021 ◽  
Vol 75 (Supplement_2) ◽  
pp. 7512500012p1-7512500012p1
Author(s):  
Amy Armstrong-Heimsoth ◽  
Rachel Reed ◽  
Samantha Grant ◽  
Jodi Thomas ◽  
Roy St. Laurent
Keyword(s):  
Physical Therapy ◽  
Interrater Reliability ◽  
Kappa Coefficient ◽  
Control Scale ◽  
Head Control ◽  
Primary Author ◽  
Strong Agreement

Abstract Date Presented 04/13/21 This study assesses reliability and accuracy of the Head Control Scale (HCS) when used by inexperienced raters. Physical therapy and OT students used the HCS to rate five videotaped pediatric subjects. The kappa coefficient for interrater reliability among students was "almost perfect" (>.80). In one subscale, when comparing student raters with clinicians, there was strong agreement in grading between each group. The HCS may be consistently used by both new and experienced raters. Primary Author and Speaker: Amy Armstrong-Heimsoth Additional Authors and Speakers: Emily Mei Chun, Elizabeth Diane Hesse, Kelsey E. Ranneklev, and Camila E. Sanchez

Interrater Reliability of a Novel Goniometric Technique to Measure Scapular Protraction and Retraction

2021 ◽  
Vol 75 (Supplement_2) ◽  
pp. 7512500032p1-7512500032p1
Author(s):  
Nathan Short ◽  
Michelle Mays ◽  
Abigail Baist ◽  
Anthony Clifton ◽  
Adam Horty ◽  
...  
Keyword(s):  
Standard Error ◽  
Interrater Reliability ◽  
Reliable Method ◽  
Occupational Performance ◽  
Motor Component ◽  
Healthy Sample ◽  
Primary Author

Abstract Date Presented Accepted for AOTA INSPIRE 2021 but unable to be presented due to online event limitations. This study describes the interrater reliability of a novel goniometric technique to measure scapular protraction and retraction. Measurements obtained by two experienced OTs demonstrated a standard error of measure of less than 4 degrees using this technique on a healthy sample of adults (N = 80). This technique may offer a more reliable method to assess scapular mobility as an essential motor component of occupational performance. Primary Author and Speaker: Nathan Short Additional Authors and Speakers: Michelle Mays, Abigail Baist, Anthony Clifton, Adam Horty, Micaela Kosty, Courtney Olson, and Riddhi Patel Contributing Authors: Thomas Almonreoder

scholarly journals Reliability of Physiological Responses Induced by Basic Emotions: A Pilot Study

2019 ◽  
Vol 38 (1) ◽  
Author(s):  
Eun-Hye Jang ◽  
Sangwon Byun ◽  
Mi-Sook Park ◽  
Jin-Hun Sohn
Keyword(s):  
Internal Consistency ◽  
Interrater Reliability ◽  
Physiological Responses ◽  
Skin Conductance Level ◽  
Intraclass Correlation ◽  
Repeated Measurements ◽  
Physiological Signals ◽  
Basic Emotions ◽  
Reliability Indices ◽  
Film Clips

Abstract Background Although emotion-specific autonomic responses based on the discrete theory of emotion have been widely studied, studies on the reliability of physiological responses to emotional stimuli are limited. In this study, we aimed to assess the reliability of physiological changes induced by the six basic emotions (happiness, sadness, anger, fear, disgust, and surprise) that were measured during 10 weekly repeated experiments. Methods Twelve college students participated, and in each experiment, physiological signals were collected before and while participants were watching emotion-provoking film clips. Additionally, the participants self-evaluated the emotions that they experienced during the film presentation at the end of each emotional stimulus. To avoid adaptation of participants to identical stimuli during repeated measurements, we used 10 different film clips for each emotion, and thus a total of 60 film clips over 10 weeks were used. Physiological features, such as skin conductance level (SCL), fingertip temperature (FT), heart rate (HR), and blood volume pulse (BVP), were extracted from the physiological signals. Two reliability indices, Cronbach’s alpha and intraclass correlation coefficient, were calculated from the physiological features to assess internal consistency and interrater reliability, respectively. Results We found that SCL, HR, and BVP measured during the emotion-provoking phase over the 10 weekly sessions were more reliable than those assessed at baseline. Furthermore, SCL, HR, and BVP from the emotion-provoking phase exhibited excellent internal consistency and interrater reliability. Conclusions Our findings suggest that these features can be used as reliable physiological indices in emotion studies. The results also support the significance of physiological signals as meaningful indicators for emotion recognition in HCI (human computer interface) area.

scholarly journals Validation of an Evidence-Based Medicine Critically Appraised Topic Presentation Evaluation Tool (EBM C-PET)

2013 ◽  
Vol 5 (2) ◽  
pp. 252-256 ◽  
Author(s):  
Hans B. Kersten ◽  
John G. Frohna ◽  
Erin L. Giudice
Keyword(s):  
Internal Consistency ◽  
Evidence Based Medicine ◽  
Interrater Reliability ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Evidence Based ◽  
Evaluation Tool ◽  
Intraclass Correlation Coefficients ◽  
Excellent Internal Consistency ◽  
Based Medicine

Abstract Background Competence in evidence-based medicine (EBM) is an important clinical skill. Pediatrics residents are expected to acquire competence in EBM during their education, yet few validated tools exist to assess residents' EBM skills. Objective We sought to develop a reliable tool to evaluate residents' EBM skills in the critical appraisal of a research article, the development of a written EBM critically appraised topic (CAT) synopsis, and a presentation of the findings to colleagues. Methods Instrument development used a modified Delphi technique. We defined the skills to be assessed while reviewing (1) a written CAT synopsis and (2) a resident's EBM presentation. We defined skill levels for each item using the Dreyfus and Dreyfus model of skill development and created behavioral anchors using a frame-of-reference training technique to describe performance for each skill level. We evaluated the assessment instrument's psychometric properties, including internal consistency and interrater reliability. Results The EBM Critically Appraised Topic Presentation Evaluation Tool (EBM C-PET) is composed of 14 items that assess residents' EBM and global presentation skills. Resident presentations (N  =  27) and the corresponding written CAT synopses were evaluated using the EBM C-PET. The EBM C-PET had excellent internal consistency (Cronbach α  =  0.94). Intraclass correlation coefficients were used to assess interrater reliability. Intraclass correlation coefficients for individual items ranged from 0.31 to 0.74; the average intraclass correlation coefficients for the 14 items was 0.67. Conclusions We identified essential components of an assessment tool for an EBM CAT synopsis and presentation with excellent internal consistency and a good level of interrater reliability across 3 different institutions. The EBM C-PET is a reliable tool to document resident competence in higher-level EBM skills.

scholarly journals Internal Consistency Reliability of the Francis Scale of Attitude toward Alcohol among Adolescents in Northern Ireland

2005 ◽  
Vol 97 (1) ◽  
pp. 321-324 ◽  
Author(s):  
Michael Fearn ◽  
Christopher Alan Lewis ◽  
Leslie J. Francis
Keyword(s):  
Northern Ireland ◽  
Internal Consistency ◽  
Internal Consistency Reliability ◽  
Age Group ◽  
Data Support ◽  
Francis Scale

The Francis Scale of Attitude toward Alcohol was completed by 324 adolescents ( M=17.1 yr., SD = 3.6) in Northern Ireland to examine reliability of the measure among this age group. These data support its internal consistency (.89) and suggest that the Francis Scale of Attitude toward Alcohol is psychometrically appropriate for use among this age group.

Sign in / Sign up

Export Citation Format

Share Document