Interactive Assessments of CT (IACT): Digital Interactive Logic Puzzles to Assess Computational Thinking in Grades 3–8

Background and Context: The Inclusive Assessment of Computational Thinking (CT) designed for accessibility and learner variability was studied in over 50 classes in US schools (grades 3-8). Objective: The validation studies of IACT sampled thousands of students to establish IACT’s construct and concurrent validity as well as test-retest reliability. Method: IACT items for each CT practice were correlated to examine construct validity. The CT pre-measures were correlated with post-measures to examine test-retest reliability. The CT post-measures were correlated with external measures to examine concurrent validity. Findings: IACT studies showed moderate evidence of test-retest reliability and concurrent validity and low to moderate evidence of construct validity for an aggregated measure of CT, but weaker validity and reliability evidence for individual CT practices. These findings were similar for students with and without IEPs or 504s. Implications: IACT is the first CT tool for grades 3-8 that has been validated in a large-scale study among students with and without IEPs or 504s. While improvements are needed for stronger validity, it is a promising start.

Download Full-text

Criterion validity and reliability of the International Physical Activity Questionnaire – Hungarian short form against the RM42 accelerometer

BMC Public Health ◽

10.1186/s12889-021-10372-0 ◽

2021 ◽

Vol 21 (S1) ◽

Author(s):

Pongrác Ács ◽

Réka Veress ◽

Paulo Rocha ◽

Tamás Dóczi ◽

Bence László Raposa ◽

...

Keyword(s):

Physical Activity ◽

Concurrent Validity ◽

International Physical Activity Questionnaire ◽

Short Form ◽

Sitting Time ◽

Validity And Reliability ◽

Retest Reliability ◽

Physical Activity Questionnaire ◽

Test Retest Reliability ◽

Activity Questionnaire

Abstract Background Physical inactivity is a global phenomenon in European welfare countries. Proper monitoring is essential to measure the physical activity level of the population. Methods In the Hungarian cohort of the European Physical Activity and Sport Monitoring System (EUPASMOS) project, our participants (N = 598) completed sociodemographic questions and the International Physical Activity Questionnaire – short form (IPAQ-SF) survey. The validity and reliability of the subjective measurement tool were examined, IPAQ-SF outcomes were contrasted against triaxial RM42 accelerometer wore for 7 consecutive days. Results The IPAQ-SF showed moderate internal consistency (Cronbach Alpha = 0.647). The concurrent validity of the IPAQ-SF to triaxial accelerometer indicated a significant weak-to-moderate correlation (R = 0.111–0.338, p = 0.042; p < 0.001). The test-retest reliability showed a significant correlation between two measurements (R = 0.788–0.981, p < 0.001). Conclusion The Hungarian version of the IPAQ-SF had excellent test-retest reliability, but low-to-fair concurrent validity for moderate and vigorous physical activity, walking and sitting time, as compared to the objective criterion measure among Hungarian adults.

Download Full-text

Validity and Reliability of Gifted Rating Scales-School Form in Sample of Teachers and Parents – A Czech Contribution

Journal of Psychoeducational Assessment ◽

10.1177/0734282920970718 ◽

2020 ◽

pp. 073428292097071

Author(s):

Michal Jabůrek ◽

Adam Ťápal ◽

Šárka Portešová ◽

Steven I. Pfeiffer

Keyword(s):

Factor Structure ◽

Concurrent Validity ◽

Rating Scales ◽

Teacher Rating ◽

Halo Effect ◽

Validity And Reliability ◽

Retest Reliability ◽

Alternative Models ◽

Teachers And Parents ◽

Test Retest Reliability

The factor structure, the concurrent validity, and test–retest reliability of the Czech translation of the Gifted Rating Scales-School Form [GRS-S; Pfeiffer, S. I., & Jarosewich, T. (2003). GRS (gifted rating scales) - manual. Pearson] were evaluated. Ten alternative models were tested. Four models were found to exhibit acceptable fit and interpretability. The factor structure was comparable for both parent ( n = 277) and teacher raters ( n = 137). High correlations between the factors suggest that raters might be subject to a halo effect. Ratings made by teachers show a closer relationship with criteria (WJ IE II COG, CFT 20-R, and TIM3–5) than ratings made by parents. Test–retest reliability of teacher rating (with median 93 days) was quite high for all GRS-S subscales ( r = .84–.87).

Download Full-text

Gait Asymmetry Post-Stroke: Determining Valid and Reliable Methods Using a Single Accelerometer Located on the Trunk

Sensors ◽

10.3390/s20010037 ◽

2019 ◽

Vol 20 (1) ◽

pp. 37 ◽

Cited By ~ 5

Author(s):

Christopher Buckley ◽

M. Encarna Micó-Amigo ◽

Michael Dunne-Willows ◽

Alan Godfrey ◽

Aodhán Hickey ◽

...

Keyword(s):

Concurrent Validity ◽

Intraclass Correlation ◽

Future Research ◽

Validity And Reliability ◽

Gait Symmetry ◽

Retest Reliability ◽

Post Stroke ◽

Gait Asymmetry ◽

Test Retest Reliability ◽

Cardinal Symptom

Asymmetry is a cardinal symptom of gait post-stroke that is targeted during rehabilitation. Technological developments have allowed accelerometers to be a feasible tool to provide digital gait variables. Many acceleration-derived variables are proposed to measure gait asymmetry. Despite a need for accurate calculation, no consensus exists for what is the most valid and reliable variable. Using an instrumented walkway (GaitRite) as the reference standard, this study compared the validity and reliability of multiple acceleration-derived asymmetry variables. Twenty-five post-stroke participants performed repeated walks over GaitRite whilst wearing a tri-axial accelerometer (Axivity AX3) on their lower back, on two occasions, one week apart. Harmonic ratio, autocorrelation, gait symmetry index, phase plots, acceleration, and jerk root mean square were calculated from the acceleration signals. Test–retest reliability was calculated, and concurrent validity was estimated by comparison with GaitRite. The strongest concurrent validity was obtained from step regularity from the vertical signal, which also recorded excellent test–retest reliability (Spearman’s rank correlation coefficients (rho) = 0.87 and Intraclass correlation coefficient (ICC21) = 0.98, respectively). Future research should test the responsiveness of this and other step asymmetry variables to quantify change during recovery and the effect of rehabilitative interventions for consideration as digital biomarkers to quantify gait asymmetry.

Download Full-text

Concurrent Validity and Reliability of My Jump 2 App for Measuring Vertical Jump Height in Recreationally Active Adults

Applied Sciences ◽

10.3390/app10113805 ◽

2020 ◽

Vol 10 (11) ◽

pp. 3805 ◽

Cited By ~ 1

Author(s):

Špela Bogataj ◽

Maja Pajek ◽

Slobodan Andrašić ◽

Nebojša Trajković

Keyword(s):

Concurrent Validity ◽

Female Athletes ◽

Vertical Jump ◽

Intraclass Correlation ◽

Jump Height ◽

Validity And Reliability ◽

Retest Reliability ◽

Study Results ◽

Test Retest Reliability ◽

Active Adults

This study aimed to examine the reliability, validity, and usefulness of the smartphone-based application, My Jump 2, against Optojump in recreationally active adults. Participants (18 women, 28.9 ± 5.6 years, and 26 men, 30.1 ± 10.6 years) completed squat jumps (SJ), counter-movement jumps (CMJ), and CMJ with arm swing (CMJAS) on Optojump and were simultaneously recorded using My Jump 2. To evaluate concurrent validity, jump height, calculated from flight time attained from each device, was compared for each jump type. Test-retest reliability was determined by replicating data analysis of My Jump 2 recordings on two occasions separated by two weeks. High test-retest reliability (Intraclass correlation coefficient (ICC) > 0.93) was observed for all measures in both male and female athletes. Very large correlations were observed between the My Jump 2 app and Optojump for SJ (r = 0.95, p = 0.001), CMJ (r = 0.98, p = 0.001), and CMJAS (r = 0.98, p = 0.001) in male athletes. Similar results were obtained for female recreational athletes for all jumps (r > 0.94, p = 0.001). The study results suggest that My Jump 2 is a valid, reliable, and useful tool for measuring vertical jump in recreationally active adults. Therefore, due to its simplicity and practicality, it can be used by practitioners, coaches, and recreationally-active adults to measure vertical jump performance with a simple test as SJ, CMJ, and CMJAS.

Download Full-text

Addicted to Exercise

European Journal of Psychological Assessment ◽

10.1027/1015-5759/a000084 ◽

2012 ◽

Vol 28 (1) ◽

pp. 3-10 ◽

Cited By ~ 9

Author(s):

Irini S. Parastatidou ◽

Georgios Doganis ◽

Yannis Theodorakis ◽

Symeon P. Vlachopoulos

Keyword(s):

Internal Consistency ◽

Concurrent Validity ◽

Discriminant Validity ◽

Factor Model ◽

Validity And Reliability ◽

Retest Reliability ◽

Confirmatory Factor ◽

Initial Support ◽

Dependence Scale ◽

Test Retest Reliability

The study examines the factor structure, internal consistency, concurrent and discriminant validity, and test-retest reliability of the Exercise Dependence Scale-Revised scores (EDS-R: Symons-Downs, Hausenblas, & Niggs, 2004 ) in a sample of Greek exercise participants. The Greek translation of the EDS-R was completed by 581 exercise participants along with measures of exercise addiction. Confirmatory factor analysis provided support for the hypothesized EDS-R correlated 7-factor model along with evidence for strong item loadings and factor discriminant validity. Further evidence emerged in favor of the internal consistency, concurrent validity, and test-retest reliability of the translated EDS-R scores. The results provide initial support for various aspects of the validity and reliability of the translated-into-Greek EDS-R scores.

Download Full-text

Validity, reliability and viability of pre-school educators’ use of early years toolbox early numeracy

Australasian Journal of Early Childhood ◽

10.1177/18369391211061188 ◽

2021 ◽

pp. 183693912110611

Author(s):

Steven J Howard ◽

Cathrine Neilsen-Hewett ◽

Marc de Rosnay ◽

Edward C Melhuish ◽

Kellie Buckley-Walker

Keyword(s):

Construct Validity ◽

Internal Consistency ◽

Concurrent Validity ◽

Early Years ◽

Validity And Reliability ◽

Early Numeracy ◽

Potential Approach ◽

Preschool Educators ◽

Learning Development ◽

Test Retest Reliability

There is need and opportunity for assessments that support quick and playful – yet also accurate, rigorous and developmentally sensitive – appraisals of early numeracy. Ideally, these should be accessible to those who have opportunity to support children’s learning development and ultimately shift children’s trajectories. The iPad-based Early Years Toolbox (EYT) Early Numeracy assessment was developed and evaluated to determine its validity and reliability, and appropriateness of use by researchers and preschool educators. Results from two studies with 246 children aged 3–5 years indicated the following: construct validity and internal consistency, concurrent validity with established measures, developmental sensitivity, test–retest reliability and highly comparable results whether used by a researcher or an educator. This yields a brief and playful assessment of early numeracy and a potential approach to develop broad-use early years assessments.

Download Full-text

Cross-Cultural Adaptation, Validity, and Reliability of the Patient-Rated Michigan Hand Outcomes Questionnaire for Thai Patients

Occupational Therapy International ◽

10.1155/2018/8319875 ◽

2018 ◽

Vol 2018 ◽

pp. 1-6 ◽

Cited By ~ 1

Author(s):

Jananya P. Dhippayom ◽

Piyawat Trevittaya ◽

Andy S. K. Cheng

Keyword(s):

Construct Validity ◽

Internal Consistency ◽

Cultural Adaptation ◽

Content Validity ◽

Cross Cultural ◽

Validity And Reliability ◽

Retest Reliability ◽

Cross Cultural Adaptation ◽

Limb Injuries ◽

Test Retest Reliability

Introduction. The Michigan Hand Outcomes Questionnaire (MHQ) is a patient-rated hand outcome instrument. It is widely used in orthopedic and neurological conditions of the hands and upper limbs. To gain more knowledge on hand outcomes from a Thai patient perspective, an MHQ-Thai version is required. Purpose of the Study. The study is aimed at translating and cross-culturally adapting the MHQ into Thai and at examining the validity and reliability of the translated version. Methods. The Beaton protocol for cross-cultural adaptation of self-reported measures was used in the translation process. Three occupational therapists were asked to assess content validity while 30 participants were asked to fill in the questionnaire in order to assess construct validity, internal consistency, and test-retest reliability. Results. All six domains of the MHQ were translated into Thai without any major problems. However, items related to the characteristics of the patients were adapted to suit the Thai context. The MHQ-Thai version had good content validity (IOC 0.972). The construct validity revealed a low-to-high correlation between every subscale of the MHQ-Thai version. The intraclass correlation coefficient (ICC) of the test-retest reliability for the six domains ranged from 0.788 to 0.956, with excellent correlation (ICC = 0.953) for the total score. Cronbach’s alpha was 0.835 for the total score of the MHQ-Thai version, indicating good internal consistency. Discussion and Conclusions. MHQ was successfully cross-culturally adapted into Thai. The MHQ-Thai version is a valid and reliable instrument for evaluating the self-perception of Thai people who have hand and upper limb injuries.

Download Full-text

Reliability and Validity of the Ohwaki-Kohs Tactile Block Design Test for the Blind

Psychological Reports ◽

10.2466/pr0.1986.58.2.375 ◽

1986 ◽

Vol 58 (2) ◽

pp. 375-380 ◽

Cited By ~ 6

Author(s):

Handré J. Brand ◽

Marietha J. Pieterse ◽

Michèle Frost

Keyword(s):

Construct Validity ◽

Internal Consistency ◽

Block Design ◽

Reliability And Validity ◽

Validity And Reliability ◽

Retest Reliability ◽

Blind Children ◽

Test Retest Reliability ◽

Age Range

The Ohwaki-Kohs Tactile Block Design Test for the Blind was administered to 147 white blind children, 91 boys and 56 girls with an age range of 5 to 19 yr., for the purpose of ascertaining the validity and reliability of the test. The test satisfied certain basic requirements with regard to test-retest reliability, internal consistency, and construct validity.

Download Full-text

Validation of the Stanford Brief Activity Survey: Examining Psychological Factors and Physical Activity Levels in Older Adults

Journal of Physical Activity and Health ◽

10.1123/jpah.7.1.87 ◽

2010 ◽

Vol 7 (1) ◽

pp. 87-94 ◽

Cited By ~ 46

Author(s):

Ruth E. Taylor-Piliae ◽

Joan M. Fair ◽

William L. Haskell ◽

Ann N. Varady ◽

Carlos Iribarren ◽

...

Keyword(s):

Physical Activity ◽

Older Adults ◽

Construct Validity ◽

Psychological Health ◽

Well Being ◽

Education Level ◽

Validity And Reliability ◽

Retest Reliability ◽

Test Retest Reliability ◽

Activity Survey

Background:This study examined the construct validity and reliability of the new 2-item Stanford Brief Activity Survey (SBAS).Methods:Secondary analysis was conducted using data collected from the healthy older controls (n = 1023) enrolled in the Atherosclerotic Disease Vascular Function and Genetic Epidemiology (ADVANCE) study. Construct validity was examined by regression analyses to evaluate significant trends (P ≤ .05) across the SBAS activity categories for the selected psychological health factors measured at baseline and year 2, adjusted for gender, ethnicity and education level. Test-retest reliability was performed using Spearman’s rank correlation.Results:At baseline, subjects were 66 ± 2.8 years old, 38% female, 77% married, 61% retired, 24% college graduate, and 68% Caucasian. At baseline, lower self-reported stress, anxiety, depression, and cynical distrust, and higher self-reported mental and physical well-being were significantly associated with higher levels of physical activity (p trend ≤ 0.01). These associations held at year 2. The test-retest reliability of the SBAS was statistically significant (rs= 0.62, P < .001).Conclusion:These results provide evidence of the construct validity and reliability of the SBAS in older adults. We also found a strong dose-response relationship between regular physical activity and psychological health in older adults, independent of gender, education level and ethnicity.

Download Full-text

A Short Version of the Physical Activity Enjoyment Scale: Development and Psychometric Properties

International Journal of Environmental Research and Public Health ◽

10.3390/ijerph182111035 ◽

2021 ◽

Vol 18 (21) ◽

pp. 11035

Author(s):

Cheng Chen ◽

Susanne Weyland ◽

Julian Fritsch ◽

Alexander Woll ◽

Claudia Niessner ◽

...

Keyword(s):

Physical Activity ◽

Factor Analysis ◽

Construct Validity ◽

Psychometric Properties ◽

Internal Consistency ◽

Concurrent Validity ◽

Retest Reliability ◽

Confirmatory Factor ◽

Test Retest Reliability ◽

Activity Enjoyment

Objective: The purposes of this paper were to (a) develop a new short, theory-driven, version of the physical activity enjoyment scale (PACES-S) using content analysis; and (b) subsequently to measure the psychometric properties (construct validity, internal consistency, test–retest reliability, and concurrent validity) of the PACES-S for adolescents. Methods: Six experts used a four-point Likert scale to assess the content validity of each of the 16 items of the physical activity enjoyment scale according to a provided definition of physical activity enjoyment. Based on the results, exploratory factor analysis was used to analyze survey data from a longitudinal study of 182 individuals (Measure 1 of Study 1: 15.75 ± 3.39 yrs; 56.6% boys, 43.4% girls), and confirmatory factor analysis (Measure 2 of Study 1: 15.69 ± 3.44 yrs; 56.3% boys, 43.7% girls) was used to analyze the survey data from a cross-sectional study of 3219 individuals (Study 2; 15.99 ± 3.10 yrs; 47.8% boys, 52.2% girls) to assess the construct validity of the new measure. To assess the reliability, test–retest reliability was assessed in Study 1 and internal consistency in Study 1 and 2. For the concurrent validity, correlations with self-reported and device-based physical activity behavior were assessed in both studies. Results: Four out of sixteen items were selected for PACES-S. Exploratory factor analysis and confirmatory factor analyses identified and supported its factorial validity (χ2 = 53.62, df = 2, p < 0.001; RMSEA = 0.073; CFI = 0.99; RFI = 0.96; NFI = 0.99; TLI = 0.96; IFI = 0.99). Results showed good test–retest reliability (r = 0.76) and internal consistency (a = 0.82 to 0.88). Regarding concurrent validity, the results showed positive correlations with a physical activity questionnaire (Study 1: r = 0.36), with a physical activity diary (Study 1: r = 0.44), and with accelerometer-recorded data (Study 1: r = 0.32; Study 2: r = 0.21). Conclusions: The results indicate that PACES-S is a reliable and valid instrument that may be particularly useful to measure physical activity enjoyment in large-scale studies. It shows comparable measurement properties as the long version of PACES.

Download Full-text