Psychometric Properties of Working Memory Test for Cycle Two (Grades 5-7) of  Basic Education in Muscat Governorate in Oman

The study aimed to develop a test to measure working memory for students in grades 5-7 in Basic Education and examine its psychometric properties. The study aimed also to develop the required norm scores for score interpretation. The sample consisted of 300 male and female students from grades 5, 6 and 7 in Muscat governorate. The validity of the working memory test was examined through face validity, construct validity, predictive validity and concurrent validity. The results supported the validity of the test. Confirmatory factor analysis showed the fit of data to the factorial structure of the working memory. In addition, the test showed high predictive validity of student achievement for several subjects. The reliability of the test was examined using Cronbach alpha reliability and test-retest reliability. Cronbach Alpha reliability ranged between 0.62 and 0.86 for the three grades. Similarly, test-retest reliability was between 0.35 and 0.75. The norm scores were computed using standardized scores and percentile ranks for each of the three subtests within each grade.

Download Full-text

Psychometric properties of gross motor assessment tools for children: a systematic review

BMJ Open ◽

10.1136/bmjopen-2018-021734 ◽

2018 ◽

Vol 8 (10) ◽

pp. e021734 ◽

Cited By ~ 33

Author(s):

Alison Griffiths ◽

Rachel Toovey ◽

Prue E Morgan ◽

Alicia J Spittle

Keyword(s):

Psychometric Properties ◽

Predictive Validity ◽

Methodological Quality ◽

Clinical Utility ◽

Assessment Tools ◽

Motor Assessment ◽

Gross Motor ◽

Retest Reliability ◽

Validity Test ◽

Test Retest Reliability

ObjectiveGross motor assessment tools have a critical role in identifying, diagnosing and evaluating motor difficulties in childhood. The objective of this review was to systematically evaluate the psychometric properties and clinical utility of gross motor assessment tools for children aged 2–12 years.MethodA systematic search of MEDLINE, Embase, CINAHL and AMED was performed between May and July 2017. Methodological quality was assessed with the COnsensus-based Standards for the selection of health status Measurement INstruments checklist and an outcome measures rating form was used to evaluate reliability, validity and clinical utility of assessment tools.ResultsSeven assessment tools from 37 studies/manuals met the inclusion criteria: Bayley Scale of Infant and Toddler Development-III (Bayley-III), Bruininks-Oseretsky Test of Motor Proficiency-2 (BOT-2), Movement Assessment Battery for Children-2 (MABC-2), McCarron Assessment of Neuromuscular Development (MAND), Neurological Sensory Motor Developmental Assessment (NSMDA), Peabody Developmental Motor Scales-2 (PDMS-2) and Test of Gross Motor Development-2 (TGMD-2). Methodological quality varied from poor to excellent. Validity and internal consistency varied from fair to excellent (α=0.5–0.99). The Bayley-III, NSMDA and MABC-2 have evidence of predictive validity. Test–retest reliability is excellent in the BOT-2 (intraclass correlation coefficient (ICC)=0.80–0.99), PDMS-2 (ICC=0.97), MABC-2 (ICC=0.83–0.96) and TGMD-2 (ICC=0.81–0.92). TGMD-2 has the highest inter-rater (ICC=0.88–0.93) and intrarater reliability (ICC=0.92–0.99).ConclusionsThe majority of gross motor assessments for children have good-excellent validity. Test–retest reliability is highest in the BOT-2, MABC-2, PDMS-2 and TGMD-2. The Bayley-III has the best predictive validity at 2 years of age for later motor outcome. None of the assessment tools demonstrate good evaluative validity. Further research on evaluative gross motor assessment tools are urgently needed.

Download Full-text

The Development and Psychometric Properties of the Visuospatial Working Memory Assessment (VWMA) for Children

Occupational Therapy International ◽

10.1155/2020/8736308 ◽

2020 ◽

Vol 2020 ◽

pp. 1-10

Author(s):

Thitiya Wangkawan ◽

Cynthia Lai ◽

Peeraya Munkhetvit ◽

Trevor Yung ◽

Supaporn Chinchai

Keyword(s):

Working Memory ◽

Construct Validity ◽

Psychometric Properties ◽

Adhd Group ◽

Visuospatial Working Memory ◽

Normal Children ◽

Retest Reliability ◽

Memory Assessment ◽

Significant Difference ◽

Test Retest Reliability

The visuospatial working memory plays a crucial role in the occupational performance of children including daily living and academic achievement. Unfortunately, relevant visuospatial working memory tests in the occupational therapy setting are lacking. Therefore, it is of clinical interest to develop new assessment tools in this area. The present study is aimed at summarizing the development of the visuospatial working memory assessment (VWMA) and assessing its psychometric properties. The results revealed that the score of item-objective congruence index (IOC) was 1.0 in overall items of assessment. The Cronbach alpha test confirmed that the internal consistency of VWMA showed good reliability in both types of the assessment, with the total score of computerized tests being .88 and the tabletop tests being .81. The computerized test was found to have excellent test-retest reliability with intraclass correlation coefficient (ICC) values ranging from .88 to .99. The tabletop test was found to have a fair to good test-retest reliability with the ICC values ranging from .51 to .63. As regards construct validity, the results revealed that the tasks in the computerized test identified a significant difference between the control group, normal children, and children with attention deficit/hyperactivity disorder (ADHD) group. The exception to this was the N-back task in which the independent sample t-test of computerized test ranged from 1.61 to 6.23. The results of the tabletop test revealed a significant difference between normal children and the children in the ADHD group over all tasks in which the independent sample t-test ranged from 3.05 to 8.40. In conclusion, good psychometric properties established as regards content validity, internal consistency, test-retest reliability, and construct validity provide evidence to support the position that the new VWMA is appropriate for children.

Download Full-text

Psychometric properties of the Czech Integrated Palliative Outcome Scale: Reliability and content validity analysis

10.21203/rs.2.20850/v2 ◽

2020 ◽

Author(s):

Karolina Vlckova ◽

Eva Hoschlova ◽

Eva Chroustova ◽

Martin Loucka

Keyword(s):

Palliative Care ◽

Factor Analysis ◽

Psychometric Properties ◽

Exploratory Factor Analysis ◽

Internal Consistency ◽

Convergent Validity ◽

Intraclass Correlation ◽

Retest Reliability ◽

Cronbach Alpha ◽

Test Retest Reliability

Abstract Background: Outcome measurement is an essential part of the evaluation of palliative care and the measurements need to be reliable, valid and adapted to the culture in which they are used. The Integrated Palliative Outcome Scale (IPOS) is a widely used tool for assessing personal-level outcomes in palliative care. The aim of this study was to provide Czech version of IPOS and asses its psychometric properties. Methods: Patients receiving palliative care in hospice or hospitals completed the IPOS. The reliability of Czech IPOS was tested with Cronbach alpha (for internal consistency), the intraclass correlation coefficient for total IPOS score and weighted Kappa (for test-retest reliability of individual items). Factor analysis was used for elucidating the construct (Exploratory Factor Analysis). Convergent validity was tested with correlation analysis (Spearman correlation) in a part of the sample, who completed also the Edmonton Symptom Assessment System (ESAS) and the Palliative Performance Scale (PPS). Results: The sample consisted of 140 patients (mean age 72; 90 women; 81 % oncological disease). The Cronbach alpha was 0.789; intraclass correlation was 0.88. The correlations of IPOS with ESAS was R= 0.4 and PPS R= -0.2. Exploratory factor analysis revealed a 2-factor solution on our data. The first factor covers emotional and information needs and the second factor covers physical symptoms. Conclusion: Czech IPOS has very good reliability regarding both internal consistency and test-retest reliability. Together with an item analysis results, we can conclude that the Czech adaptation of the tool was successful. The convergent validity needs to be assessed on the larger sample and the proposed 2-factor internal structure of the questionnaire has to be confirmed by using CFA.

Download Full-text

Psychometric properties of the Czech Integrated Palliative Outcome Scale: Reliability and content validity analysis

10.21203/rs.2.20850/v3 ◽

2020 ◽

Author(s):

Karolina Vlckova ◽

Eva Hoschlova ◽

Eva Chroustova ◽

Martin Loucka

Keyword(s):

Palliative Care ◽

Factor Analysis ◽

Psychometric Properties ◽

Exploratory Factor Analysis ◽

Internal Consistency ◽

Convergent Validity ◽

Intraclass Correlation ◽

Retest Reliability ◽

Cronbach Alpha ◽

Test Retest Reliability

Download Full-text

Reliability and validity of the Persian version of 5-D itching scale among patients with chronic kidney disease

BMC Nephrology ◽

10.1186/s12882-020-02220-x ◽

2021 ◽

Vol 22 (1) ◽

Author(s):

Amin Kordi Yoosefinejad ◽

Fatemeh Karjalian ◽

Marzieh Momennasab ◽

Shahrokh Ezzatzadegan Jahromi

Keyword(s):

Chronic Kidney Disease ◽

Kidney Disease ◽

Psychometric Properties ◽

Internal Consistency ◽

Reliability And Validity ◽

Hemodialysis Patients ◽

Life Questionnaire ◽

Retest Reliability ◽

Persian Version ◽

Test Retest Reliability

Abstract Background Hemodialysis is considered a major therapeutic method for patients with chronic kidney disease. Pruritus is a common complaint of hemodialysis patients. The 5-D pruritus scale is amongst the most common tools to evaluate several dimensions of itch. Psychometric properties of the 5-D scale have not been evaluated in Persian speaking population with hemodialysis; hence, the objective of this study was to assess reliability and validity of the Persian version of the scale. Methods Ninety hemodialysis patients (men: 50, women: 40, mean age: 54.4 years) participated in this cross-sectional study. The final Persian version of 5-D scale was given to the participants. Tests Compared: One-third of the participants completed the scale twice within 3–7 days apart to evaluate test- retest reliability. Other psychometric properties including internal consistency, absolute reliability, convergent, discriminative and construct validity, floor/ceiling effects were also evaluated. Results The Persian 5-D scale has strong test-retest reliability (ICC= 0.98) and internal consistency (Cronbach’s alpha= 0.99). Standard error of measurement and minimal detectable change were 0.33 and 0.91, respectively. Regarding convergent validity, the scale had moderate correlation with numeric rating scale (r =0.67) and quality of life questionnaire related to itch (r = 0.59). Exploratory factor analysis revealed two factors within the scale. No floor or ceiling effect was found for the scale. Conclusion The Persian version of 5-D the itching scale is a brief instrument with acceptable reliability and validity. Therefore, the scale could be used by experts, nurses, and other health service providers to evaluate pruritus among Persian speaking hemodialysis patients.

Download Full-text

The design fluency test: a reliable and valid instrument for the assessment of game intelligence?

German Journal of Exercise and Sport Research ◽

10.1007/s12662-020-00697-0 ◽

2021 ◽

Author(s):

Thomas Finkenzeller ◽

Björn Krenn ◽

Sabine Würth ◽

Günter Amesberger

Keyword(s):

Psychometric Properties ◽

Team Sports ◽

Correlation Coefficients ◽

Soccer Players ◽

Scientific Instrument ◽

Retest Reliability ◽

Adolescent Students ◽

Design Fluency ◽

Test Retest Reliability ◽

Fluency Test

AbstractThe design fluency test (DFT) has been reported to predict successful sports performance of soccer players and has therefore been in the spotlight of sport psychology research. There is, however, a lack of research regarding the psychometric properties of the DFT in elite sports. Thus, the aim of this research was to provide findings of test–retest reliability, practice effects and the diagnostic power of the DFT. Multiple studies of youth and adult elite athletes, as well as nonathlete students, were conducted in applied settings. Test–retest relationship demonstrated poor to acceptable short-term and long-term correlations. Furthermore, significant changes between test and retest were obtained in some variables that differed among samples. The differential value of the DFT was corroborated by significant differences between adolescent students and adolescent elite soccer players. Regarding the prospective value, significant partial correlation coefficients were found between DFT scores and volleyball performance in adult elite players. Although our research partially confirmed previous findings on the differential and prospective power of the DFT, the findings on test–retest reliability indicate that the DFT cannot be recommended for application in sports. The psychometric properties—in particular the findings on test–retest reliability—of the DFT have to be improved before research can be carried out on the application for the selection of team sport athletes and for the prediction of future success in team sports. Further research is needed to develop a scientific instrument for the assessment of game intelligence.

Download Full-text

Psychometric properties of the critical thinking disposition assessment test amongst medical students in China: a cross-sectional study

BMC Medical Education ◽

10.1186/s12909-020-02437-2 ◽

2021 ◽

Vol 21 (1) ◽

Author(s):

Liyuan Cui ◽

Yaxin Zhu ◽

Jinglou Qu ◽

Liming Tie ◽

Ziqi Wang ◽

...

Keyword(s):

Factor Analysis ◽

Critical Thinking ◽

Medical Students ◽

Psychometric Properties ◽

Internal Consistency ◽

Discriminant Validity ◽

Retest Reliability ◽

Critical Thinking Disposition ◽

Thinking Disposition ◽

Test Retest Reliability

Abstract Background Critical thinking disposition helps medical students and professionals overcome the effects of personal values and beliefs when exercising clinical judgment. The lack of effective instruments to measure critical thinking disposition in medical students has become an obstacle for training and evaluating students in undergraduate programs in China. The aim of this study was to evaluate the psychometric properties of the CTDA test. Methods A total of 278 students participated in this study and responded to the CTDA test. Cronbach’s α coefficient, internal consistency, test-retest reliability, floor effects and ceiling effects were measured to assess the reliability of the questionnaire. Construct validity of the pre-specified three-domain structure of the CTDA was evaluated by explanatory factor analysis (EFA) and confirmatory factor analysis (CFA). The convergent validity and discriminant validity were also analyzed. Results Cronbach’s alpha coefficient for the entire questionnaire was calculated to be 0.92, all of the domains showed acceptable internal consistency (0.81–0.86), and the test-retest reliability indicated acceptable intra-class correlation coefficients (ICCs) (0.93, p < 0.01). The EFA and the CFA demonstrated that the three-domain model fitted the data adequately. The test showed satisfactory convergent and discriminant validity. Conclusions The CTDA is a reliable and valid questionnaire to evaluate the disposition of medical students towards critical thinking in China and can reasonably be applied in critical thinking programs and medical education research.

Download Full-text

Validity, reliability, and calibration of the physical activity unit 7 item screener (PAU-7S) at population scale

International Journal of Behavioral Nutrition and Physical Activity ◽

10.1186/s12966-021-01169-w ◽

2021 ◽

Vol 18 (1) ◽

Author(s):

Helmut Schröder ◽

Isaac Subirana ◽

Julia Wärnberg ◽

María Medrano ◽

Marcela González-Gross ◽

...

Keyword(s):

Physical Activity ◽

Predictive Validity ◽

Internal Consistency ◽

Regression Models ◽

Weighted Kappa ◽

Linear Regression Models ◽

Retest Reliability ◽

Activity Unit ◽

Test Retest Reliability ◽

Acceptable Internal Consistency

Abstract Background Validation of self-reported tools, such as physical activity (PA) questionnaires, is crucial. The aim of this study was to determine test-retest reliability, internal consistency, and the concurrent, construct, and predictive validity of the short semi-quantitative Physical Activity Unit 7 item Screener (PAU-7S), using accelerometry as the reference measurement. The effect of linear calibration on PAU-7S validity was tested. Methods A randomized sample of 321 healthy children aged 8–16 years (149 boys, 172 girls) from the nationwide representative PASOS study completed the PAU-7S before and after wearing an accelerometer for at least 7 consecutive days. Weight, height, and waist circumference were measured. Cronbach alpha was calculated for internal consistency. Test-retest reliability was determined by intra-class correlation (ICC). Concurrent validity was assessed by ICC and Spearman correlation coefficient between moderate to vigorous PA (MVPA) derived by the PAU-7S and by accelerometer. Concordance between both methods was analyzed by absolute agreement, weighted kappa, and Bland-Altman statistics. Multiple linear regression models were fitted for construct validity and predictive validity was determined by leave-one-out cross-validation. Results The PAU-7S overestimated MVPA by 18%, compared to accelerometers (106.5 ± 77.0 vs 95.2 ± 33.2 min/day, respectively). A Cronbach alpha of 0.76 showed an acceptable internal consistency of the PAU-7S. Test-retest reliability was good (ICC 0.71 p < 0.001). Spearman correlation and ICC coefficients of MVPA derived by the PAU-7S and accelerometers increased from 0.31 to 0.62 and 0.20 to 0.62, respectively, after calibration of the PAU-7S. Between-methods concordance improved from a weighted kappa of 0.24 to 0.50 after calibration. A slight reduction in ICC, from 0.62 to 0.60, yielded good predictive validity. Multiple linear regression models showed an inverse association of MVPA with standardized body mass index (β − 0.162; p < 0.077) and waist to height ratio (β − 0.010; p < 0.014). All validity dimensions were somewhat stronger in boys compared to girls. Conclusion The PAU-7S shows a good test-retest reliability and acceptable internal consistency. All dimensions of validity increased from poor/fair to moderate/good after calibration. The PAU-7S is a valid instrument for measuring MVPA in children and adolescents. Trial registration Trial registration numberISRCTN34251612.

Download Full-text

Psychometric properties of the short form of the Stroke Impact Scale in German-speaking stroke survivors

Health and Quality of Life Outcomes ◽

10.1186/s12955-021-01826-5 ◽

2021 ◽

Vol 19 (1) ◽

Author(s):

Anna Coppers ◽

Jens Carsten Möller ◽

Detlef Marks

Keyword(s):

Factor Analysis ◽

Psychometric Properties ◽

Short Form ◽

Trial Registration ◽

Cognitive Domain ◽

Retest Reliability ◽

Stroke Impact Scale ◽

Impact Scale ◽

German Speaking ◽

Test Retest Reliability

Abstract Background The short form of the Stroke Impact Scale (SF-SIS) consists of eight questions and provides an overall index of health-related quality of life after stroke. The goal of the study was the evaluation of construct validity, reliability and responsiveness of the SF-SIS for the use in German-speaking stroke patients in rehabilitation. Methods The SF-SIS, the Stroke Impact Scale 2.0 (SIS 2.0), EQ-5D-5L, National Institutes of Health Stroke Scale (NIHSS) and de Morton Mobility Index were assessed in 150 inpatients after stroke, with a second measurement two weeks later for the analyses of responsiveness. In 55 participants, the test–retest-reliability was assessed one week after the first measurement. The study was designed following the recommendations of the COSMIN initiative. Results The correlations of the SF-SIS with the SIS 2.0 (ρ = 0.90), as well as the EQ-5D-5L (ρ = 0.79) were high, as expected. There was adequate discriminatory ability of the SF-SIS index between patients who were less and more severely affected by stroke, as assessed by the NIHSS. Exploratory factor analysis indicated a two-factor structure of the SF-SIS explaining 59.9% of the total variance, providing better model fit in the confirmatory factor analysis than the one-factorial structure. Analyses of test–retest-reliability showed an intraclass correlation coefficient of 0.88 (95% CI 0.75–0.94). Hypotheses concerning responsiveness were not confirmed due to lower correlations between the assessments change scores. Conclusion Results of this analysis of the SF-SIS’s psychometric properties are matching with the validity analysis of the English original version, confirming the high correlations with the Stroke Impact Scale and the EQ-5D-5L. Examination of structural validity did not confirm the presumed unidimensionality of the scale and found evidence of an underlying two-factor solution with a physical and cognitive domain. Sufficient test–retest reliability and internal consistency were found. In addition, this study provides first results for the responsiveness of the German version. Trial registration The study was registered at the German Clinical Trials Register. Trial registration number: DRKS00011933, date of registration: 07.04.2017

Download Full-text

The Brief International Cognitive Assessment in Multiple Sclerosis (BICAMS): Validation in Arabic and Lebanese Normative Values

Journal of the International Neuropsychological Society ◽

10.1017/s1355617721000102 ◽

2021 ◽

pp. 1-10

Author(s):

Hala Darwish ◽

Pia Zeinoun ◽

Natali Farran ◽

Husam Ghusn ◽

Bassem Yamout ◽

...

Keyword(s):

Multiple Sclerosis ◽

Psychometric Properties ◽

Cognitive Assessment ◽

Healthy Subjects ◽

Good Evidence ◽

Normative Values ◽

Arabic Version ◽

Retest Reliability ◽

Test Retest Reliability ◽

Healthy Participants

Abstract Objective: Multiple sclerosis (MS) is often associated with cognitive deficits. Accurate evaluation of the MS patients’ cognitive performance is essential for diagnosis and treatment recommendation. The Brief International Cognitive Assessment in Multiple Sclerosis (BICAMS), widely used cognitive testing battery, examines processing speed, verbal and visuospatial learning, and memory. Our study aims to examine the psychometric properties of an Arabic version of the BICAMS and to provide normative values in a Lebanese sample. Method: The BICAMS, comprised of the Symbol Digit Modalities Test (SDMT), Brief Visuospatial Memory Test-Revised (BVMT-R), and a newly developed verbal learning/memory test, the Verbal Memory Arabic Test (VMAT), were administered on healthy subjects and MS patients. The sample consisted of 180 healthy individuals, of whom 63 were retested after 2–3 weeks. Forty-three MS patients matched with 43 healthy subjects based on age, sex, and years of education were assessed. A sample of 10 MS patients was also examined on two occasions. Test–retest reliability and criterion-related validity were examined, and regression-based norms were derived. Results: The test–retest correlations showed good evidence of reliability with coefficients ranging between 0.64 and 0.73 in the healthy sample, and between 0.43 and 0.92 in the MS sample. The BICAMS was able to discriminate between MS patients and matched healthy participants on the SDMT and BVMT-R. Normative data were comparable to other studies. Conclusions: This new Arabic version of the BICAMS shows initial good psychometric properties. While good evidence of VMAT’s reliability was shown in the healthy participants, less test–retest reliability in this tool was seen in the MS group, and partial criterion-related validity was evident. This renders further examination of the VMAT. We provide regression-based norms for a Lebanese sample and encourage the use of this battery in both research and clinical settings.

Download Full-text