Beyond Programming: A Computer-Based Assessment of Computational Thinking Competency

Computational Thinking (CT ), entailing both domain-general and domain-specific skills, is a competency fundamental to computing education and beyond. However, as a cross-domain competency, appropriate assessment design and method remain equivocal. Indeed, the majority of the existing assessments have a predominant focus on measuring programming proficiency and neglecting other contexts in which CT can also be manifested. To broaden the promotion and practice of CT, it is necessary to integrate diverse problem types and item formats using a competency-based assessment method to measure CT. Taking a psychometric approach, this article evaluates a novel computer-based assessment of CT competency, Computational Thinking Challenge. The assessment was administered to 119 British upper secondary school students ( M = 16.11; SD = 1.19) with a range of prior programming experiences. Results from several reliability analyses, a convergent validity analysis, and a Rasch analysis, provided evidence to support the quality of the assessment. Taken together, the study demonstrated the feasibility to expand from traditional assessment methods to integrating multiple contexts, problem types, and item formats in measuring CT competency in a comprehensive manner.

The Chinese Assessment of physical literacy: Based on Grounded Theory Paradigm for children in grades 3-6

The aim of this study is to construct and validate “physical literacy self-assessment questionnaire” (PLAQ) for Chinese students in grades 3-6. This study uses qualitative and quantitative methods to construct evaluation indicators of PL and determine the weights of each indicator. The 60 items of original PLAQ was based on literature review and interviews, and administered to 1179 primary students graded 3-6 in China. Exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) are used to optimize the structure and verify the reliability and validity of the questionnaire. The model of PLAQ is composed of 4 first-level indicators, 10 second-level indicators and 35 third-level indicators. The results of EFA and CFA resulted in a 44-items, 4-factor questionnaire. EFA item loadings ranged from 0.558 to 0.896, and Cronbach's alpha ranged from 0.818 to 0.892. The results of CFA show that the constructed model fits well, and PLAQ has good convergent validity and discriminative validity. The PLAQ appeared to be reliable and valid that can be used as an assessment tool for students in grades 3-6. PLAQ can be used as a guide for the development of PL. Additionally, PLAQ gives us a shared understanding about what PL is and how it can be developed by Chinese children. However, studies on the accuracy and generalizability of the PLAQ should be conducted to improve it in the future.

Characterizing Individual Differences in Sweet Taste Hedonics: Test Methods, Locations, and Stimuli

Sweetness drives the consumption of added sugars, so understanding how to best measure sweet hedonics is important for developing strategies to lower sugar intake. However, methods to assess hedonic response to sweetness vary, making results across studies difficult to integrate. We compared methods to measure optimal sucrose concentration in 21 healthy adults (1) using paired-comparison preference tracking vs. ratings of liking, (2) with participants in the laboratory vs. at home, and (3) using aqueous solutions vs. vanilla milk. Tests were replicated on separate days to assess test-retest reliability. Test-retest reliability was similar between laboratory and home testing, but tended to be better for vanilla milk and preference tracking. Optimal sucrose concentration was virtually identical between laboratory and home, slightly lower when estimated via preference tracking, and about 50% lower in vanilla milk. However, optimal sucrose concentration correlated strongly between methods, locations, and stimuli. More than 50% of the variability in optimal sucrose concentration could be attributed to consistent differences among individuals, while much less variability was attributable to differences between methods. These results demonstrate convergent validity between methods, support testing at home, and suggest that aqueous solutions can be useful proxies for some commonly consumed beverages for measuring individual differences.

Sibling Bullying in Turkish Adolescents: Translation and Cross-Cultural Validation of the Sibling Bullying Questionnaire

The primary aim of this study was to translate the Sibling Bullying Questionnaire (SBQ) into Turkish and validate it. A secondary aim was to estimate the prevalence of sibling bullying in Turkish adolescents. The SBQ was translated by a team of English-Turkish bilinguals. Self-report data were collected from Turkish adolescents (N = 301) aged 10 to 18 years old (mean age = 14.25 years, SD = 2.46). Confirmatory factor analysis (CFA) was used to confirm the factor structure of the newly translated Turkish SBQ (T-SBQ). Descriptive analyses were then conducted to report the characteristics of the sample and the prevalence of sibling bullying. CFA confirmed the original two-factor structure of the T-SBQ indicating that a first-order correlated two-factor model shows the best fit: x2=160.33 (p < 0.001), df = 61, RMSEA = 0.07, CFI = 0.95 and TLI = 0.93. The T-SBQ showed satisfactory levels of internal consistency in victimisation (α = 0.84) and perpetration (α = 0.83) subscales, excellent reliability in the overall test scale (α = 0.90), and a high level of convergent validity when compared with the Revised Sibling Bullying Questionnaire (α = 0.79). In terms of sibling bullying prevalence, approximately half of the adolescents (51%) reported having been involved in some form of sibling bullying in the preceding six months, either as pure-victim (18%), pure-bully (3%) or bully-victim (30%). This result aligns with the findings from other countries such as the United States (41%), Israel (51%), and the United Kingdom (49%). The T-SBQ is valid and reliable in measuring sibling bullying in Turkish adolescents and sibling bullying is prevalent in the lives of Turkish adolescents.

Validity of a single-item indicator of treatment side effect bother in a diverse sample of cancer patients

Purpose With higher efficacy of cancer therapies, the numbers and types of side effects experienced by patients have also increased, evidencing a need for brief assessments of side effect bother. The Functional Assessment of Cancer Therapy-General (FACT-G) includes the item “I am bothered by side effects of treatment” (GP5). This study aimed to confirm GP5’s validity in a large, diverse, real-world patient sample. Methods Real-world data were drawn from 10 Adelphi Disease Specific Programmes (DSP™) conducted between 2015 and 2019 in France, Germany, Italy, Spain, the UK and the USA, covering 10 cancer sites. We examined correlations between GP5 responses and varied measures of patient-reported global health and the number of side effects experienced. We explored whether more advanced patients and those with worse Eastern Cooperative Oncology Group Performance Status Rating (ECOG PSR) reported greater side effect bother. Finally, we conducted differential item functioning (DIF) assessment using the Mantel–Haenszel approach. Results The sample included 6755 advanced cancer patients. GP5 responses were distributed similarly across most cancer sites. A moderate, negative correlation (rpolyserial = − 0.43) between GP5 responses and global health evidenced convergent validity. Known groups validity was evidenced by dichotomised distributions of GP5, showing expected results between cancer stage 2 vs. 3 and 4 and with ECOG PSR (p < 0.001). Little evidence of DIF was found. Conclusion GP5 exhibited evidence of validity across cancer sites and countries and appeared to measure the same construct across these countries. GP5 has significant promise as a summary indicator of side effect bother.

Factor Structure and Internal Consistency on a Reduced Version of the Revised Test of Need for Cognitive Closure

The need for cognitive closure is a construct postulated by Kruglanski that explains the motivational aspects which influence decision-making and its impact on the social environment. Initially, it was assessed through a unidimensional scale, later criticized for its poor satisfactory reliability and validity. Regarding these criticisms, Pierro and Kruglanski developed a new 14-item scale to measure two dimensions, which were not previously evaluated: urgency tendency and permanence tendency. Although the Revised Test of Need for Cognitive Closure is more economical in terms of assessment time, it would be optimal to develop a reduced test that can assess faster while maintaining validity and reliability. The present research aims to reduce the Revised Test of Need for Cognitive Closure scale to the Argentinian context. To this end, we worked on a non-experimental design, assessing this scale within a sample of 690 Argentinian university students (Women = 81.16%, Men = 18.84%), and proceeded to perform reliability, as well as confirmatory factor analysis, convergent validity, and factorial invariance analysis. The results indicate a bi-factorial structure of a Need for Cognitive Closure instrument with eight items and two dimensions: urgency tendency (α = 0.76) and permanence tendency (α = 0.64), suggesting good reliability in both of them. In addition, well convergent validity was checked with other validated instruments, and finally, the factor loadings were shown to be invariant. In conclusion, it was demonstrated the reliability and validity of reducing the Revised Test of Need for Cognitive Closure in our social environment.

Measuring personal recovery in a low-intensity community mental healthcare setting: validation of the Dutch version of the individual recovery outcomes counter (I.ROC)

Background Measuring progress in treatment is essential for systematic evaluation by service users and their care providers. In low-intensity community mental healthcare, a questionnaire to measure progress in treatment should be aimed at personal recovery and should require little effort to complete. Methods The Individual Recovery Outcome Counter (I.ROC) was translated from English into Dutch, and psychometric evaluations were performed. Data were collected on personal recovery (Recovery Assessment Scale), quality of life (Manchester Short Assessment of Quality of Life), and symptoms of mental illness and social functioning (Outcome Questionnaire, OQ-45) for assessing the validity of the I.ROC. Test–retest reliability was evaluated by calculating the Intraclass Correlation Coefficient and internal consistency was evaluated by calculating Cronbach’s alpha. Exploratory factor analysis was performed to determine construct validity. To assess convergent validity, the I.ROC was compared to relevant questionnaires by calculating Pearson correlation coefficients. To evaluate discriminant validity, I.ROC scores of certain subgroups were compared using either a t-test or analysis of variance. Results There were 764 participants in this study who mostly completed more than one I.ROC (total n = 2,863). The I.ROC aimed to measure the concept of personal recovery as a whole, which was confirmed by a factor analysis. The test–retest reliability was satisfactory (Intraclass Correlation Coefficient is 0.856), as were the internal consistency (Cronbachs Alpha is 0.921) and the convergent validity. Sensitivity to change was small, but comparable to that of the OQ-45. Conclusions The Dutch version of the I.ROC appears to have satisfactory psychometric properties to warrant its use in daily practice. Discriminant validity and sensitivity to change need further research.

Examining the Factor Structure of a Risk Assessment Inventory in Young Offenders: FER-R, Risk and Resource Assessment Form

The FER-R, Risk and Resource Assessment Form, is a multidimensional inventory of structured professional judgment that assesses criminogenic risks and resources for the design and management of individualized intervention plans with criminally sanctioned adolescents. The aim of this study was to examine the psychometric properties of the FER-R, reviewing its factorial structure to contribute evidence of convergent and discriminant construct validity in a sample of adolescents sentenced for crimes in Chile. For each domain (risks and resources) with its respective facets, a unidimensional bifactor structure (CFA-BF) was obtained, with adequate indices of fit that confirmed its construct validity, while the convergent validity was demonstrated with the YLS/CMI and the divergent validity with two MACI scales. The FER-R adds factorial validity to the evidence of the previously reported predictive validity, making it a robust inventory for the evaluation of young offenders, and a relevant tool to manage differentiated interventions in Chile, with a high potential for use in Latin America. The importance of finding a suitable balance in assessing risks and protective factors is discussed, in order to manage interventions adjusted to the needs of the adolescents to promote their criminal desistance.

The Depression Anxiety Stress Scale 8: Its Psychometric Evaluation Among Women with Chronic Non-Cancer Pelvic Pain

Psychiatric comorbidity and abusive experiences in chronic pelvic pain (CPP) conditions may prolong disease course. This study investigated the psychometrics of the Depression Anxiety Stress Scale 8 (DASS-8) among women with CPP (N = 214, mean age = 33.3 ± 12.4 years). The DASS-8 expressed excellent fit, invariance across age groups and menopausal status, good discriminant validity (differentiating women with psychiatric comorbidity from those without comorbidity: U = 2018.0, p = 0.001), excellent reliability (alpha = 0.90), adequate predictive and convergent validity indicated by strong correlation with the DASS-21 (r = 0.94) and high values of item-total correlations (r = 0.884 to 0.893). In two-step cluster analysis, it classified women into low and high distress clusters (n = 141 and 73), with significantly higher levels of distress, pain severity and duration, and physical symptoms in cluster 2. The DASS-8 correlated with pain severity/duration, depression/anxiety symptoms, sexual assault, fatigue, headache severity, and physical symptoms at the same level expressed by the parent scale, or even greater. Accordingly, distress may represent a target for early identification of psychiatric comorbidity, CPP severity, sexual assault, fatigue, etc. Therefore, the DASS-8 is a useful brief measure of mental symptoms among women with CPP.