scholarly journals Beyond Programming: A Computer-Based Assessment of Computational Thinking Competency

2022 ◽  
Vol 22 (2) ◽  
pp. 1-27
Author(s):  
Rina P. Y. Lai
Keyword(s):  
Convergent Validity ◽  
Computational Thinking ◽  
Assessment Method ◽  
School Students ◽  
Traditional Assessment ◽  
Domain Specific ◽  
Assessment Design ◽  
Problem Types ◽  
Computer Based ◽  
Competency Based

Computational Thinking (CT ), entailing both domain-general and domain-specific skills, is a competency fundamental to computing education and beyond. However, as a cross-domain competency, appropriate assessment design and method remain equivocal. Indeed, the majority of the existing assessments have a predominant focus on measuring programming proficiency and neglecting other contexts in which CT can also be manifested. To broaden the promotion and practice of CT, it is necessary to integrate diverse problem types and item formats using a competency-based assessment method to measure CT. Taking a psychometric approach, this article evaluates a novel computer-based assessment of CT competency, Computational Thinking Challenge. The assessment was administered to 119 British upper secondary school students ( M = 16.11; SD = 1.19) with a range of prior programming experiences. Results from several reliability analyses, a convergent validity analysis, and a Rasch analysis, provided evidence to support the quality of the assessment. Taken together, the study demonstrated the feasibility to expand from traditional assessment methods to integrating multiple contexts, problem types, and item formats in measuring CT competency in a comprehensive manner.

scholarly journals Development and Validation of Computational Thinking Assessment of Chinese Elementary School Students

2021 ◽  
Vol 15 ◽  
pp. 183449092110102
Author(s):  
Yan Li ◽  
Shan Xu ◽  
Jia Liu
Keyword(s):  
Convergent Validity ◽  
Computational Thinking ◽  
Verbal Ability ◽  
Reliability And Validity ◽  
Sixth Grade ◽  
Test Reliability ◽  
Neural Activation ◽  
School Students ◽  
Two Samples ◽  
Key Aspects

Recent advances in artificial intelligence have brought attention to computational thinking (CT) in school education worldwide. However, little is known about the development of the literacy of CT in children, mainly because of the lack of proper psychometric assessments. We developed the first psychometrically validated assessment on the literacy of CT of children in Chinese elementary schools, coined as the Computational Thinking Assessment for Chinese Elementary Students (CTA-CES). Items were constructed to reflect key aspects of CT such as abstraction, algorithm thinking, decomposition, evaluation, and pattern recognition. To examine the test reliability and validity, we recruited two samples of 280 third- to sixth-grade students in total. Cronbach’s alpha provided evidence for the reliability of the test scores, item response theory analyses demonstrated psychometric appropriateness, whereas construct validity was verified by convergent validity, and criterion-related validity was confirmed by correlations between the CTA-CES and measures related to CT, namely reasoning, spatial ability, and verbal ability. In addition, an fMRI study further demonstrated similar neural activation patterns when students conducted the CTA-CES and programming tasks. Taken together, the CTA-CES is the first reliable and valid instrument for measuring the literacy of CT for Chinese children, and may be applicable to children worldwide.

Manipulate Me

2020 ◽  
Vol 36 (4) ◽  
pp. 554-562
Author(s):  
Alica Thissen ◽  
Frank M. Spinath ◽  
Nicolas Becker
Keyword(s):  
High School Students ◽  
Spatial Ability ◽  
Convergent Validity ◽  
Item Difficulty ◽  
Test Results ◽  
Response Elimination ◽  
School Students ◽  
Test Environment ◽  
Response Options ◽  
Construction Task

Abstract. The cube construction task represents a novel format in the assessment of spatial ability through mental cube rotation tasks. Instead of selecting the correct answer from several response options, respondents construct their own response in a computerized test environment, leading to a higher demand for spatial ability. In the present study with a sample of 146 German high-school students, we tested an approach to manipulate the item difficulties in order to create items with a greater difficulty range. Furthermore, we compared the cube task in a distractor-free and a distractor-based version while the item stems were held identical. The average item difficulty of the distractor-free format was significantly higher than in the distractor-based format ( M = 0.27 vs. M = 0.46) and the distractor-free format showed a broader range of item difficulties (.02 ≤  pi ≤ .95 vs. .37 ≤  pi ≤ .63). The analyses of the test results also showed that the distractor-free format had a significantly higher correlation with a broad intelligence test ( r = .57 vs. r = .17). Reasons for the higher convergent validity of the distractor-free format (prevention of response elimination strategies and the broader range of item difficulties) and further research possibilities are discussed.

Improving Skills in Senior Secondary Schools for Effective Performance in Computer Based Test and Security.

2019 ◽  
pp. 167-174
Author(s):  
Agu B.G. ◽  
Eya G.M.
Keyword(s):  
Cognitive Abilities ◽  
Computer Literacy ◽  
Literacy Skills ◽  
School Students ◽  
Effective Performance ◽  
Information And Communication ◽  
Computer Based ◽  
Senior Secondary Schools ◽  
Matriculation Examination ◽  
Senior Secondary

Students are accessed using paper and pen on cognitive abilities in Nigeria. This method of assessment encourages different forms of examination malpractices. The threat of examination malpractices on the validity of examination outcomes has resulted in some examination bodies adopting different methods of examination. One of such methods is the computer based test (CBT). Using survey research method, this study investigated the levels of competency in computer literacy skills possessed by senior secondary school students. Three research questions and one hypothesis guided the study. Problems encountered by the students and prospective methods of enhancing computer based test (CBT) acceptance in Nigeria were also documented. A total of 310 copies of the questionnaire were administered to students who participated in the 2015 Unified Tertiary Matriculation Examination (UTME) at Afrihub Information and Communication Technology (CBT) centre, Institution of Management and Technology (IMT), Enugu and Godfrey Okoye University, Enugu and 237 representing 76% were adequately completed and found usable. The findings revealed among others that majority of the respondents confirmed that CBT can curb examination malpractice. Majority of candidates were also found to prefer CBT to the paper and pencil test (PPT). The mean, standard deviation and Pearson‟s Correlation Analysis showed that the respondent is preference for CBT were sensitive across gender. While improving electricity was identified as critical in enhancing CBT examinations, poor ICT skills on the part of students and the invigilators were also identified as the major problems facing the implementation of JAMB CBT examination in Nigeria.

The Interplay Between Mathematical and Computational Thinking in Primary School Students’ Mathematical Problem-Solving Within a Programming Environment

2021 ◽  
pp. 073563312097993
Author(s):  
Zhihao Cui ◽  
Oi-Lam Ng
Keyword(s):  
Problem Solving ◽  
Mathematical Thinking ◽  
Mathematics Learning ◽  
Mathematical Problem ◽  
Computational Thinking ◽  
Programming Environment ◽  
Primary School Students ◽  
School Students ◽  
Mathematical Concepts ◽  
Block Based

In this paper, we explore the challenges experienced by a group of Primary 5 to 6 (age 12–14) students as they engaged in a series of problem-solving tasks through block-based programming. The challenges were analysed according to a taxonomy focusing on the presence of computational thinking (CT) elements in mathematics contexts: preparing problems, programming, create computational abstractions, as well as troubleshooting and debugging. Our results suggested that the challenges experienced by students were compounded by both having to learn the CT-based environment as well as to apply mathematical concepts and problem solving in that environment. Possible explanations for the observed challenges stemming from differences between CT and mathematical thinking are discussed in detail, along with suggestions towards improving the effectiveness of integrating CT into mathematics learning. This study provides evidence-based directions towards enriching mathematics education with computation.

Cognitive Orientation to (Daily) Occupational Performance: Changes in Strategy and Session Time Use over the Course of Intervention

2008 ◽  
Vol 28 (4) ◽  
pp. 168-179 ◽  
Author(s):  
Sylvia Rodger ◽  
Silvia Liu
Keyword(s):  
Time Use ◽  
Developmental Coordination Disorder ◽  
Cognitive Strategy ◽  
Cognitive Intervention ◽  
Strategy Use ◽  
Occupational Performance ◽  
Domain Specific ◽  
Session Time ◽  
Cognitive Orientation ◽  
Computer Based

Cognitive Orientation to (daily) Occupational Performance (CO-OP) is a cognitive intervention that was developed to assist children with developmental coordination disorder (DCD) enhance their motor performance in everyday activities. Using a computer-based analysis of 10 videotaped treatment sessions for each of four boys with DCD who were 6 to 9 years of age, this study investigated changes in cognitive strategy use and session time use over the course of intervention. Cognitive strategy use focused on the child's use of global and domain-specific strategies during intervention. Session time use referred to the duration of Talking About Task (describing the task or plans that will be executed), Practicing Task (actually doing the task or activity), and Dual Tasking (both talking and doing) coded during video segments observations. Trends in strategy and session time use over 10 sessions appeared to be child- and goal-specific, with few systematic patterns observed. This article discusses the use of specific strategies over time both within and across the four participants. Individual results were varied and highlight the unique child—task—environment interactions that occur during intervention, reinforcing the individualized and client-centered focus of the CO-OP.

Sign in / Sign up

Export Citation Format

Share Document