Beyond Programming: A Computer-Based Assessment of Computational Thinking Competency

Computational Thinking (CT ), entailing both domain-general and domain-specific skills, is a competency fundamental to computing education and beyond. However, as a cross-domain competency, appropriate assessment design and method remain equivocal. Indeed, the majority of the existing assessments have a predominant focus on measuring programming proficiency and neglecting other contexts in which CT can also be manifested. To broaden the promotion and practice of CT, it is necessary to integrate diverse problem types and item formats using a competency-based assessment method to measure CT. Taking a psychometric approach, this article evaluates a novel computer-based assessment of CT competency, Computational Thinking Challenge. The assessment was administered to 119 British upper secondary school students ( M = 16.11; SD = 1.19) with a range of prior programming experiences. Results from several reliability analyses, a convergent validity analysis, and a Rasch analysis, provided evidence to support the quality of the assessment. Taken together, the study demonstrated the feasibility to expand from traditional assessment methods to integrating multiple contexts, problem types, and item formats in measuring CT competency in a comprehensive manner.

Using student feedback about the learning environment as a starting point for co-construction

The context in which learning takes place, or learning environment, is pivotal to a positive learning experience for students. Although numerous studies have established strong links between a positive learning environment and a range of student outcomes, far less research has examined how teachers might establish such an environment. Amidst growing acknowledgment that opportunities for the co-construction of learning and assessment design could provide a means of developing a more positive learning environment, this case study examined one such journey. Using a case study approach, we argue that student feedback involving a learning environment survey provides a valuable starting point for including students in co-construction and classroom improvement. Our findings indicate that teachers can improve the learning environment by involving students in meaningful co-construction through open tasks.

DEVELOPING THE PROBLEM OF NUMERATION LITERACY WITH ISLAMIC CONTEXT

This study aims to develop assessment questions or instruments to measure students' numeration literacy skills integrated with the Islamic context. The research was conducted through 4 stages: initial assessment, design, test making, and a study of problem items then limited trials and analysis. The instruments used include algebra and statistics by taking the Islamic context of zakat material. Experts validated the instrument, and the validation results were analyzed using Aiken's formula. The instrument was also tested online and limited to 22 students of grade 8 MTsN 1 Surabaya. The test results were analyzed using product-moment correlation to determine its empirical validity and used alpha Cronbach to determine its reliability. The results showed that the 6 questions developed are valid with a validity value of 0.783. This result is reinforced by empirical validity results that show that the instruments developed are valid in terms of material/content, construct, and language. The reliability test results using alpha Cronbach obtained the reliability coefficient is 0.72. The instrument developed in this research is expected to be one of the references of students in practicing their numeracy skills and preparing to face national assessments by the Ministry of Education. Because it was found in this study that students have difficulty answering the question of numeration literacy with Islamic context. This case shows that students' numeration literacy skills are still low.

Priming Numbas for formative assessment in a first-year mathematics unit

This paper outlines an initiative that involved implementing ‘Numbas’ as a computer-based tool to support mathematics learning. ‘Numbas’ was implemented within the existing learning management system at Queensland University of Technology, where students engaged in formative assessment activities independently and were provided with automated feedback along the way. An initial evaluation was undertaken by learning designers using the ‘Assessment Design Decisions Framework’, and although more rigorous evaluation is underway, results indicate positive outcomes, and appropriate adjustment is likely to be made before rolling it out to other units within the School of Mathematical Sciences. This paper will be of interest to other educators looking for ways to embed independent computer-aided learning of mathematics.

Implementation of M-Flex Based Moodle in Pancasila Course: An Initial Evaluation on Student’s View

<p><strong>Abstract </strong></p><p>M-Flex is the approach used by utilizing various interesting and quality online learning maneuvers. Moodle-based M-Flex learning specifically in Pancasila learning is the focus of this research. The research aimed to see students' initial responses to Moodle-based M-Flex and monitor any benefits and security felt by users. The approach used is qualitative, with interviews as research instruments. The research respondents were 9 students. Analysis procedures used descriptive qualitative methods. In conclusion, the application of M-Flex based on Moodle still faces several challenges related to students' internet connections, the lack of training in using Moodle for students in Pancasila classes, and the assessment design which is still less varied. M-Flex based on Moodle, on the other hand, shows an advantage because it is supported by Moodle features that continue to develop.</p><p> </p><p><strong><em>Abstrak</em></strong></p><p><em>M-Flex adalah pendekatan yang digunakan dengan memanfaatkan berbagai manuver pembelajaran dalam jaringan yang menarik dan berkualitas. Pembelajaran M-Flex berbasis Moodle khusus dalam pembelajaran Pancasila dijadikan fokus dalam penelitian. Tujuan penelitian untuk melihat respons awal mahasiswa terhadap M-Flex berbasis Moodle dan memantau setiap manfaat serta keamanan yang dirasakan oleh penggunanya. Pendekatan yang digunakan adalah kualitatif dengan wawancara sebagai instrumen penelitian. Responden penelitian sebanyak 9 mahasiswa. Prosedur analisis menggunakan metode deskriptif kualitatif. Kesimpulannya penerapan M-Flex berbasis moodle masih menghadapi beberapa tantangan terkait koneksi internet mahasiswa, kurangnya pelatihan penggunaan moodle bagi mahasiswa dalam kelas Pancasila dan rancangan asesmen yang masih kurang variatif. M-Flex berbasis Moodle di sisi lain memperlihatkan keuntungan karena ditunjang fitur moodle yang terus berkembang.</em></p>

Ghostbusters: Using Learning Analytics and Early Assessment Design to identify and support ghost students

Ghosting is a student behaviour characterised by enrolling in a subject but never participating. Hence, a ghost student who remains enrolled receives a zero-fail grade. From 2022, the Job ready Graduates Package will require that only genuine students have access to Commonwealth assistance at Australian Universities and an institution may need to refund the fees of what are referred to as non-genuine students. In 2019 and 2020, 382 first-year subjects were monitored to identify disengaged students in weeks 3 and 4 of the session using learning analytics and nonsubmission of an early assessment item. Disengaged students were contacted via phone and 2-way SMS and offered timely and targeted support pre census. The total number of domestic undergraduate students receiving a zero fail has decreased during this time. To further reduce the number of ghost students, once identified as disengaged, an engagement should be mandatory to remain in the subject.

Preservice Teachers’ Eliciting and Responding to Student Thinking in Lesson Plays

This study presents an analysis of 95 lesson play scripts—hypothetical dialogues between the teacher and a student—written by 32 preservice teachers (PSTs). Writing lesson scripts was part of the assessment design activities to elicit and respond to students’ thinking. The findings present the types and frequencies of teacher talks/moves in fraction-related tasks during a stage of lesson plays, such as launch, active elicitation, and closure. Our analysis indicates a wide range in the number of turns taken by the PSTs, while there is little correlation between the number of turns and effectiveness at eliciting and responding to student thinking. The study also confirmed that some unproductive talk moves were still present in the lesson play context, although the PSTs had plenty of time to craft a script. This study drew implications of PSTs’ prior perceptions, experiences, knowledge, and needs in mathematics teacher education regarding the ways to create learning opportunities for them to elicit and respond to student thinking.

TECHNOLOGY FOR MONITORING CAPITAL CONSTRUCTION OBJECTS AT THE LIFE CYCLE STAGES BY REMOTE SENSING METHODS USING UNMANNED AIRCRAFT (DRONES) BASED ON HIGH PRECISION DIGITAL MODEL

In modern construction at the stages of investment assessment, design, construction and operation of capital construction facilities with the implemented information modeling system, a serious problem is the harmonization of data collected from the construction site on the geometric parameters of the facility and territory being built. The article presents a comprehensive scientific and technical solution in the field of diagnostics of buildings and structures, monitoring the progress of construction, as well as automated determination of the volume of construction work performed using remote sensing technologies using unmanned aerial vehicles and information modeling (BIM technologies).

An Analysis of Strategies for Teaching and Assessing Standards-Based Assessment Design to Preservice Teachers

Research consistently shows that solid assessment designs lead to better student learning outcomes. The development of well-designed assessments presents a challenge to preservice teachers in their attempts to master the process and to the teacher educators who instruct them. This exploratory study examined strategies for teaching assessment design utilized by 87 teacher educators in the United States. Analysis of the results showed that expository, collaborative, and hands-on approaches were used, with assessment approaches aligning to structured or unstructured approaches. Data also revealed that the participants tended to focus more on the vocabulary related to assessments rather than the strategies for design.