Assessment of Complex Performances in Digital Environments

2019 ◽  
Vol 683 (1) ◽  
pp. 217-232 ◽  
Author(s):  
John T. Behrens ◽  
Kristen E. DiCerbo ◽  
Peter W. Foltz

Digital technologies hold the potential to transform educational assessment. Recent advances reveal that digital environments will support the development of learning and assessment activities in ways that will both increase the inferential fidelity of assessments and change the form of assessments altogether. Digital technologies can also automate data collection and the production of assessment inferences on a massive scale. Here, we discuss the wide variation in digital learning experiences and explain how they are transforming traditional language for discussing assessment. We argue that the predigital constraints on assessment have skewed our thinking about assessment and give examples of new and novel approaches. Second, we discuss how digital environments can allow us to capture and make inferences from simple or complex learning activities in new ways. Third, we point to advances in machine learning and AI that have the potential to change current and future assessment practices. Finally, we argue for balancing enthusiasm for digital environments against the challenges of making appropriate assessment inferences.

2016 ◽  
Vol 9 (2) ◽  
pp. 64-76
Author(s):  
Maria José Bocorny Finatto ◽  
Monica Stefani ◽  
Aline Evers ◽  
Bianca Franco Pasqualini

RESUMO:Neste artigo, relata-se uma investigação inicial que pretendeu qualificar a elaboração e a facilidade de uso de recursos didáticos para Educação a Distância (EAD) na área de Letras/Língua Portuguesa e Leitura. Apresentam-se o planejamento do recurso, a seleção de materiais e as noções teóricas envolvidas e o desenho inicial da atividade, que consistiu em ler e avaliar a complexidade de um conjunto de textos curtos. A experiência revelou sucesso apenas para um pequeno grupo controlado de alunos e insucesso em grande grupo, sem controle. Para a melhoria do recurso criado e da sua implementação didática, indica-se a necessidade de realização de atividades prévias presenciais de estudo com os grupos envolvidos e de avaliação de resultados com os alunos respondentes após a tarefa realizada.PALAVRAS-CHAVE: ambientes digitais; complexidade textual; recursos de EAD; vocabulário. ABSTRACT: In this paper, we describe an initial investigation that intended to qualify the elaboration and usability of didactic resources for Distance Learning (DL) in the field of Languages/Portuguese Language and Reading. We present the planning of the resource, the selection of materials and the theoretical notions involved, and the initial design of the activity, which consisted in reading and evaluating the complexity of a set of short texts. The experience was successful only for a small controlled group of students and unsuccessful for the large uncontrolled group. In order to improve the devised resource and implement it didactically, there is the need to perform previous presential learning activities with the involved groups and proceed with the student’s evaluation of the results after the task is accomplished.KEYWORDS: digital environments; textual complexity; distance learning resources; vocabulary.


2021 ◽  

Supplemental Instruction is a program designed to support students in their learning process. The program consists of advanced students supervising new students, where the purpose is to improve students’ performance and reduce the risk of interruption of studies. Supplemental Instruction was established almost 50 years ago and is used today in universities around the world. This book is about student learning processes and Supplemental Instruction, which includes everything from learning activities in SI to developing guidance skills of leaders and more. The book also deals with a comparison of Supplemental Instruction with other group-oriented learning activities, and practical aspects of the programme. The book is aimed at anyone who is concerned about study quality in higher education. The contributors are researchers and lecturers at various universities from several countries. The book is part of a trilogy on Supplemental Instruction, where the themes for the other books are “Digital Technologies” and “Organisation and Leadership”. The editors of the trilogy are Abbas Strømmen-Bakhtiar, Roger Helde and Elisabeth Suzen, all three Associate Professors at Nord University, Norway.


2021 ◽  
Author(s):  
◽  
Rana Daoud

<p>Using digital devices in primary classrooms has become a common practice in many schools around the world. A considerable amount of research has explored this phenomenon. However, the majority of studies published in highly ranked educational technology journals have focused on the effectiveness of interventions related to using digital devices in primary classrooms and few studies examine students’ use of digital devices during learning which reflects a dominance of the reductionist approach in studying classroom environments. While there is rich literature addressing the outcomes of using devices, much is still unknown about the use itself. The present study aimed to understand how students use digital devices in classroom learning activities. It explored the ways of use, the factors that shaped these uses, and how the uses contributed to the purposes of learning activities. Approaches used to study phenomena in open recursive systems, such as classrooms, should be different from approaches used to study phenomena in closed systems under controlled conditions. Therefore, Complexity Theory provided a framework to understand the socio-materiality of digital devices in classrooms learning. In addition, Actor-Network Theory was used to study the phenomenon in action and Biesta’s (2009) framework of the functions of education to understand the contribution of the uses to educational purposes. This multiple case study was conducted in New Zealand within two schools where two teachers and seven upper-primary students participated in the study. Data were collected across six months through observations, semi-structured interviews, group interviews, informal conversations, student think-aloud interviews and artefacts from learning including video screen-captures. Data were coded and analysed using the thematic analysis and an abductive strategy. From a synthesis of the findings a ‘Using Devices for Classroom Learning’ model was developed in which seven patterns of use were identified. The children used their devices as a source of information, means of communication, production medium, external personal memory, collective memory coordinator, trial-and-error learning space, and as a research tool. Interconnected factors shaped these uses which were related to the educational system, school and classroom environment, teachers, students, and digital technologies. The findings showed how the seven uses contributed to the educational purposes of classroom learning which were classified into students’ qualifications, socialisation, and subjectification. However, some of these uses led to undesirable influence on students’ learning. This study provides theoretical and practical contributions to the field of using digital technologies in education. Complexity thinking, as a holistic approach, sheds light on blind spots of the educational process and acknowledges the complexity and uncertainty when using devices for learning in social complex systems such as classrooms. What emerges in classrooms does not result from separate factors but from a network of relationships and interactions of interconnected factors. The model developed provides an analysis tool for researchers and assists educators and policymakers to understand and anticipate the role of digital devices in classroom learning.</p>


Author(s):  
Elvira Vitaljevna Burtseva ◽  
Olga Chepak ◽  
Olga Kulikova

The subject of this research is the implementation of digital technologies in educational process of a university. The goal consists in studying the impact of digital technologies upon the students&rsquo; learning activities. The article presents the results of questionnaire-based survey among students by the three question pools. In the course of research, the author examines such aspects of the problem, as the positive and negative impact of technologies upon learning activities of the students of digital generation. Particular attention is given to consideration of students&rsquo; attitude on digitalization of higher education. The opinions of pedagogues on the results of conducted research are presented. The scientific novelty lies in mainstreaming the question on the negative impact of digital technologies upon learning activities of the modern generation of students that deserves special attention. On the background of common passion of the scholars of researchers and pedagogues for the ideas of digitalization of education, when digital technologies are viewed as virtually the key factor for modernization of educational process; second come the problems of growing pathological dependence of youth on digital technologies, undesired to switch to digitalized educational process to the disadvantage of communication in social networks and pleasant pastime online. The problem of the negative effect of digital technologies on learning activities must be recognized in order to find the ways for its solution.


2021 ◽  
Vol 10 (4) ◽  
pp. 42
Author(s):  
Haris Sugianto

Although a large number of studies have put a focus on the enactment of blended learning in English as a foreign language (EFL) classroom, there is a paucity of research into the teacher’s lived experiences of how they enact assessment in the blended learning activities. To fill such a gap, this paper reports on a narrative inquiry of an EFL teacher’s lived experiences of conducting assessment during blended learning in the pandemic era. The finding of the study shed light on the ineffectiveness of the assessment practice during the blended learning enactment, particularly in the context of rural schools. Albeit the participating teacher in this study was fully engaged to conduct assessment from his past experiences, two major problems hinder such a practice: students’ unsubmitted assignments and poor Internet connection. Based on these findings, teachers are encouraged to find an alternative assessment practice during the blended learning, portfolio assessment can be an option. This suggestion is anchored by the fact that the assessment practice was not technically supported during the blended learning activities.


2021 ◽  
Vol 6 ◽  
Author(s):  
Gunilla Näsström ◽  
Catarina Andersson ◽  
Carina Granberg ◽  
Torulf Palm ◽  
Björn Palmberg

Motivation is a prerequisite for students’ learning, and formative assessment has been suggested as a possible way of supporting students’ motivation. However, there is a lack of empirical evidence corroborating the hypothesis of large effects from formative assessment interventions on students’ autonomous forms of motivation and motivation in terms of behavioral engagement in learning activities. In addition, formative assessment practices that do have an impact on students’ motivation may put additional requirements on teachers than more traditional teaching practices. Such requirements include decisions teachers need to make in classroom practice. The requirements on teachers’ decision-making in formative assessment practices that have a positive impact on students’ autonomous forms of motivation and behavioral engagement have not been investigated. This study describes one teacher’s formative assessment practice during a sociology course in upper secondary school, and it identifies the requirements for the teacher’s decision-making. The teacher had participated in a professional development program about formative assessment just prior to this study. This study also investigated changes in the students’ motivation when the teacher implemented the formative assessment practice. The teacher’s practice was examined through observations, weekly teacher logs, the teacher’s teaching descriptions, and an interview with the teacher. Data on changes in the students’ type of motivation and engagement were collected in the teacher’s class and in five comparison classes through a questionnaire administered in the beginning and the end of the course. The students responded to the questionnaire items by choosing the extent to which they agreed with the statements on a scale from 1–7. The teacher’s formative assessment practice focused on collecting information about the students’ knowledge and skills and then using this information to make decisions about subsequent instruction. Several types of decisions, and the knowledge and skills required to make them that exceed those required in more traditional teaching practices, were identified. The students’ in the intervention teacher’s class increased their controlled and autonomous forms of motivation as well as their engagement in learning activities more than the students in the comparison classes.


The current economic terms and conditions stimulate investments in digital transformations. Digital technologies act as drivers, including for education and vocational training. The companies that invest in information technologies for education and HR training realize that investments in HR and the development of skills in education and vocational training are recognized as key factors of the economic growth. This article aims at analyzing the peculiarities of investing in digital learning technologies in the context of the digital economy. In the article the relevance of investing in HR has been substantiated, and the foreign experience of stimulating investments in digital learning technologies has been analyzed. Based on the expert survey, the possibilities of HR digital training have been analyzed, and the peculiarities of various forms of digital training have been defined.


2021 ◽  
Author(s):  
Michael Schwartz ◽  

Many companies have tried to automate data collection for handheld Digital Multimeters (DMM) using Optical Character Recognition (OCR). Only recently have companies tried to perform this task using Artificial Intelligence (AI) technology, Cal Lab Solutions being one of them in 2020. But when we developed our first prototype application, we discovered the difficulties of getting a good value with every measurement and test point.A year later, lessons learned and equipped with better software, this paper is a continuation of that AI project. In Beta-,1 we learned the difficulties of AI reading segmented displays. There are no pre-trained models for this type of display, so we needed to train a model. This required the testing of thousands of images, so we changed the scope of the project to a continual learning AI project. This paper will cover how we built our continuous learning AI model to show how any lab with a webcam can start automating those handheld DMMS with software that gets smarter over time.


Sign in / Sign up

Export Citation Format

Share Document