scholarly journals Integrating technologies into ‘‘authentic’’ assessment design: an affordances approach

Author(s):  
Richard Osborne ◽  
Elisabeth Dunne ◽  
Paul Farrand

Current pressures in higher education around student employability are driving new initiatives for change. Assessment is also a topic of debate, as it is a key driver of student behaviour, yet often falls behind other metrics in national surveys. In addition, increasing focus on digital literacies is catalysing new appreciations of what emerging digital culture might mean for both students and staff. These three highly topical challenges were jointly explored by the University of Exeter’s Collaborate project, which aimed to create employability-focused assessments enhanced by technology. By combining existing research on assessment with grounded data derived from local stakeholders, the project has developed a model for assessment design which embeds employability directly into the curriculum. Digital technologies have been aligned with this model using a “top trump” metaphor, where key affordances of technologies are highlighted in the context of the model. This paper explores the design-based research approach taken to develop this model and associated “top trumps”, along with results from the first practical iteration. Results suggest that the model is effective in supporting the design of an “authentic” assessment and that a targeted affordances approach can support the alignment of specific technologies with a particular pedagogic design.Keywords: employability; assessment; authentic; affordance; evaluation(Published: 6 September 2013)Citation: Research in Learning Technology 2013, 21: 21986 - http://dx.doi.org/10.3402/rlt.v21i0.21986

2017 ◽  
Vol 21 (3) ◽  
Author(s):  
Cristi Ford ◽  
Darragh McNally ◽  
Kate Ford

This paper discusses the design-based research approach used by the Center for Innovation in Learning and Student Success at the University of Maryland (CILSS), University College. CILSS is a laboratory for conducting applied research that focuses on continuous improvements to the university's instruction of curriculum, learning models, and student support to identify promising innovations for underserved populations in adult higher education; to drive adoption of next-generation transformational online learning; to develop new educational models based on learning science, cutting edge technology, and improved instructional methods; to help more UMUC adult students succeed by increasing retention and graduating more students in shorter time frames (thus reducing their costs). As such, leveraging technology and pedagogy in innovative ways is key to the Center's work. CILSS serves as the research and development arm for the university, promoting innovative ideas and breakthroughs in learning. The paper details one interpretation of design-based research (DBR) and how it can be applied by an innovation center working within a university for program evaluation. This paper also posits that the conceptual framework and assumptions of andragogy (Knowles, 1984) has applicable relevance to the instructional shifts that include adaptive learning in the curriculum. A review of the literature on DBR explores the central features of this approach. A review of andragogy as the conceptual framework for this paper highlights what we believe to be the central features of the evaluation approach of adaptive learning software. We then present the model used by CILSS when designing and testing a pilot project. To illustrate the approach, we provide the example of a recent pilot that uses the adaptive learning software RealizeIt in UMUC’s Principles of Accounting I course, a course that traditionally has lower than average success rates.


2020 ◽  
pp. 137-149
Author(s):  
Krzysztof Szewior

The author focuses on the manner and effects of German higher education reforms that have changed the model of university management. The point of reference is the quality of education and its role, how universities ensure it, and how it is verified through evaluation and accreditation. These elements divide the article into two parts: a part about quality and a part about evaluation and accreditation. The analysis includes the impact of global processes and Europeanization. The research approach is characteristic for public policies, sciences of management and quality. The theories used in this article: the theory of systems and neo-institutionalism, as well as perspectives: the university as an active strategic partner, entrepreneurial university, the third role of universities. The publication is based on desk research and on the analysis of processes.


2020 ◽  
Vol 9 (9) ◽  
pp. 155 ◽  
Author(s):  
Sven Ivens ◽  
Monika Oberle

Grounded in a design-based research approach, the aim of this article is to determine whether scientific evaluations help to (a) identify and fix problems in educational interventions and (b) eventually foster a more effective and positive evaluated intervention. Therefore, data from a longer-term evaluation of short digital simulation games about the European Parliament for civic education in schools were used. The data included three cycles of interventions with pre- and post-evaluations starting with the first prototype in 2015/2016 (n = 209), the second cycle in 2017/18 (n = 97), and the last one in 2019/20 (n = 222). After each evaluation, major problems and critiques regarding the simulation game were discussed with the developers, and changes were implemented in the game design. The four most important problems, the processes by which they were improved and the reactions of the participants in the following evaluations are pointed out in the article. A comparison of the last and first evaluation cycle showed an overall improvement of the simulation game regarding its effectiveness in transferring EU knowledge and the participants’ general satisfaction with the simulation game. This study underlines the value of the design-based research approach for developing educational interventions and can be useful for further work on civic education measures and the implementation of digital simulation games.


2014 ◽  
Vol 76 (6) ◽  
pp. 408-414 ◽  
Author(s):  
Joshua S. White ◽  
April C. Maskiewicz

Using a design-based research approach, we developed a data-rich problem (DRP) set to improve student understanding of cellular respiration at the ecosystem level. The problem tasks engage students in data analysis to develop biological explanations. Several of the tasks and their implementation are described. Quantitative results suggest that students from the experimental class who participated in the DRP showed significant gains on cellular respiration posttest items, and students from the control class who participated in a non-DRP task showed no significant gains. Qualitative results from interviews and written responses showed that students from the experimental class progressed to deeper “levels of achievement” in cellular respiration. The data-rich tasks promote student understanding of cellular respiration, matter transformation, decomposition, and energy transformation – all goals recommended by the Next Generation Science Standards.


2019 ◽  
Vol 4 (01) ◽  
pp. 1-19
Author(s):  
Ferdinan Ferdinan ◽  
Nurhayati Nurhayati

  AbstrakPenelitian ini adalah penelitian evaluasi dengan menggunakan jenis penelitian kombinasi (mixed methods). Pendekatan penelitian, yaitu: pendekatan studi kasus. Sumber data penelitian ini terdiri atas Rektor, Wakil Rektor I, Ketua Lembaga Penjaminan Mutu, Ketua Unit Penjaminan Mutu Fakultas, dan Kasubdit SDM Universitas dan yang menjadi responden yaitu 32 Ketua Prodi dan 70 Ketua Tingkat. Teknik pengumpulan data yaitu wawancara, studi dokumentasi, dan lembar observasi. Penilaian untuk setiap aspek evaluasi dikategorikan menjadi tiga tingkatan: tinggi, sedang, dan rendah.  Pengambilan keputusan dikategorikan menjadi tiga tingkatan: tercapai, kurang tercapai, dan tidak tercapai. Penelitian evaluasi ini memberikan beberapa kesimpulan,  yaitu gambaran pelaksanaan pembelajaran di Unismuh Makassar pada tahapan proses (transactions) menunjukkan bahwa: 1) penguasaan dosen dalam menyusun dan menyiapkan administrasi perkuliahan dari 7 subaspek  yang dievaluasi  terdapat 6 subaspek  telah memenuhi kriteria objektif dan 1 subaspek yang kurang tercapai yaitu kemampuan dosen dalam menyusun buku ajar, 2)) penguasaan dosen dalam pelaksanaan perkuliahan menunjukkan bahwa dari 15 subaspek yang dievaluasi 13 subaspek sudah tercapai sesuai standar objektif dan 2 subaspek yang belum terpenuhi yaitu dosen tidak memberikan sanksi kepada mahasiswa yang terlambat 30 menit dalam mengikuti perkuliahan dan dosen belum menyampaikan materi kuliah dengan berbasis IT, 3) interaksi dosen dengan mahasiswa dalam perkuliahan, dari 4 subaspek yang dievaluasi semuanya telah memenuhi standar objektif, dan 4) kemampuan dosen dalam melakukan evaluasi hasil perkuliahan  menunjukkan bahwa dari 12 subaspek yang dievaluasi terdapat  10 subaspek sudah tercapai sesuai standar objektif dan 2 subaspek kurang terpenuhi. Kata Kunci: Evaluasi, Mutu Pembelajaran dan TransactionsAbstract                This study is an evaluation study using mixed methods. Research approach, namely: case study approach. The data sources of this study consisted of the Chancellor, Deputy Chancellor I, Chairperson of the Quality Assurance Agency, Chair of the Faculty Quality Assurance Unit, and the Head of Sub-directorate of Human Resources of the University and respondents, namely 32 Chairmen of Study Programs and 70 Chairmen. Data collection techniques are interviews, documentation studies, and observation sheets. Assessments for each aspect of evaluation are categorized into three levels: high, medium, and low. Decision making is categorized into three levels: achieved, less achieved, and not achieved. This evaluation study provides several conclusions, namely the description of the implementation of learning in Unismuh Makassar at the stages of transactions shows that: 1) the mastery of lecturers in preparing and preparing lecture administration from 7 sub-aspects evaluated, there are 6 sub-aspects that meet objective criteria and 1 sub-aspect is lacking achieved, namely the ability of lecturers in preparing textbooks, 2)) mastery of lecturers in lecturing shows that out of 15 sub-aspects evaluated 13 sub-aspects have been achieved according to objective standards and 2 sub-aspects that have not been fulfilled, namely lecturers do not sanction students who are 30 minutes late in attending lectures and lecturers have not delivered IT-based lecture material, 3) lecturer and student interaction in lectures, of the 4 sub-aspects evaluated all met objective standards, and 4) lecturers' ability to evaluate lecture results showed that from 12 sub the evaluated aspects have 10 sub-aspects that have been achieved according to objective standards and 2 sub-aspects have not been fulfilled.Keywords: Evaluation, Learning Quality and Transaction


2021 ◽  
Vol 41 (6) ◽  
pp. 424-428
Author(s):  
Alugumi Samuel Ndou ◽  
Wanyenda Leonard Chilimo

This study examined the perceptions of academic researchers regarding electronic resources (e-resources) provided by the library at the University of Venda (UNIVEN), South Africa. The quantitative research approach and survey research design were adopted to conduct the investigation. Data was collected using a self-administered structured questionnaire randomly distributed to 45 UNIVEN academics. The findings of this study revealed that although academics at UNIVEN find e-resources easy to use, believe the resources improve academic performance, and frequently encouraged postgraduate students to use them, the majority of them had plagiarism concerns and were only moderately satisfied with available e-resources at UNIVEN. This study recommends that the university library should train academics on plagiarism detection. In addition, the library should adopt innovative ways of improving e-resource services, such as providing an Online Public Access Catalogue (OPAC) with advanced and federated search capabilities.


Analisis ◽  
2020 ◽  
Vol 10 (2) ◽  
pp. 104-117
Author(s):  
Yosafat Kristianus Bao ◽  
Maria Helena Carolinda Dua Mea

The decision to study in a major is a big challenge among most students. They will consider the existing conditions or circumstances. If the circumstances or conditions seem not in accordance with what is expected, there will be doubts which result in the decision not to choose the expected study program. Although in making a decision to take education in a study program, a consideration is needed, however, students of the Management study program have not conducted an analysis of the study program they are taking. The research approach used is a quantitative approach. From the calculation, the t-count value is 19.794 with a significance level of 0.000 or a sig value <0.05, the first hypothesis which states "the reputation of the university affects the student's decision to choose Management Study Program at the University of Flores" is accepted. From the calculation results, the t-count value is 0.887 with a significance level of 0.377 or sig> 0.05, thus the second hypothesis which states "tuition costs affect students' decisions to choose Management Study Program at the University of Flores" is rejected. From the calculation results, it is obtained that the t-count value is 5.295 with a significance level of 0.000 or a sig value <0.05, the third hypothesis which states "lecture facilities affect the student's decision to choose Management Study Program at the University of Flores" is accepted.


2021 ◽  
Vol 6 (2) ◽  
pp. 84-94
Author(s):  
Noorihan Abdul Rahman ◽  
Rozianiwati Yusof ◽  
Nor Asma Mohd Zin ◽  
Zuriani Ahmad Zukarnain

COVID-19 gives a drastic change in our lifestyle. In education, it effects on motivation, routine and the dilemma in using certain application. The university has taken various proactive measures for ensuring the productivity of their stakeholders. Students and instructors are changing their teaching and learning style which this impact on learning technology usage while having online class. This paper shares COVID-19 story in terms of learning system development online which is challenging for learners and instructors. They need to adjust themselves so that the message is conveyed, and problem is solved during the online class. This paper looks at how the learners and instructors manage their online class by using an online prototype tool, Justinmind, for assisting them to learn system development during COVID-19. The learners have been asked to plan, gather, and design the user interface according to the requirements stated previously. This study found out that there are some difficulties in conducting system development class in online mode since there is a change of routine as well as teaching and learning style. However, the difficulties have been addressed by the utilization of the technology and thus creating more exciting journey for the class regardless of the pandemic era.


Author(s):  
Nina Vyatkina

Data-Driven Learning (DDL), or a corpus-based method of language teaching and learning, has been developing rapidly since the turn of the century and has been shown to be effective and efficient. Nevertheless, DDL is still not widely used in regular classrooms for a number of reasons. One of them is that few workable pedagogical frameworks have been suggested for integrating DDL into language courses and curricula. This chapter describes an exemplar of a practical application of such a pedagogical framework to a high-intermediate university-level German as a foreign language course with a significant DDL component. The Design-Based Research approach is used as the main methodological framework. The chapter concludes with a discussion of wider pedagogical implications.


Sign in / Sign up

Export Citation Format

Share Document