Application of Scientific Approaches for Evaluation of Quality of Learning Objects in eQNet Project

Author(s):  
Eugenijus Kurilovas ◽  
Silvija Serikoviene
Author(s):  
Eugenijus Kurilovas ◽  
Irina Vinogradova ◽  
Silvija Serikoviene

This paper analyses and presents the new scientific models and methods for the expert evaluation of quality of learning objects (LOs) paying special attention to LOs reusability level. Currently all existing approaches in the area are quite subjective and depend only on the experience of the decision-makers. The authors analyse several scientific methods and principles to minimise the subjectivity level in the expert evaluation of LOs quality. They are: (a) the principles of multi-criteria decision analysis for identification of quality criteria, (b) technological quality criteria classification principle, (c) fuzzy group decision making theory to obtain evaluation measures, (d) normalisation of the weights of criteria, and (e) scalarisation method for LOs quality optimisation. The authors demonstrate that the complex application of these approaches could significantly improve the quality of the expert evaluation of LOs and noticeably reduce the level of the expert evaluation subjectivity. The paper also presents the example of practical application of these approaches for evaluation of LOs for Mathematics subject.


2017 ◽  
Vol 35 (5) ◽  
pp. 953-976
Author(s):  
Christian Vidal-Castro ◽  
Alejandra Andrea Segura Navarrete ◽  
Victor Menendez-Dominguez ◽  
Claudia Martinez-Araneda

Purpose This paper aims to address the need to ensure the quality of metadata records describing learning resources. We propose improvements to a metadata-quality model, specifically for the compliance sub-feature of the functionality feature. Compliance is defined as adherence level of the learning object metadata content to the metadata standard used for its specification. The paper proposes metrics to assess the compliance, which are applied to a set of learning objects, showing their applicability and usefulness in activities related to resources management. Design/methodology/approach The methodology considers a first stage of metrics refinement to obtain the indicator of the sub-feature compliance. The next stage is the proposal evaluation, where it is determined if metrics can be used as a conformity indicator of learning object metadata with a standard (metadata compliance). The usefulness of this indicator in the information retrieval area is approached through an assessment of learning objects where the quality level of its metadata and the ranking in which they are retrieved by a repository are correlated. Findings This study confirmed that the best results for metrics of standardization, completeness, congruence, coherence, correctness and understandability, which determine the compliance indicator, were obtained for learning objects whose metadata were better labelled. Moreover, it was found that the learning objects with the highest level of compliance indicator have better positions in the ranking when a repository retrieves them through an exact search based on metadata. Research limitations/implications In this study, only a sub-feature of the quality model is detailed, specifically the compliance of learning object standard. Another limitation was the size of the learning objects set used in the experiment. Practical implications This proposal is independent from any metadata standard and can be applied to improve processes associated with the management of learning objects in a repository-like retrieval and recommendation. Originality/value The originality and value of this proposal are related to quality of learning object metadata considered from a holistic point of view through six metrics. These metrics quantify both technical and pedagogical aspects through automatic evaluation and supported by experts. In addition, the applicability of the indicator in recovery systems is shown, by example to be incorporated as an additional criterion in the learning object ranking.


2017 ◽  
Vol 59 (3) ◽  
pp. 28
Author(s):  
Margarita María Ayala Doval ◽  
Marcela Georgina Gómez-Zermeño

This pilot- study focused on the evaluation of Learning Objects for face-to-face and online education, proposing a set of quality indicators for design teams to consider while selecting learning material. The aim was to find out whether the Learning Objects were suitable enough to be used and/or reused. A sample of teachers, tutors and computer technicians of a graduate program in a Colombian university participated in the study. To analyze the data collected, indicators for the evaluation of the quality of Learning Objects were based on three main aspects: the role of the tutor and their previous experience, the design process, and the evaluation of the learning object. Conclusions established that a standardization of Learning Objects may be difficult, however, in order to be usable and reusable, these Learning Objects must all be flexible to adapt to students’ needs.


Author(s):  
E. M. Morales Morgado ◽  
D.A Gómez Aguilar ◽  
F. J. García Peñalvo ◽  
R. Therón Sánchez

Author(s):  
Lidia Ruiz Ortiz ◽  
Yaimí Trujillo Casañola ◽  
Yohandri Ril Gil

Con el auge en la creación de Objetos de Aprendizaje (OA) para apoyar el proceso de enseñanza-aprendizaje en las universidades cubanas, ha cambiado de manera significativa la forma en que los docentes diseñan y preparan sus cursos, permitiéndoles actualizar su contenido con el uso cotidiano de la tecnología. Como parte de este proceso, se comienzan a tener en cuenta la forma de evaluar eficientemente la calidad de los Objetos de Aprendizaje que se producen. Para ello se consideran diferentes criterios a la hora de evaluarlos. En esta investigación se resumen las características, definiciones y ventajas de los OA. Se exponen además diferentes modelos de evaluación y estándares de catalogación. El objetivo principal de este trabajo es lograr  conformar la base necesaria para fundamentar una guía que permita evaluar la calidad de los Objetos de Aprendizaje una vez creados en la Universidad de las Ciencias Informáticas, y de esta manera garantizar una mayor utilización y una mejor aceptación de los mismos.The quality of the learning objects produced at the university of information sciencesAbstractWith the boom in the creation of Learning Objects to support the teaching-learning process in Cuban universities, has significantly changed the way in which teachers design and prepare their courses, allowing them to update the content daily use of technology. As part of this process, they begin to consider how to efficiently evaluate the quality of learning objects that are produced. This will consider various criteria when evaluating them. This research summarizes the characteristics, definitions and benefits of OA. Also discussed different models of evaluation and documentation standards. The main objective of this work is to form the basis for founding a guide for evaluating the quality of learning objects once created at the University of Information Sciences, and thereby ensure greater use and greater acceptance of them.


Sign in / Sign up

Export Citation Format

Share Document