Application of Multiple Criteria Decision Analysis and Optimisation Methods in Evaluation of Quality of Learning Objects

2013 ◽  
pp. 136-150
Author(s):  
Eugenijus Kurilovas ◽  
Irina Vinogradova ◽  
Silvija Serikoviene
Keyword(s):  
Decision Analysis ◽  
Quality Criteria ◽  
Learning Objects ◽  
Scientific Models ◽  
Expert Evaluation ◽  
Quality Of Learning ◽  
Technological Quality ◽  
Optimisation Methods ◽  
Quality Optimisation

This paper analyses and presents the new scientific models and methods for the expert evaluation of quality of learning objects (LOs) paying special attention to LOs reusability level. Currently all existing approaches in the area are quite subjective and depend only on the experience of the decision-makers. The authors analyse several scientific methods and principles to minimise the subjectivity level in the expert evaluation of LOs quality. They are: (a) the principles of multi-criteria decision analysis for identification of quality criteria, (b) technological quality criteria classification principle, (c) fuzzy group decision making theory to obtain evaluation measures, (d) normalisation of the weights of criteria, and (e) scalarisation method for LOs quality optimisation. The authors demonstrate that the complex application of these approaches could significantly improve the quality of the expert evaluation of LOs and noticeably reduce the level of the expert evaluation subjectivity. The paper also presents the example of practical application of these approaches for evaluation of LOs for Mathematics subject.

Application of Multiple Criteria Decision Analysis and Optimisation Methods in Evaluation of Quality of Learning Objects

2011 ◽  
Vol 1 (4) ◽  
pp. 62-76 ◽  
Author(s):  
Eugenijus Kurilovas ◽  
Irina Vinogradova ◽  
Silvija Serikoviene
Keyword(s):  
Decision Analysis ◽  
Quality Criteria ◽  
Learning Objects ◽  
Scientific Models ◽  
Expert Evaluation ◽  
Quality Of Learning ◽  
Optimisation Methods ◽  
Quality Optimisation ◽  
Fuzzy Group Decision Making

This paper analyses and presents the new scientific models and methods for the expert evaluation of quality of learning objects (LOs) paying special attention to LOs reusability level. Currently all existing approaches in the area are quite subjective and depend only on the experience of the decision-makers. The authors analyse several scientific methods and principles to minimise the subjectivity level in the expert evaluation of LOs quality. They are: (a) the principles of multi-criteria decision analysis for identification of quality criteria, (b) technological quality criteria classification principle, (c) fuzzy group decision making theory to obtain evaluation measures, (d) normalisation of the weights of criteria, and (e) scalarisation method for LOs quality optimisation. The authors demonstrate that the complex application of these approaches could significantly improve the quality of the expert evaluation of LOs and noticeably reduce the level of the expert evaluation subjectivity. The paper also presents the example of practical application of these approaches for evaluation of LOs for Mathematics subject.

scholarly journals Evaluation of multiple criteria quality of mathematics learning objects in eQNet project

2010 ◽  
Vol 51 ◽  
Author(s):  
Silvija Sėrikovienė ◽  
Eugenijus Kurilovas
Keyword(s):  
Mathematics Learning ◽  
Quality Criteria ◽  
Learning Objects ◽  
Multiple Criteria ◽  
Digital Learning ◽  
Criteria Weights ◽  
Technological Quality ◽  
Digital Learning Objects ◽  
Fuzzy Group Decision Making

The paper is aimed to analyse the application of several scientific approaches, methods, and principles for evaluation of quality of digital learning objects (LOs) for Mathematics subject. The authors analyse the following approaches to minimise subjectivity level in expert evaluation of LOs quality, namely: (1) principles of multiple criteria decision analysis for identification of quality criteria, (2) technological quality criteria classification principle, (3) fuzzy group decision making theory toobtain evaluation measures, (4) normalisation requirement for criteria weights, and (5) scalarisation method for LOs quality evaluation. The applied approaches have been used practically for evaluation of LOs while implementing European Lifelong Learning programme’s eQNet project in Lithuanian comprehensive schools in winter and spring 2010.

Towards a holistic model for quality of learning object repositories

2017 ◽  
Vol 35 (5) ◽  
pp. 953-976
Author(s):  
Christian Vidal-Castro ◽  
Alejandra Andrea Segura Navarrete ◽  
Victor Menendez-Dominguez ◽  
Claudia Martinez-Araneda
Keyword(s):  
Learning Objects ◽  
Learning Object ◽  
Quality Level ◽  
Quality Model ◽  
Holistic Model ◽  
Metadata Standard ◽  
Content Type ◽  
Learning Object Metadata ◽  
Quality Of Learning

Purpose This paper aims to address the need to ensure the quality of metadata records describing learning resources. We propose improvements to a metadata-quality model, specifically for the compliance sub-feature of the functionality feature. Compliance is defined as adherence level of the learning object metadata content to the metadata standard used for its specification. The paper proposes metrics to assess the compliance, which are applied to a set of learning objects, showing their applicability and usefulness in activities related to resources management. Design/methodology/approach The methodology considers a first stage of metrics refinement to obtain the indicator of the sub-feature compliance. The next stage is the proposal evaluation, where it is determined if metrics can be used as a conformity indicator of learning object metadata with a standard (metadata compliance). The usefulness of this indicator in the information retrieval area is approached through an assessment of learning objects where the quality level of its metadata and the ranking in which they are retrieved by a repository are correlated. Findings This study confirmed that the best results for metrics of standardization, completeness, congruence, coherence, correctness and understandability, which determine the compliance indicator, were obtained for learning objects whose metadata were better labelled. Moreover, it was found that the learning objects with the highest level of compliance indicator have better positions in the ranking when a repository retrieves them through an exact search based on metadata. Research limitations/implications In this study, only a sub-feature of the quality model is detailed, specifically the compliance of learning object standard. Another limitation was the size of the learning objects set used in the experiment. Practical implications This proposal is independent from any metadata standard and can be applied to improve processes associated with the management of learning objects in a repository-like retrieval and recommendation. Originality/value The originality and value of this proposal are related to quality of learning object metadata considered from a holistic point of view through six metrics. These metrics quantify both technical and pedagogical aspects through automatic evaluation and supported by experts. In addition, the applicability of the indicator in recovery systems is shown, by example to be incorporated as an additional criterion in the learning object ranking.

scholarly journals SELECTION AND QUALITY OF LEARNING OBJECTS. ARE THEY USABLE AND REUSABLE?

2017 ◽  
Vol 59 (3) ◽  
pp. 28
Author(s):  
Margarita María Ayala Doval ◽  
Marcela Georgina Gómez-Zermeño
Keyword(s):  
Online Education ◽  
Graduate Program ◽  
Learning Objects ◽  
Learning Material ◽  
Design Teams ◽  
Face To Face ◽  
Quality Of Learning ◽  
Evaluation Of Learning

This pilot- study focused on the evaluation of Learning Objects for face-to-face and online education, proposing a set of quality indicators for design teams to consider while selecting learning material. The aim was to find out whether the Learning Objects were suitable enough to be used and/or reused. A sample of teachers, tutors and computer technicians of a graduate program in a Colombian university participated in the study. To analyze the data collected, indicators for the evaluation of the quality of Learning Objects were based on three main aspects: the role of the tutor and their previous experience, the design process, and the evaluation of the learning object. Conclusions established that a standardization of Learning Objects may be difficult, however, in order to be usable and reusable, these Learning Objects must all be flexible to adapt to students’ needs.

scholarly journals Supporting the Quality of Learning Objects Through Their Ranking Visualization

2009 ◽  
Vol 4 (0) ◽  
Author(s):  
E. M. Morales Morgado ◽  
D.A Gómez Aguilar ◽  
F. J. García Peñalvo ◽  
R. Therón Sánchez
Keyword(s):  
Learning Objects ◽  
Quality Of Learning

scholarly journals NEW MCEQLS TFN METHOD FOR EVALUATING QUALITY AND REUSABILITY OF LEARNING OBJECTS

2013 ◽  
Vol 19 (4) ◽  
pp. 706-723 ◽  
Author(s):  
Eugenijus Kurilovas ◽  
Silvija Serikovienė
Keyword(s):  
Decision Analysis ◽  
Fuzzy Numbers ◽  
Quality Criteria ◽  
Learning Objects ◽  
Multiple Criteria ◽  
Quality Model ◽  
Research Results ◽  
Analysis Process ◽  
Multiple Criteria Evaluation ◽  
Learning Software

The aim of the paper is to present a new simple to use and efficient MCEQLS (Multiple Criteria Evaluation of the Quality of Learning Software) TFN (Trapezoidal Fuzzy Numbers) method for the expert evaluation of the quality and reusability of learning objects (LOs). MCEQLS and TFN methods are analysed, improved, and practically applied to present the decision analysis process for selecting LOs suitable to reuse in different pedagogical situations and in different education systems. The research results are implemented in eQNet – a three-year strategic pan-European project focused on reusability of LOs. A novel method of consecutive application of Fuzzy Numbers theory to establish the weights of LOs quality criteria and MCEQLS approach to establish final evaluation results are explored in more detail. A number of multiple criteria decision analysis principles are applied to create a comprehensive quality model (criteria system) for evaluating the quality and reusability of LOs. Several practical examples of LOs evaluated against the proposed MCEQLS TFN method are presented in the paper. The research results have shown that the proposed method is quite objective, exact, simple to use, and efficient for selecting qualitative reusable LOs alternatives in the market.

Sign in / Sign up

Export Citation Format

Share Document