scholarly journals Investigating the Influence of Quality Factors on User Satisfaction with Summative Computer-based Assessment

2021 ◽  
Vol 19 (6) ◽  
pp. pp490-503
Author(s):  
Hassan Bello ◽  
Nor Athiyah Abdullah

Computer-based assessment or e-assessment system is an e-learning system where information communication technology is utilized for examination activity, grading, and recording of responses of the examinees. It includes the entire assessment process from the examinees, teachers, institutions, examination agencies, and the public. E-assessment systems have been used extensively in educational and non-educational settings worldwide because of their significant impact on assessment to both the institutions and students. Electronic assessment systems have many significant advantages over conventional paper-pencil-based approaches, like reducing production cost, automatic marking, and fair grading. Other benefits include the ability to conduct adaptive testing, an increase in the frequency of assessment, a large number of people could be examined, low staff requirements during the assessment, and the ability to improve the quality of the evaluation. Text, images, audio, video, and interactive virtual environments in an e-assessment system are all feasible. Nevertheless, given all these advantages, some examinees expressed negative views about electronic assessment in our study due to fear or lack of familiarity with assessment technology and lack of information on e-assessment methods. Despite the increased adoption of e-assessment in higher education and organizations, the examinees' attitudes and opinions need to be studied to implement the system successfully. In an e-assessment environment, several factors account for the evaluation of the system quality. These factors can be categorized into three dimensions: technical, educational, and economical. However, based on literature reviewed,  limited studies attempted to map these quality factors to determine user satisfaction with an e-assessment system. This scarcity of e-assessment satisfaction studies is the gap the study intends to fill. Furthermore, this study's findings would help provide practical and theoretical implications for educational institutions and organizations. This study is among the first application of the Delone and McLean information system success model to predict user satisfaction with computer-based assessment in a developing, African country.

Assessment is an important component of education especially in the context of the learning and teaching environment. In higher education, assessment is the heart of formal education. Nowadays, technology plays an important role in the assessment process. Therefore, using technology development has an impact on improving the assessment system. Focus on the using of electronic assessment (e-assessment) systems is increasingly developing at the higher education level. Technological developments have led to a shift in concepts and ways of assessing moving from face-to-face assessment to digital-based assessment, namely an end-to-end assessment process using ICT. E-assessment system is provides many benefits for the effectiveness and efficiency of learning in higher education for lecturers, students and institutions. Many e-assessment models are developed to meet various objectives, especially in the purpose of educational learning. However, there are many challenges in its process and application. This paper aims to provide an example of e-assessment system application, describe challenges in the use of e-assessment systems in higher education based on literature, journals and research results and provide recommendations on how to deal with all of these challenges so that the assessment objectives can be achieved. The method that used is to figure out and describe qualitatively. Overall conclusion is the e-assessment system has become one of the requirements in higher education with many models. There are still many questions for lecturers, students and institutions that pose challenges in the application of e-assessments related to validity and reliability, accuracy, fairness, security, infrastructure and human resources. Based on this fact then the recommendation of these challenges in the successful implementation of e-assessment in higher education are paying attention to the characteristics of e-assessment, designing assessments according the needs, and creating a complete and accessible assessment system for all.


2020 ◽  
Vol 2 (11) ◽  
pp. 15-21
Author(s):  
Ria Dwi I’zzaty

Current technological developments greatly impact the assessment verification system. To find out the student benchmarks in the results of teaching and learning activities during the learning system assessment process is very important in the scope of higher education. With the existence of blockchain technology widely applied in the world of Education, having the advantage of a decentralized system and strong cryptography can help universities in building infrastructure. Universitas Raharja is one of the educational institutions that has implemented an online assessment system (PEN +), which will use blockchain technology to verify the assessment of independent studies. which provides services to Raharja University lecturers in verifying student grades that can be accessed anywhere and at any time. However, currently the verification process for the independent study assessment that has been carried out is still done manually which results in verification not with very strong security. The existence of an independent study assessment verification uses blockchain technology to produce strong data security that did not occur before. In the PEN + lecturer assessment system for the independent study assessment verification process, it cannot yet enter the value of Independent study (IS) in real time. Therefore, there is a need for development in this blockchain technology for the verification process of independent study assessment. In this study there were 10 (ten) literary studies on verification of valuation. Thus there are several benefits that lecturers need not hesitate to verify the assessment, the process by using blockchain technology produces very strong security.


2009 ◽  
Vol 48 (01) ◽  
pp. 92-100 ◽  
Author(s):  
G. Paré ◽  
M.-P. Moreault ◽  
A. Lemay ◽  
L. Valiquette ◽  
J. Barkun ◽  
...  

Summary Objective: Since it is important to develop strategies for the successful implementation of electronic clinical information systems, the aim of this study is to explore where, and to what extent, users’ attitudes toward the former system that is being replaced may vary. Methods: A cross-sectional survey of 346 nurses and physicians practicing in two Canadian teaching hospitals resulted in a total response rate of 63%. User attitudes were measured in three dimensions: a) user satisfaction with the system’s quality attributes, b) perceived system usefulness, and c) perceived impact on quality of care and patient safety. The current system (the one being replaced) was analyzed as a dual system composed of both paper-based and electronic records. Results: The results on user satisfaction demonstrate a wide variation in opinions, with satisfaction ranging from 4.2 to 7.7 on a 10-point disagree-agree, Likert scale. The quality attributes varied by record type, with differences that were systematically in favor of the electronic record component, which received higher scores. The results also highlighted large differences by user group. Physicians and nurses systematically rated the two record formats differently. The nurses were more satisfied with the attributes of the paper-based record. Multivariate regression analyses results also revealed strong interdependencies among the three dimensions of user attitudes, to the extent that perceived system usefulness was strongly correlated with system quality attributes and the system outcomes were also correlated, although less strongly, with the two former system dimensions. Conclusion: Understanding users’ attitudes toward a clinical information system in use, both in its paper and electronic aspects, is crucial for developing more successful implementation strategies for electronic record systems.


2021 ◽  
Vol 7 (1) ◽  
pp. 225
Author(s):  
Nurul Shahnaz Mahdzan ◽  
Marzuki Mokhtar ◽  
Amran M. Nayan ◽  
Mohd Razif Idris

Engineering Maintenance System (EMESYS) is the online Management Information System (MIS) on equipment maintenance performed by the Royal Electrical and Mechanical Engineers (REME) Corps including maintenance on vehicle, weapon, electronic and miscellaneous equipment. This study attempts to identify the determinants of user satisfaction in adopting the EMESYS based on an information system success model by De Lone and Mc Lean (2003).  This study is important as it is the first empirical study focusing on the user satisfaction of EMESYS in the context of the Malaysian Army. The data were collected using online surveys from 309 EMESYS users. Standard multiple regressions was used to analyse the data gathered. The results of this study indicate that three of the hypothesis are supported and users’ satisfaction of EMESYS is influenced by the three dimensions, namely, system quality, information quality and IT infrastructure. EMESYS has been proven successful in transforming the tedious procedures involving multiple parties and documents to the process of a simple data entry to EMESYS.


2012 ◽  
Vol 10 (1) ◽  
pp. 44-54 ◽  
Author(s):  
Tung-Cheng Lin ◽  
Ching-Jen Chen

Many e-learning studies have evaluated learning attitudes and behaviors, based on TAM. However, a successful e-learning system (ELS) should take both system and information quality into account by applying ISM developed by Delone and McLean. In addition, the acceptance for information system depends on the perceived usefulness and ease of use according to TAM. This research combined TAM with ISM by introducing system quality, quality of platform information, and course information as an antecedent of perceived usefulness and perceived ease of use. These factors were crucial for understanding users’ intention to continue their use of ELS. This study investigated 412 students with ELS experiences. The results indicate that system quality, platform information, and course information had significantly related to user satisfaction and their intention to use ELS continuously.


Author(s):  
Muhammad Hafiz Riandi ◽  
Harianto Respati ◽  
Syarif Hidayatullah

This study aims to collect the required information to construct a conceptual model to measure e-learning information system success in higher education setting. The methodology used in this study is literature study which was done by comparing six articles from international journals across the globe. Other articles as well as books were also used to support the findings in this study. Further in-depth study and comparisons was made to find suitable variables to evaluate e-learning system success. The conclusion of this study is a conceptual model which implements user satisfaction as mediating variable of the relationship of elearning service quality and system quality on students' individual performance as a measure of e-learning system success. Furthermore, this conceptual model can be an essential reference to be implemented in further related research.


2013 ◽  
Vol 12 (1) ◽  
pp. 3167-3177
Author(s):  
Abdelghafar Mohammed Elhady Elsaid ◽  
Ahmed Elsayed Hassan

Computer's hardware and software development aided education field progresses more rapidly. Not only the computer is used in learning and assessment processes to add more attractiveness, but also it's used for better performance of educational system. But one of more defects was lacking in applying modern educational quality factors to both learning and assessment software. This paper presents a web based Student Assessment Process Management System (SAPMS). SAPMS provides a secured, attractive, easy to use and quality based assessment system. Our system is completely analyzed and designed using the Unified Modeling Language (UML). We also present the implementation of the core components of the SAPMS which performs the most important processes in the system. In addition to that a validation study for the system components is performed.


Author(s):  
Sylvia Encheva ◽  
Sharil Tumin

The issue of rewarding partially correct answers has been addressed by many authors (Guzman, E. & Conejo, R., 2004, Gardner-Medwin, A.R. 1995, Huffman, D, Goldberg, F., & Michlin, M. 2003). Intelligent systems have been designed to assign scores related to the importance of missing or incorrect part of an answer. Such systems are meant to facilitate the process of knowledge assessment. While trying to be efficient in evaluating students’ responses these systems operate with the answers to a single question addressing learning a new term, understanding a new concept or mastering a new skill. However, experimental practice shows that asking several questions about the same item results in inconsistent and/or incomplete feedback, i.e. some of the answers are correct while others are partially correct or even incorrect. A large number of computer based systems and thus automated assessment systems lack the ability to reason with inconsistent information. Such a situation occurs when, f. ex. a student answers to two questions about one item and one of the answers is correct and the other one is incorrect or missing. Reasoning by applying classical logic cannot solve the problem because the presence of contradiction leads to trivialization, i. e. anything follows from ‘correct and incorrect’ and thus all inconsistencies are treated as equally bad (Priest, 2001). In this paper we discuss how to assess students’ understanding of new terms and concepts, shortly after they have been introduced in a subject. Application of many-valued logic allows the system to give meaningful responses in the presence of inconsistencies. Decision making rules, an intelligent agent is applying for assessing students’ understanding of new terms and concepts are presented. Such rules distinguish between students’ hesitation in the process of giving an answer and lack of knowledge. We propose use of the generalized Lukasiewicz’s logic in a Web-based assessment system as a way of resolving problems with inconsistent and/or incomplete input.


2021 ◽  
Vol 4 (1) ◽  
pp. 29
Author(s):  
Burhan Mafazi

Education is a crucial thing and highly concerned all over the world. As one of the educational institutions, the university has currently applied many information systems because of several obstacles and problems. With the fast development of information and communication technology, the learning process also has improved, known as e-learning. Pertamina University is a private university located in Jakarta, which has six faculties and 15 study programs. Since its inception in 2016, Pertamina University has applied e-learning to its students. Based on the conceptual models developed by DeLone & McLean, this research aims to examine the success of the implementation of the e-learning system in Pertamina University with six variables, which are information quality, system quality, service quality, use, user satisfaction, and net benefit. The results of the study using 610 samples showed that the information quality variable did not affect the user satisfaction variable, which means that the quality of information on e-learning needed to be improved again to get a better response to user satisfaction.


Sign in / Sign up

Export Citation Format

Share Document