scholarly journals Evaluation of User Experience Information Systems Using Heuristic Evaluation (Case Study of STMIK Amik Riau Student Portal)

2021 ◽  
Vol 4 (2) ◽  
pp. 180-188
Author(s):  
Heru Satria Surya ◽  
Benino Giordiola Millenio ◽  
Junadhi Junadhi ◽  
Silvyana Dwi Putri

The academic information system is an important system to supports lecture activities. Is used by almost all elements in the university, both students, lecturers, staff and leaders. This research uses Heuristic Evaluation as an inference method to assess the components of learnability, efficiency, memorability, errors, and satisfaction. for various cases, such as designing academic and corporate websites with reference to these problems, it is necessary to evaluate the usability of STMIK Amik Riau information system. STMIK Amik Riau implements an integrated information system to support fast and real-time information management processes of STMIK Amik Riau information system includes various services such as E-KRS, E-KTM, E-EDOM, and other information. The aim is to identify problems related to the usability of the website. The data collection method in this research was carried out using questionnaire, containing a list of questions distributed via google form to respondents, its about 100 students of STMIK Amik Riau. Based on the analysis conducted using the Heuristic Evaluation method, the evaluation results of STMIK Amik Riau web portal have met the usability criteria with an average of 78.71915% where P > 60% and provides user satisfaction in accessing STMIK Amik Riau web portal. STMIK Amik Riau's web interface design is quite good. These results are based on the results of Likert scale score which states that the respondents agree.

BUANA ILMU ◽  
2021 ◽  
Vol 6 (1) ◽  
pp. 82-97
Author(s):  
Rini Malfiany ◽  
Donny Apdian ◽  
Shofa Shofiah Hilabi

BPJS Ketenagakerjaan adalah program jaminan sosial yang memberikan fasilitas layanan kepesertaan bagi tenaga kerja ataupun perusahaan (pemberi kerja). Salah satu program BPJS Ketenagakerjaan yang wajib diikuti ialah program Jaminan Hari Tua (JHT). Untuk mengetahui berapa saldo yang kita dapatkan setiap tahunnya, kita bisa mengetahui nya melalui sebuah aplikasi mobile untuk jaminan Hari Tua (JHT) yaitu aplikasi BPJSTKU. Aplikasi BPJSTKu merupakan aplikasi mobile untuk memberikan pelayanan bagi peserta yang dikhususkan pada tenaga kerja untuk mendapatkan informasi mengenai Saldo Jaminan Hari Tua (JHT) beserta rincian dari Saldo Jaminan Hari Tua (JHT) tahunan. Selain itu aplikasi tersebut menyediakan informasi mengenai data perserta BPJSTKU, simulasi Saldo Jaminan Hari Tua (JHT) juga menyediakan Formulir pengajuan Klaim pengambilan JHT secara online. Tujuan dibuatnya penelitian ini untuk mengetahui kepuasan atau kekecewaan dari pengguna aplikasi BPJSTKU ini, karena kepuasan pengguna itu merupakan salah satu faktor untuk menentukan tingkat usability sebuah aplikasi. Untuk menemukan masalah usability pada desain aplikasi BPJSTKU, penelitian ini dibuat dengan menggunakan metode evaluasi Heuristic. Jenis penelitian menggunakan metode kuantitatif karena mengukur kepuasan pengguna dengan Tingkat severity ratings pada masalah usability yang ditentukan dengan skala 0 sampai 4. Lokasi penelitian dilakukan di Karawang dengan sampel staf STMIK Rosma yang menggunakan Aplikasi BPJSTKU. Dari hasil pengukuran evaluasi heuristic menunjukkan kategori minor usability problem, perbaikan masalah ini diberikan prioritas yang rendah dengan nilai rata-rata 1.88 atau skala 2. Kata Kunci : Evaluasi Heuristic, Desain Antarmuka, BPJSTKU BPJS Employment is a social security program that provides membership service facilities for workers or companies (employers). One of the BPJS Employment programs that must be followed is the Old Age Security (JHT) program. To find out how much balance we get each year, we can find out through a mobile application for Old Age Security (JHT), namely the BPJSTKU application. The BPJSTKu application is a mobile application to provide services for participants devoted to the workforce to obtain information about the Old Age Security Balance (JHT) along with details of the annual Old Age Security Balance (JHT). In addition, the application provides information on BPJSTKU participant data, Simulation of Old Age Security Balance (JHT) also provides an online claim form for taking JHT. The purpose of this research is to find out the satisfaction or disappointment of the users of this BPJSTKU application, because user satisfaction is one of the factors to determine the usability level of an application. To find usability problems in the BPJSTKU application design, this study was made using the Heuristic evaluation method. This type of research uses quantitative methods because it measures user satisfaction with severity ratings on usability problems which are determined on a scale of 0 to 4. The research location was conducted in Karawang with a sample of STMIK Rosma staff who used the BPJSTKU application. From the results of the heuristic evaluation measurement, it shows the category of minor usability problems, repairing this problem is given a low priority with an average value of 1.88 or a scale of 2. Keywords: Heuristic Evaluation, Interface Design, BPJSTKU


Repositor ◽  
2020 ◽  
Vol 2 (4) ◽  
pp. 503
Author(s):  
Yola Agustia Rahman ◽  
Evi Dwi Wahyuni ◽  
Dharma Surya Pradana

AbstrakSistem informasi Teknik Informatika UMM memuat kegiatan berhubungan dengan akademik. Berdasarkan hasil observasi menggunakan kuesioner yang disebarkan ke 30 responden kepada mahasiswa aktif Teknik Informatika UMM, dari pernyataan ke empat bahwa 23 orang menyatakan meragukan data yang terdapat dalam sistem bukan informasi terkini dan jarang diperbarui. Kemudian interaksi yang dilakukan seperti penyampaian informasi mengenai jadwal kuliah, jadwal sidang, event dan informasi lainnya disampaikan melalui grup Facebook. Dengan adanya permasalahan tersebut maka peneliti menggunakan .metode User Centered Design (UCD) dalam perancangan prototype akademik dengan. memanfaatkan pendapat pengguna, serta pola. dan tingkah laku pengguna dapat .menghasilkan user interface dan fungsionalitas. yang maksimal serta memiliki nilai usabili.ty. Selain itu digunakan metode Heuristic Evaluation untuk melakukan evaluasi desain dan menilai sistem. Untuk menemukan kekurangan lebih awal sebelum di implementasikan, mengurangi kesalahan kegunaan berikutnya yang memungkinkan adanya pengeluaran biaya lebih untuk perbaikan. Abstract . Information System of Informatic engineegring UMM contains activities related to academics. Based on the results of observations using a questionnaire distributed to 30 respondents to UMM Informatics Engineering active students, from the fourth statement that 23 people expressed doubts the data contained in the system is not up-to-date information and rarely updated. Then interactions are carried out such as submitting information about class schedules, session schedules, events and other information delivered through the Facebook group. With these problems, the researcher uses the User Centered Design (UCD) method in designing academic prototypes by utilizing the opinions of users, as well as the patterns and behavior of users can produce maximum user interface and functionality and have usability value. In addition, the Heuristic Evaluation method is used to evaluate the design and assess the system. To find deficiencies early before they are implemented, reduce subsequent usability errors that allow for more expenses for repairs.


2021 ◽  
Vol 10 (1) ◽  
pp. 69
Author(s):  
Ahmad Azizi ◽  
Mahmood Maniati ◽  
Hadis Ghanbari-Adivi ◽  
Zeinab Aghajari ◽  
Sedigheh Hashemi ◽  
...  

Introduction: There are various applications and health information systems which have been developed to promote the effective retrieval of patient information, statistics, research, and education. Therefore, there is a need to design them in consistency with scientific principles of usability. To this end, the usability of hospital information sub-systems employed at the hospitals of Ahvaz were compared using heuristic evaluation method. The objective of the study was to assess the usability of hospital information system according to heuristic evaluation.Material and Methods: Six trained evaluators, independently determined the ADT subsystem, HIM subsystem, and NIS according to Nielsen’s 10 Heuristic Principles. Since more than half of the hospitals (about 54%) employed Sib application, no specific sampling method was used. After combining the usability problems, the average severity ratings of the problems were calculated, and then the subsystems were compared.Results: The number of the usability problems of the ADT information subsystem, HIM subsystem, and NIS were 40, 39, and 37, respectively. After merging the problems, the features of “user control and freedom” with 20 cases and “flexibility and efficiency of use” with six cases had the highest and the lowest inconsistencies with usability principles. The average severity ratings of the problems also varied between 1.7 and 3.Conclusion: Heuristic evaluation method is regarded as one of the approaches appropriate to identify usability problems in health information systems. Thus, it is advisable to utilize this method to modify the design of the systems and to improve their efficiency before their implementation in order to increase user satisfaction.


Author(s):  
Anjana Ramkumar ◽  
Yu Song ◽  
Wiro J. Niessen ◽  
Pieter Jan Stappers

Findings from previous literatures, ethnography studies and interviews showed that radiotherapy contouring interfaces are very complex, requiring many human-computer interactions (HCI). In this paper we used observational, heuristic evaluation, think aloud and NASA-TLX methods to 1) analyse the workflow of radiotherapy segmentation systems; 2) discover possible usability and HCI design issues of current segmentation systems in order to identify the requirements for future interface design; and 3) explore the abilities and limitations of various evaluation methods. From the results it can be seen that observational and think aloud methods were very useful in identifying the workflow of different systems. The heuristic evaluation method uncovered more general usability issues with the interface design. The think aloud method identified more HCI issues compared to general usability issues. From the NASA-TLX, it can be seen that the workload level of system C is higher in almost all the categories. Using the four different methods this study identified several usability and HCI issues and have proposed seven main requirements which might be considered in our future studies.


Author(s):  
Amalia Ratna Rahmaani ◽  
Muhammad Dzulfikar Fauzi ◽  
Sumarsono Son

Academic Information System (AIS) is a form of information technology in the form of software services in the education process including academic information. To get a good AIS services, it needs good governance, including IT support, service for IT users as well as continuity of care. Sunan Kalijaga UIN has adequate information technology support used in academic services for users. Audit SIA is needed to fit the IT governance framework and standards of Control Objectives for Information and Related Technology (COBIT). COBIT is standard because it is the most complete guide of best practices in IT management because it has a very good compromise in the breadth of coverage and detail of management's processes. Referring to one of the domains in COBIT is to Deliver and Support the domain that has the focus in his ministry. This study has implemented almost all IT activities and has a maturity level of 2.56, which means IT Academic Information System is approaching Defined Process management. This suggests that the activities of the Deliver and Support domain have been applied, but have not had formal procedures in writing and well documented.


2020 ◽  
Vol 3 (2) ◽  
pp. 119-123
Author(s):  
Nur Aeni Hidayah ◽  
Elvi Fetrina ◽  
Alvali Zaqi Taufan

As concrete steps in order to realize the vision and mission of an organization or educational institution is to implement the system of academic information. The one factor that influences the success of the academic information system is the satisfaction of users.  The problems in the user satisfaction are also issues that cannot be denied and continue to be studied. In consequently, having measurements related to user satisfaction is required. This research is done to see how the user satisfaction of the existing system has been implemented and to know what factorshas influenced the system. The method used in this study is a quantitative method using the End User Computing Satisfaction (EUCS) model whereas 255 respondents are chosen as the sample for the study. The purposive sampling technique is usedand the PLS-SEM approach with tools Smart PLS 3.0 is used for analyzing the data.  This research consists of 7 hypotheses and 8 variables, namely Content, Accuracy, Format, Timeliness, Ease of Use, System Reliability, System Speed and End-User Satisfaction. The research finds out that the current level of end-user satisfaction is in satisfied level. Inferentially, of the 7 hypotheses tested, 2 of them were rejected and the other 5; Accuracy, System Reliability, Timeliness, Content and System Spee;are accepted.Through this research, it is hoped that later it could be used as a practical consideration and theoretical study in thefuture.


2018 ◽  
Vol 9 (2) ◽  
Author(s):  
Dafid Dafid

<p class="SammaryHeader" align="center"><strong><em>Abstract</em></strong></p><p><em> </em><em>Academic Information System is an online and interactive learning information system owned by universities. Its function is very important to support the academic activities and to improve the quality of teaching and learning. Excelllent educational services which good quality and easy to use can be reached by improving the quality of the learning web. In an effort to optimize the contribution of information technology and ensure the web services that have been provided are appropriate, it is necessary to know the level of service provided to improve quality. This research was conducted using the IPA method (Importance-Performance Analysis) which is used to measure the level of user satisfaction with the services provided and using the WebQual method to measure the quality of the learning web used. Data collection is done by conducting a questionnaire on STMIK XYZ Palembang students by giving 2 questions. Measurements are made by comparing the value between performance and importance of the assessment variable. The results showed that the quality of the SIA Simponi STMIK XYZ had not met the expectations of the users, so it was necessary for the manager to improve the services provided for all dimensions, namely usability (U), information quality (I), interaction quality (A) especially for variables which is included in  fourth quadrant.</em></p><p><strong><em>Keyword : </em></strong><em>Academic Information System, WebQual, Importance-Performance Analysis</em></p><p class="SammaryHeader" align="center"><strong><em>Abstrak</em></strong></p><p><em>Sistem Informasi Akademik merupakan sistem informasi pembelajaran online dan interaktif yang dimiliki oleh perguruan tinggi. Fungsinya sangat penting untuk mendukung kelancaran kegiatan akademik maupun peningkatan kualitas belajar mengajar. Layanan  pendidikan yang berkualitas secara fungsionalitas maupun yang mudah dalam penggunaan dapat dilakukan melalui perbaikan dan peningkatan kualitas web pembelajaran. Dalam usaha mengoptimalkan kontribusi teknologi informasi dan memastikan layanan web yang telah diberikan telah sesuai maka perlu diketahui tingkat layanan yang diberikan guna peningkatan kualitas. Penelitian ini dilakukan dengan menggunakan metode IPA (Importance-Performance Analysis) yang digunakan untuk mengukur tingkat kepuasan pengguna atas layanan yang diberikan serta menggunakan metode WebQual untuk mengukur kualitas dari web pembelajaran yang digunakan. Pengumpulan data dilakukan dengan melakukan kuesioner terhadap mahasiswa STMIK XYZ Palembang dengan memberikan 2bentuk pertanyaan. Pengukuran dilakukan dengan membandingkan nilai antara performance dengan importance dari variabel penilaian. Hasil penelitian menunjukkan bahwa </em><em>kualitas SIA Simponi STMIK XYZ belum memenuhi harapan dari pengguna sehingga perlu upaya dari pihak pengelola untuk memperbaiki layanan yang diberikan untuk semua dimensi yang ada yaitu </em><em>usability(U), information quality(I), interaction quality(A) terutama untuk variabel-vararibel yang termasuk dalam kuadran empat</em></p><strong><em>Kata kunci : </em></strong><em>Sistem Informasi Akademik, WebQual, Importance-Performance Analysis</em>


2019 ◽  
Vol 3 (4) ◽  
pp. 391
Author(s):  
Murdiaty Murdiaty ◽  
Angela Angela ◽  
Chatrine Sylvia

Evaluation of interface design is part of human and computer interaction (HCI-Human Computer Interaction). The focus of this study is to conduct heuristic evaluations on the interface design of an academic portal to determine the extent to which the academic portal meets the concept of usability. Academic portal is a website accessed by academics through a web browser. This portal can be accessed by students, lecturers, academic supervisors, Final Project supervisors, and other academics such as: Academic Administration Section (BAA), Study Programs, Libraries, Student Affairs, and Public Administration and Personnel Section (BAUK). This study uses heuristic evaluation as an approach in evaluating a human-machine system (man-machine system) in relation to academic portal ease of use (usability) and also severity ratings in addition to heuristic checklist.  This study involved several evaluators who would conduct an assessment by filling in the heuristic checklist. The expected results with the evaluator's heuristic evaluation method found usability problems related to the general interface. These results are expected to be used by Mikroskil's academic portal system developers to make improvements to the academic portal currently in use


Author(s):  
Sahara Ramadhan ◽  
Nadya Safitri

Abstrak: Sistem Informasi Akademik membantu kegiatan pengelolaan atau pengadministrasian berbagai kegiatan dalam rangka terselenggaranya proses belajar mengajar yang efektif dan efisien di suatu Lembaga Pendidikan tinggi. Universitas Bina Insani telah menerapkan Sistem Informasi Akademik selama lebih dari dua tahun. Namun pada kenyataanya sistem tersebut memiliki beberapa masalah terhadap pengunaannya. Agar suatu sistem informasi dapat berjalan dengan optimal sesuai dengan keperluan penggunanya, maka perlu adanya evaluasi terhadap sistem informasi. Evaluasi ini menggunakan metode DeLone & McLean (2003) dengan 4 variabel yaitu kualitas sistem, kualitas informasi, kualitas layanan dan kepuasan pengguna. Populasi pada penelitian ini adalah Mahasiswa dan dosen fakultas informatika serta bagian akademik dan bagian Pendidikan dengan jumlah sampel yang digunakan sebanyak 92 responden. Instrumen penelitian menggunakan kuesioner online. Adapun metode analisis yang digunakan Partial Least Square (PLS) dengan menggunakan software SmartPLS. Hasil analisis ini adalah diterimanya tiga dari tiga hipotesis yang diuji. Sehingga hasil tersebut menunjukan kualitas sistem mempunyai pengaruh yang positif dan signifikan terhadap kepuasan pengguna dengan nilai koefisiensi jalur sebesar 0,407 dan t-statistic sebesar 4,699, kualitas informasi mempunyai pengaruh yang positif dan signifikan terhadap kepuasan pengguna dengan nilai koefisiensi jalur sebesar 0,336 dan t-statistic sebesar 2,782 sedangkan kualitas layanan berpengaruh positif tetapi tidak signifikan terhadap kepuasan pengguna dengan nilai koefisiensi jalur sebesar 0,206 dan t-statistic sebesar 1,898. Dengan demikian, Penelitian ini menunjukan bahwa Sistem Informasi Akademik yang telah diterapkan di Universitas Bina Insani dapat dikatakan sukses dalam memberikan manfaat yang baik terhadap penggunanya.     Kata kunci: Sistem Informasi Akademik, DeLone & McLean, SmartPLS, PLS   Abstract: The Academic Information System assists activities in the management or administration of various activities in the context of implementing an effective and efficient teaching and learning process in a higher education institution. Bina Insani University has implemented an Academic Information System for more than two years. However, in fact the system has several problems with its use. In order for an information system to run optimally according to the needs of its users, it is necessary to evaluate the information system. This evaluation uses the DeLone & McLean (2003) method with 4 variables, system quality, information quality, service quality and user satisfaction. The population in this study were students and lecturers of the faculty of informatics as well as the academic and education sections with a total sample size of 92 respondents. The research instrument used an online questionnaire. The analysis method used is Partial Least Square (PLS) using the SmartPLS software. The result of this analysis is the acceptance of three of the three hypotheses tested. So that these results indicate the quality of the system has a positive and significant effect on user satisfaction with a path coefficient value of 0.407 and a t-statistic of 4.699, information quality has a positive and significant impact on user satisfaction with a path coefficient value of 0.336 and a t-statistic of 2,782 while service quality has a positive but insignificant effect on user satisfaction with a path coefficient value of 0.206 and a t-statistic of 1.898. Thus, this study shows that the Academic Information System that has been implemented at Bina Insani University can be said to be successful in providing good benefits to its users.     Keywords: Academic Information Systems, DeLone & McLean, SmartPLS, PLS


JOUTICA ◽  
2019 ◽  
Vol 4 (1) ◽  
pp. 168
Author(s):  
Yusi Tyroni Mursityo ◽  
M. Chandra Saputra ◽  
Admaja Dwi Herlambang

Education services from tertiary institutions have applied a lot of the Academic Information System (SIAKAD). In the research on heuristic evaluation in the Academic Information System of Brawijaya University, there were several problems related to users, including problems in the ease of users to interact or use applications, SIAKAD Desktop which did not provide information to the user about the condition of a process within a certain time period or time. On the other hand, universities must guarantee the best service. Therefore, it is necessary to evaluate the acceptance of SIAKAD Desktop users to find out what factors can affect the use of Desktop SIAKAD. UTAUT as a theoretical model will be used to explore the acceptance and use of the technological environment, especially for SIAKAD users in the academic section of the Faculty of Computer Science, Universitas Brawijaya. The data that has been collected will then be analyzed using the Partial Least Square Sequence Equation Modeling (PLS SEM) method. The results of the analysis show that only the conditions of the facilities significantly influence the behavior of using SIAKAD Desktop. The UTAUT model can only explain 44.8% of the factor variants using SIAKAD Desktop which is included in the moderate category. Therefore, it is necessary to develop a research model construct construct so that the prediction of the variance accuracy of the research model increases. In addition, it is expected that further research can cover a wider population target so that data is more reliable.


Sign in / Sign up

Export Citation Format

Share Document