scholarly journals Evaluasi Usability Sistem Informasi Prakerin Pendidikan Teknik Informatika di Universitas Pendidikan Ganesha dengan Metode Usability Testing

Author(s):  
Made Adhi Widya Sadnyana . ◽  
I Gede Mahendra Darmawiguna, S.Kom, M.Sc . ◽  
I Made Ardwi Pradnyana, S.T., M.T. .

Penelitian ini bertujuan mengetahui bagaimana evaluasi Sistem Informasi Prakerin Pendidikan Teknik Inforamatika (PTI) dari segi kegunaanya, keefektivan, keefisienan, dan kepuasan pengguna dalam menggunakan Sistem Informasi Prakerin PTI. Penelitian ini menggunakan metode usability testing. Sampel dalam penelitian ini mahasiswa dan dosen PTI sebanyak 6 orang. Pengumpulan data menggunakan teknik Performance Measurement dan Retrospective Think Aloud (RTA). Dengan teknik tersebut akan dicari hasil data kuantitatif dan kualitatifnya. Penelitian ini juga menggunakan kuisioner Sistem Usability Scale (SUS) untuk mengukur kepuasan penggunanya. Hasil penelitian diperoleh 1.Sistem Informasi Prakerin PTI masih belum efektif. Karena masih ada error yang dilakukan responden mahasiswa atau dosen dalam melaksanakan tugas yang diberikan. 2.Sistem Informasi Praekrin PTI dilihat dari hasil penghitungan waktu pelaksanaan tugas antara responden pemula atau mahir tidak terdapat perbedaan yang signifikan. Jadi Sistem Informasi Prakerin PTI bisa dikatakan efisien. 3.Dalam kepuasan pengguna sistem Informasi Prakerin PTI masih kurang. Dari hasil rekapitulasi kuisioner SUS yang didapat dihitung dengan menggunakan berbandingan Mann Whitney U-Test hasilnya adalah untuk responden mahasiswa 62,08 dan responden dosen 60,42. Karena masih lebih kecil dari 68 responden dikatakan belum puas. 4.Rekomendasi yang diberikan responden yaitu perlu ditambah menu data diri, halaman ubah password, dan dalam form isi nilai ditambahkan keterangan nilai yang harus diisi.Kata Kunci : Survei, Sistem Informasi Prakerin PTI, Performance Measurement, RTA, Efektivitas, Efisiensi, Kepuasan pengguna, Rekomendasi This research aims to find out how evaluation Information System Prakerin Educational Engineering Inforamatika (PTI) in terms of usability, effectiveness, efficiency, and user satisfaction in using Information Systems Prakerin PTI. This research uses usability testing method. Samples in this study of students and lecturers of PTI as many as 6 people. Data collection using Performance Measurement and Retrospective. Think Aloud (RTA) techniques. With these techniques will be searched the results of quantitative and qualitative data. This study also used a questionnaire System Usability Scale (SUS) to measure user satisfaction. The results obtained 1. Information System Prakerin PTI still not effective. Because there are still errors made by the student or lecturer respondents in carrying out the given task. 2. Information System Prakerin PTI seen from the results of timing execution of tasks between the beginner or advanced respondents there is no significant difference. So Information System Prakerin PTI can be said to be efficient. 3.In the user satisfaction System Information Prakerin PTI still less. From the result of recapitulation of SUS questionnaire which was obtained was calculated by using Mann Whitney U-Test result was for student respondent 62,08 and lecturer respondent 60,42. Because it is still smaller than 68 respondents said not satisfied. 4.Recommendation given by the respondent that is necessary to add the menu of self data, change the password page, and in the form of the value, added value information to be filled.keyword : Survey, Information System Prakerin PTI, Performance Measurement, RTA, Effectiveness, Efficiency, User Satisfaction, Reccomnedations

Author(s):  
Ni Luh Putu Ratih Indriyani ◽  
Gede Rasben Dantes ◽  
Kadek Yota Ernanda Aryanto

This research is aimed to determine the results of the usability analysis from the website Sekolah Tinggi Pariwisata (STIPAR) Triatma Jaya viewed from the user side as well as knowing the recommendation of website improvement of Sekolah Tinggi Pariwisata (STIPAR) Triatma Jaya from usability aspect. The methods used are Usability Testing of Performance Measurement and Retrospective Think Aloud (RTA) techniques and the dissemination of SUS questionnaires.  The results showed that the Sekolah Tinggi Pariwisata (STIPAR) Triatma Jaya still not effective, it is seen from the error or mistake made by users of lecturers and students while doing the task. Statistically website Sekolah Tinggi Pariwisata (STIPAR) Triatma Jaya has been efficient for lecture but not efficient for college students users. For lecturers there are 6 out of 10 tasks that do not have significant time difference, while for  college students there are 4 out of 10 tasks that do not have significant time difference. From the aspect of user satisfaction, both lecturers and college students feel still less satisfied using the website of Sekolah Tinggi Pariwisata (STIPAR) Triatma Jaya, this can be seen from the SUS questionnaire scores of lecturers of 63.28 and college students users of 58.44. Based on the analysis result, it can be concluded that the Sekolah Tinggi Pariwisata (STIPAR) Triatma Jaya has not fulfilled the criteria of products that have good usability, because the three aspects (effectiveness, efficiency and user satisfaction) have not been met. Based on the above, the recommendation of Sekolah Tinggi Pariwisata (STIPAR) Triatma Jaya website is focused on adjustment of display, language and term change, feature addition, menu name adjustment, menu structure and menu layout, content addition and menu simplification. Repairs done by making wireframe recommendation page Sekolah Tinggi Pariwisata (STIPAR) Triatma Jaya.


Author(s):  
Dewa Ayu Putu Ari Widhiani ◽  
I Ketut Resika Arthana ◽  
I Made Ardwi Pradnyana

Penelitian ini bertujuan untuk mengetahui tingkat kepuasan pengguna dan mengevaluasi SIAK Undiksha ditinjau dari pengguna mahasiswa menggunakan metode Usability Testing dengan teknik Firstclick Usability Testing, Performance Measurement, Retrospective Think Aloud (RTA), kuisoner System Usability Scale (SUS) serta memberikan rekomendasi perbaikan terhadap sistem tersebut berdasarkan atas hasil penelitian. Ada beberapa aspek yang dikaji dalam penelitian ini yaitu efektivitas (effectiveness), efisiensi (efficiency), tingkat kesalahan (error), dan kepuasan pengguna (satisfaction) menggunakan SIAK Undiksha ditinjau dari pengguna mahasiswa.Populasi dari penelitian ini yaitu mahasiswa Undiksha dengan melibatkan 385 responden kuisioner SUS dan 20 orang responden usability testing. Hasil penelitian berdasarkan analisis Mann Whitney U-test dan SUS menunjukkan bahwa (1) SIAK Undiksha ditinjau dari pengguna mahasiswa sudah efektif akan tetapi masih terdapat beberapa error yang ditemukan dalam sistem, (2) SIAK Undiksha ditinjau dari pengguna mahasiswa sudah efisien dilihat dari tidak adanya perbedaan yang signifikan waktu pengerjaan tugas kelompok mahir dan kelompok pemula, dan (3) Pengguna merasa kurang puas menggunakan SIAK Undiksha ditinjau dari pengguna mahasiswa dilihat dari skor kuisioner SUS sebesar 61,6.Dengan demikian berdasarkan hasil analisis data tersebut disimpulkan bahwa SIAK Undiksha ditinjau dari pengguna mahasiswa sudah memenuhi kriteria usability baik akan tetapi pengguna belum puas  saat menggunakan SIAK Undiksha ditinjau dari pengguna mahasiswa. Hal ini dapat dilihat pada penilaian tingkat efektivitas, efisiensi, tingkat kesalahan dan kepuasan pengguna, SIAK Undiksha ditinjau dari pengguna tersebut hanya berhasil memenuhi 2 dari 4 aspek. Oleh sebab itu, rekomendasi perbaikan dalam penelitian ini difokuskan untuk mengubah tata letak (layout) halaman dan menu navigasi sesuai hasil data penyebab kesalahan (error) pengguna dan menyederhanakan penggunaa Bahasa. Perbaikan dilakukan dengan membuat wireframe halaman utama SIAK Undiksha itinjau dari pengguna mahasiswa, halaman menu prosedur, halaman submenu biodata, halaman ubah biodata, halaman statistic nilai mahasiswa dan halaman cetak kartu rencana studi.


2020 ◽  
Author(s):  
Katherine L. Dauber-Decker ◽  
Melissa Basile ◽  
D'Arcy King ◽  
Jennifer Polo ◽  
Karina Calise ◽  
...  

BACKGROUND Cystic fibrosis (CF) is a life-limiting genetic disease that causes chronic lung infections. We developed an internet-based decision aid (decision aid) to help CF patients make better informed decisions regarding treatments and advance care planning (ACP). We built the decision aid around two major treatment decisions: whether or not to have a lung transplant, and whether or not to agree to intubation. OBJECTIVE To present results from iterative usability testing of the InformedChoices Cystic Fibrosis advance care planning decision aid among adults with cystic fibrosis, their clinicians and family caregivers. METHODS We performed a patient needs assessment and “think aloud” usability testing with CF patients, their surrogates, and clinicians caring for CF patients. “Think aloud” participants provided feedback while navigating the decision aid and answered surveys. Session transcripts and survey results were categorized into common, generalizable themes and optimizations for improving content, comprehension, and navigation. RESULTS Participants gave the decision aid an average System Usability Scale (SUS) score of 88.33 (“excellent”). Comments were coded into three themes: Functionality, Visibility and Navigation, and Content and Usefulness. Areas for improvement included reducing repetition, enhancing comprehension, and changing the flow. CONCLUSIONS Usability testing revealed areas for potential improvement. Testing also yielded positive feedback, suggesting the decision aid’s future success.Integrating changes prior to implementation should improve the decision aid’s comprehension, navigation, and usefulness, and lead to greater adoption.


2018 ◽  
Vol 4 (2) ◽  
Author(s):  
A.A. Gede Yudhi Paramartha ◽  
I Gede Partha Sindu ◽  
Agus Aan Jiwa Permana

ABSTRACT<br />The development of electronic learning materials requires various applications that are used to support electronic learning. The lecturer makes the material by utilizing a document processing application to create learning material, using a search engine to obtain teaching materials, and a Learning Management System to publish learning material. This causes the lecturer to have to move to one application to another application. In previous research, to overcome these problems, an add-ins was developed in Microsoft Office PowerPoint that integrates Learning Management Systems as a media for publishing learning materials, and Material Reconstruction System as a source of reusable teaching materials by utilizing the search engines provided. These add-ins function as an intermediary between the two systems with Microsoft PowerPoint, so users only need to use one application to develop learning material and publish it to e-learning. In this study, the add-ins that have been developed are tested using the usability testing method. Usability testing is done to determine the level of user satisfaction in using the add-ins and obtain feedback for system improvements. The method used is Retrospective Think Aloud method to obtain feedback from users, and the System Usability Scale to determine the level of user satisfaction in using the add-ins. The results showed that users were satisfied with the add-ins that had been developed. in addition, feedback from users was also successfully obtained and recommendations for add-ins improvements were made based on these recommendations.<br />Keywords : Learning Management System, Office Add-ins, Usability Testing<br />ABSTRAK<br />Pengembangan materi pembelajaran elektronik membutuhkan berbagai aplikasi yang digunakan untuk mendukung pembelajaran elektronik. Dosen membuat materi dengan memanfaatkan aplikasi pengolah dokumen untuk membuat materi, menggunakan mesin pencari untuk memperoleh bahan ajar, dan Sistem Manajemen Pembelajaran untuk mempublikasikan materi pembelajaran. Hal ini menyebabkan dosen harus berpindah ke satu aplikasi ke aplikasi yang lain. Pada penelitian sebelumnya, untuk mengatasi permasalahan tersebut, dikembangkan sebuah add-ins di Microsoft Office PowerPoint yang mengintegrasikan Sistem Manajemen Pembelajaran sebagai media publikasi materi pembelajaran, dan Sistem Rekonstruksi Materi sebagai sumber bahan ajar dengan memanfaatkan mesin pencari yang disediakan. Add-ins tersebut berfungsi sebagai perantara antar kedua sistem tersebut dengan Microsoft PowerPoint, sehingga pengguna hanya perlu menggunakan satu aplikasi untuk mengembangkan materi pembelajaran hingga mempublikasikan materi tersebut ke e-learning. Pada penelitian ini, add-ins yang telah dikembangkan diuji dengan menggunakan metode usability testing. Usability testing dilakukan untuk mengetahui tingkat kepuasan pengguna dalam menggunakan add-ins dan memperoleh umpan balik untuk perbaikan sistem. Metode yang digunakan adalah metode Retrospective Think Aloud (RTA) untuk memperoleh dari pengguna, dan System Usability Scale (SUS) untuk mengetahui tingkat kepuasan pengguna dalam menggunakan add-ins. Hasil penelitian menunjukkan bahwa pengguna merasa puas dengan add-ins yang telah dikembangkan. selain itu, umpan balik dari pengguna juga berhasil diperoleh dan dibuatkan rekomendasi perbaikan berdasarkan rekomendasi tersebut.<br />Kata kunci: Sistem Manajemen Pembelajaran, Office Add-ins, Usability Testing


2021 ◽  
Vol 14 (1) ◽  
pp. 47
Author(s):  
M. Alfaliansyah ◽  
Maswadi Maswadi

The particular problem of coconut in Kubu Raya Regency is the ongoing partnership with suppliers to meet dynamic market changes that have not been well established. Supply chain management has become an important matter in the coconut industry in Kubu Raya Regency. Measurement of the performance of the coconut industry supply chain in order to optimize the performance of the coconut supply chain in Kubu Raya Regency, so that the realization of an efficient and effective coconut supply chain. Measurement of added value is done using the Hayami method and performance measurement is done by the SCOR method. The result of value added analysis shows that the added value of coconut in the farmer level is 758 rupiah / fruit. Analysis of supply performance using the SCOR method shows the performance of each member of the supply chain. Farmers have a 72.3% performance value included in the category below average. Traders and collectors obtained a performance value of 55.7% included in the Poor category.


2021 ◽  
Vol 2 (2) ◽  
pp. 146-158
Author(s):  
Rahmat Novrianda Dasmen ◽  
◽  
Fatoni Fatoni ◽  
Alek Wijaya ◽  
Baibul Tujni ◽  
...  

System Usability Scale (SUS) is a usability testing technique for a simple system using a Likert scale. Testing and usability analysis assess user satisfaction with the system or web. So, the purpose of this service activity is to train website usability testing with SUS, using the Dukcapil website as a test object. Dukcapil's website will be analyzed for its usability level as a real case for direct practice. In SUS, ten statements are used as parameters in assessing the usability of a website. This activity was attended by 20 people, including Bina Darma University students, vocational students, and IT staff from the Dukcapil Palembang City. The usability analysis of this website aims to assess how well user interaction with the website is going. Then, the results of this assessment and study produce an input as a reference for website development to be more optimal in the future. In testing the usefulness of the Dukcapil website in this PKM activity, it can be seen that the SUS score is at a score of 56.125, with the category Acceptable. Therefore, it shows that the Dukcapil website is ranked F, with a "Good" rating category. The training results show that the Dukcapil website is still very rarely accessed by users. Because it provides information lacking in updates, the features used are still in the beta version (still in the testing phase). Users or participants still do not understand how to use it. In addition, this activity provides participants with an understanding of the website usability test using the SUS model.


2019 ◽  
Vol 16 (1) ◽  
pp. 65
Author(s):  
Kadek Widya Antari ◽  
Resika Arthana ◽  
Nyoman Sugihartini

Undiksha has several systems incorporated in e-ganesha, including the Lecturer Database Information System (PDD) and the Undiksha Performance System. This system is used for accessibility of lecturer data and for recording lecturer performance in the implementation of Tri Dharma College. The objectives of this study were (1) to determine the level of usability in Lecturer Database Information System and Undiksha Lecturer Performance Using the Questionnaire and Field Observation Method (2) to find out the recommendations of Lecturer Database Information System and Undiksha Lecturer Performance to increase user satisfaction based on results from the research that will be conducted. The variables measured in this study are effectiveness, efficiency, and user satisfaction. With the Field Observation method to measure aspects of Effectiveness and efficiency, the SUS questionnaire was used to measure aspects of user satisfaction. The sample used was 25 respondents of PNS lecturers who were still active. The results of usability testing on the Undiksha PDD system show that (1) the system is still not effective with an average task completion of 64.96%, (2) the system is not efficient because the user is still confused with the PDD Undiksha system (3) the user is not satisfied using the PDD Undiksha system seen from the results of the SUS questionnaire which is 61.6% less than the SUS standard which is 68%. The results of usability testing in the Undiksha Performance system show that (1) the system has not been effective with an average task completion of 60.16%, (2) The system has not been efficient because many users have not been smooth and still confused using the Undiksha Performance system (3) Users not satisfied with using the system seen from the results of SUS which is 61.5%. Recommendations for improvements provided are derived from the results of video analysis using observation sheets on field observation methods, HCI theory and 8 golden rules, and expert tests and expert input have been carried out.


2002 ◽  
Vol 26 (4) ◽  
pp. 395-406 ◽  
Author(s):  
Kee-Sook Lim

This study evaluated the relationships between three personal characteristics on computer attitude and user satisfaction. The three personal characteristics tested were gender, computer experience, and overall academic performance. Survey results revealed that computer experience and gender make a significant difference in the computer attitude of the respondents. However, the three personal characteristics did not make a significant difference in academic computer system user satisfaction. Also found is a significant moderating effect of the three personal characteristics on the relationship between computer attitude and user satisfaction. Women, those with moderate computer experience, and those with low academic performance tend to show stronger relationships between computer attitude and computer user information system satisfaction than their counterparts.


Author(s):  
Ni Luh Putri Ari Wedayanti ◽  
Ni Kadek Ayu Wirdiani ◽  
I Ketut Adi Purnawan

Tingkat usability dapat mempengaruhi kemudahan penggunaan suatu aplikasi termasuk aplikasi mobile, sehingga penting untuk dilakukanya evaluasi. Aplikasi Simalu merupakan sebuah aplikasi lokal Bali yang bergerak dalam bidang kebersihan lingkungan. Simalu tergolong aplikasi baru karena dirilis pada awal bulan Januari tahun 2018 dan belum pernah dilakukan evaluasi usability sebelumnya. Evaluasi usability dilakukan untuk meningkatkan User Experience pengguna, sehingga aplikasi dapat diterima dan digunakan lebih mudah oleh pengguna. Metode yang digunakan untuk melakukan evaluasi yaitu usability testing dengan teknik Retrospective Think Aloud dan Performance Measurement. Hasil yang didapatkan adalah aplikasi Simalu memiliki kualitas yang belum dapat dikatakan efektif, efisien dan memenuhi kepuasan pengguna, sehingga perbaikan desain juga dilakukan agar aplikasi lebih baik lagi untuk memenuhi harapan pengguna. Kata kunci: Aplikasi Simalu, Evaluasi Usability, User Experience, Usability Testing, Retrospective Think Aloud, Performance Measurement.


2002 ◽  
Vol 31 (4) ◽  
pp. 543-557 ◽  
Author(s):  
Wesley O. Hagood ◽  
Lee Friedman

One of the most significant challenges faced by public personnel executives today is measuring the performance of their human resources information system (HRIS) in order to justify the value-added contribution of the HRIS to accomplishing the organization's mission. Over the last year, the CIA developed and implemented a balanced scorecard-based performance measurement system for its HRIS to justify cost and highlight the effectiveness of the system. The HRIS Program Director, Patricia Minard, used the Kaplan-Norton balanced scorecard framework to identify and align the organization's goals, objectives, and measures; to gather baseline data to measure against established measurement targets; and to measure and demonstrate the value-added contribution of the HRIS.


Sign in / Sign up

Export Citation Format

Share Document