Usability Testing Sesuai Dengan ISO 9241-11 Pada Sistem Informasi Program Pengalaman Lapangan Universitas Pendidikan Ganesha Ditinjau Dari Pengguna Mahasiswa

Sistem Informasi Program Pengalaman Lapangan (SI PPL) Undiksha adalah salah satu sistem informasi yang telah diterapkan untuk mendukung kegiatan PPL Real di Undiksha. Penelitian ini bertujuan untuk mengevaluasi SI PPL Undiksha serta dapat memberikan rekomendasi perbaikan atas sistem tersebut berdasarkan hasil evaluasi usability yang merujuk pada ISO 9241-11 yang ditinjau dari pengguna mahasiswa. Jenis penelitian ini adalah penelitian survei berbasis pengguna. Metode yang digunakan adalah metode usability testing dengan teknik wawancara untuk mendapatkan data awal, atribut efektifitas dan atribut efisiensi diukur menggunakan teknik Performance Measurementuntuk mengumpulkan data kuantitatif , serta atribut kepuasan diukur menggunakan teknik Restropective Think Alouduntuk mengumpulkan data kualitatif, dan kuesioner SUS. Hasil rekomendasi akan berpedoman pada 8 aturan emas untuk memperoleh desain interface yang efektif sehingga dapat mengoptimalkan perbaikan SI PPL Undiksha. Jumlah sampel yang ditentukan pada penelitian ini sebanyak 10 orang mahasiswa FTK di Undiksha angkatan 2015 yang berpotensi menggunakan SI PPL Undiksha. Undiksha Field Experience Program Information System (SI PPL) is one of the information systems that has been implemented to support Real PPL activities at Undiksha. This study aims to evaluate the SI PPL Undiksha and can provide recommendations for improvements to the system based on the results of usability evaluation that refers to ISO 9241-11 which is reviewed by student users. This type of research is user-based survey research. The method used is the usability testing method with interview techniques to obtain initial data, attributes of effectiveness and efficiency attributes were measured using Performance Measurement techniques to collect quantitative data, and satisfaction attributes were measured using Think Aloud's Restropective technique to collect qualitative data, and SUS questionnaires. The recommendation results will be guided by 8 golden rules to obtain an effective interface design so as to optimize the improvement of the Undiksha SI PPL. The number of samples determined in this study were 10 FTK students at the 2015 Undiksha who had the potential to use the Undiksha SI PPL.

Download Full-text

Pengaruh Penerapan Invitation Dialog pada Online Course

Jurnal SAINTEKOM ◽

10.33020/saintekom.v7i2.43 ◽

2017 ◽

Vol 7 (2) ◽

pp. 174

Author(s):

Elia Zakharia

Keyword(s):

Data Analysis ◽

Data Collection ◽

Interface Design ◽

Usability Testing ◽

Good Effect ◽

Online Course ◽

Requirement Analysis ◽

Test Results ◽

Effectiveness And Efficiency ◽

Open Application

Invitation is a helpful hint, usually shown first when user open application or form. The form of invitation implementation is very diverse, and one of them is invitation dialog. The purpose of this study is to measure the effect of invitation dialog implementation on online course, in terms of usability (effectiveness and efficiency).Methods to achieve the purpose of this study consisted of five stages, namely requirement analysis of invitation dialog interface, design the interface, construct the prototype, usability testing and data collection, last data analysis and interpretation.Based on the test results from 32 Universitas Atma Jaya Yogyakarta (UAJY) students, implementation of invitation dialog affects the effectiveness of online course usage 93.75%, and efficiency 56.603%. Invitation dialog on the online course has a good effect on efficiency, but it does not have a significant impact on efficiency.

Download Full-text

TESTING METHOD FOR EVALUATING ACADEMIC ACHIEVEMENTS OF STUDENTS WITH OOP IN INCLUSIVE EDUCATION

BULLETIN Series Psychology ◽

10.51889/2020-3.1728-7847.13 ◽

2020 ◽

Vol 64 (3) ◽

pp. 75-84

Author(s):

A. N. Autaeva ◽

◽

A. K. Satova ◽

L.A. Butabayeva ◽

S. T. Bulabayeva ◽

...

Keyword(s):

Inclusive Education ◽

Quantitative Data ◽

Qualitative Data ◽

Behavioral Responses ◽

Academic Achievements ◽

Testing Method ◽

Types Of Information ◽

Do So

Assessment is the process of collecting data to make decisions about students. It is crucial that this is done correctly, and that those who evaluate students do so with technical precision, accuracy, and integrity. A test is a pre-defined set of questions or tasks that are searched for predefined types of behavioral responses. Tests are especially useful because they allow each person tested to ask the same tasks and questions for the test. Because the tester identifies and evaluates behavior in a pre-defined and consistent way, they can compare the characteristics of several different test subjects. Tests provide two types of information - quantitative and qualitative. Quantitative data is the actual scores obtained from the test. Qualitative data consists of other observations made during the student's testing; they tell us whether the students achieved the grade. The article discusses the use of the testing method.

Download Full-text

PENGUJIAN USABILITY PADA SISTEM INFORMASI PANGKALAN DATA DOSEN DAN KINERJA DOSEN UNDIKSHA MENGGUNAKAN METODE QUESTIONNAIRE AND FIELD OBSERVATION

Jurnal Pendidikan Teknologi dan Kejuruan ◽

10.23887/jptk-undiksha.v16i1.16790 ◽

2019 ◽

Vol 16 (1) ◽

pp. 65

Author(s):

Kadek Widya Antari ◽

Resika Arthana ◽

Nyoman Sugihartini

Keyword(s):

Information System ◽

User Satisfaction ◽

Field Observation ◽

Usability Testing ◽

Task Completion ◽

Observation Methods ◽

Performance System ◽

Effectiveness And Efficiency ◽

Expert Input ◽

Observation Method

Undiksha has several systems incorporated in e-ganesha, including the Lecturer Database Information System (PDD) and the Undiksha Performance System. This system is used for accessibility of lecturer data and for recording lecturer performance in the implementation of Tri Dharma College. The objectives of this study were (1) to determine the level of usability in Lecturer Database Information System and Undiksha Lecturer Performance Using the Questionnaire and Field Observation Method (2) to find out the recommendations of Lecturer Database Information System and Undiksha Lecturer Performance to increase user satisfaction based on results from the research that will be conducted. The variables measured in this study are effectiveness, efficiency, and user satisfaction. With the Field Observation method to measure aspects of Effectiveness and efficiency, the SUS questionnaire was used to measure aspects of user satisfaction. The sample used was 25 respondents of PNS lecturers who were still active. The results of usability testing on the Undiksha PDD system show that (1) the system is still not effective with an average task completion of 64.96%, (2) the system is not efficient because the user is still confused with the PDD Undiksha system (3) the user is not satisfied using the PDD Undiksha system seen from the results of the SUS questionnaire which is 61.6% less than the SUS standard which is 68%. The results of usability testing in the Undiksha Performance system show that (1) the system has not been effective with an average task completion of 60.16%, (2) The system has not been efficient because many users have not been smooth and still confused using the Undiksha Performance system (3) Users not satisfied with using the system seen from the results of SUS which is 61.5%. Recommendations for improvements provided are derived from the results of video analysis using observation sheets on field observation methods, HCI theory and 8 golden rules, and expert tests and expert input have been carried out.

Download Full-text

PENINGKATAN KOMPETENSI GURU DALAM MENYUSUN SILABUS KURIKULUM 2013 MELALUI BINTEK PADA GURU PENDIDIKAN AGAMA HINDU DI GUGUS I KECAMATAN KINTAMANI KABUPATEN BANGLI TAHUN 2018

GUNA WIDYA: JURNAL PENDIDIKAN HINDU ◽

10.25078/gw.v6i1.860 ◽

2019 ◽

Vol 6 (1) ◽

pp. 16

Author(s):

I Wayan Miarta

Keyword(s):

Action Research ◽

Quantitative Data ◽

Qualitative Data ◽

Action Observation ◽

Descriptive Analysis ◽

Measurement Techniques ◽

Classroom Learning ◽

Learning Plan ◽

Planning Action

<em>The aims of this study is to improve teacher potential through Bimtek to compile the 2013 Curriculum Syllabus in Cluster 1 of Kintamani District, and Bangli Regency. This study was Regional School Action Research (PTSW) using two cycle designs and each cycle consists of four stages, namely: planning, action, observation, and reflection. In collecting the data, this study used measurement techniques, in the form of tests to obtain quantitative data. The observation sheet is used to obtain qualitative data. The data was analyzed by using descriptive analysis. There are 11 Hinduism Teachers, in Cluster 1 with less moderate and capable criteria. The teachers are ability to compile the syllabus as a classroom learning plan. The results showed that the quality of Hindu teachers in Cluster I gets enough title and the teacher who gets a good predicate is 45% so that the increase is 17% from enough to good. Furthermore, while the first cycle received a very good predicate as much as 18% in cycle 2 to 55% so that it experienced a 37% increase in the number of syllabus compilation from cycle I to cycle II. However, based on the result of this study was effective to achieve the target.</em>

Download Full-text

Analisis Usabilitas Sistem Informasi Perpustakaan (Sipus) Integrasi UGM

Berkala Ilmu Perpustakaan dan Informasi ◽

10.22146/bip.17288 ◽

2016 ◽

Vol 12 (2) ◽

pp. 104

Author(s):

Ikhwan Arif ◽

Budhi Santoso

Keyword(s):

Information System ◽

Statistical Method ◽

Quantitative Data ◽

Vocational School ◽

Assessment Criteria ◽

Iso Standard ◽

Usability Assessment ◽

Effectiveness And Efficiency ◽

Library Staff

It is important to assess usability of Integrated Library Information System (SIPUS) at UGM in order to find out whether the system that has been developed by the Central Library of UGM is useful and accepted by user libraries spread out within the campus. There are three criteria of usability assessment based on the standard of ISO 9241-11 (1998), i.e. efficiency, effectiveness, and satisfaction. This ISO standard is used because it has a series of assessment criteria relevant with the problems of SIPUS implementation at various libraries within UGM. The study was descriptive quantitative. Data collected during the study were analyzed using statistical method and interpreted. Population of the study were the librarians at UGM. Samples consisted of 30 librarians/library staff at faculty libraries, Central Library, the library of vocational school and Jakarta Campus. The result of analysis and discussion showed that usability, effectiveness and efficiency of integrated SIPUS implementation werevery high.

Download Full-text

PENERIMAAN MAHASISWA BARU BERBASIS WEBSITE PADA UNIVERSITAS KARYADARMA KUPANG

High Education of Organization Archive Quality: Jurnal Teknologi Informasi ◽

10.52972/hoaq.vol11no1.p6-10 ◽

2019 ◽

Vol 11 (1) ◽

pp. 6-10

Author(s):

Dina Maria ◽

Hildayanti Henuk

Keyword(s):

Information System ◽

Programming Language ◽

Usability Testing ◽

System Testing ◽

Web Based ◽

Testing Method ◽

Database Server ◽

The University ◽

New Student

New Student Admission Information System at Karyadarma University has not used a web-based information system. This information system is an information system used to facilitate the registration administration process so as to make it easier for the Admissions Committee at the University of Kupang Karyadarma. In developing the New Student Admission Information System using the Laravel framework method. This information system uses the PHP programming language and MYSQL database server. The system testing method uses blackbox and usability testing. The results of this study are a website-based New Student Admission Information System that can help the ongoing performance. The results of testing the software that was developed obtained a functionality value of 1 (Good), testing the usability aspect obtained results with a percentage of 94.66% (Very Eligible).

Download Full-text

Examination of General Competencies and Needs of Pre-School and Classroom Teacher Candidates in Terms of Assessment and Evaluation Course

Education Quarterly Reviews ◽

10.31014/aior.1993.04.02.213 ◽

2021 ◽

Vol 4 (2) ◽

Author(s):

Mustafa Yeler ◽

◽

Aytunga Oğuz ◽

Keyword(s):

Teacher Candidates ◽

Quantitative Data ◽

Qualitative Data ◽

Classroom Teacher ◽

Measurement Techniques ◽

University Education ◽

Research Approach ◽

Assessment And Evaluation ◽

Significant Difference ◽

Measurement And Evaluation

This study examines the general competencies and the requirements of classroom and preschool teacher candidates in terms of assessment and evaluation course. The study group consisted of 140 4th-year teacher candidates randomly selected from a total of 256 teacher candidates studying at Classroom Teaching and Preschool departments of Burdur Mehmet Akif Ersoy University Education Faculty, Turkey. In this study, a mixed research approach and a convergent design, in which quantitative and qualitative studies are used to support each other’s strengths, were used. To collect quantitative data, the “Measurement and Evaluation Common Competency Perception Scale for Teacher Candidates” (MECCPSTC), which was developed by Nartgün (2008), was used. The qualitative data of the study were obtained thorough the open-ended questions that were asked to 13 teacher candidates through focus group interview technique. In the analysis of the quantitative data, descriptive statistics, t-test and one-way ANAVO were used. Content analysis was used in the analysis of the qualitative data. The findings showed that approximately one fourth of the teacher candidates had the opinion that they were “sufficient and very sufficient” in terms of their learning in the assessment and evaluation course. The scores of three quarters of the teacher candidates obtained from the scale were at “moderate and very insufficient” interval. In addition, it was examined whether there was a significant difference between the scores of teacher candidates obtained from Basic concepts” (BC), “Measurement techniques” (MT), “Statistical analysis and Reporting” (SAT) dimensions, and total score of the scale in terms of age, gender, department and belief in appointment variables. The codes obtained from the analysis of qualitative data were grouped under themes. Each theme was arranged and interpreted in a table with the codes within the scope. The results obtained from the analysis of both quantitative and qualitative data were combined and discussed and recommendations were developed.

Download Full-text

Qualitative or Quantitative Data for Nuclear Control Room Usability Studies? A Pragmatic Approach to Data Collection and Presentation

Proceedings of the Human Factors and Ergonomics Society Annual Meeting ◽

10.1177/1541931218621380 ◽

2018 ◽

Vol 62 (1) ◽

pp. 1674-1678 ◽

Cited By ~ 3

Author(s):

Thomas A. Ulrich ◽

Ronald L. Boring ◽

Roger Lew

Keyword(s):

Interface Design ◽

Quantitative Data ◽

Qualitative Data ◽

Formative Evaluation ◽

Evaluation Study ◽

Control Room ◽

Human System ◽

Formative Stage ◽

Large Numbers ◽

Nuclear Control

Qualitative and quantitative approaches provide alternative, but often incompatible means to answer design questions during the early formative and later summative evaluation phases of the human-system interface design process. Human factors practitioners and researchers should identify which approach best addresses their particular research needs. Nuclear control room studies, particularly those conducted for control room modernization efforts, pose unique challenges. Due to the challenge of sampling large numbers of operators, the interface improvement goals of a usability evaluation, and the limited resources available for study analyses, a traditional quantitative approach is often not feasible or reasonable. Qualitative data provides a more pragmatic means to address design questions early on during the formative stage of the evaluation. Quantitative data can also be useful to bolster the qualitative data by presenting the data in a simple and intuitive graphic to provide evidence for design choices. An example case study using this approach during a formative evaluation study of a turbine control system human-system interface is described in this paper.

Download Full-text

Pembelajaran Mahārat al-Kalām pada Program Kursus Bahasa Arab Spesial Ramadan di Pesantren Darul Lughah Waddirasatil Islamiyah, Pamekasan, Madura

Al-Ma rifah ◽

10.21009/almakrifah.17.01.03 ◽

2020 ◽

Vol 17 (1) ◽

pp. 29-40

Author(s):

Mahbub Humaidi Aziz ◽

M. Syathibi Nawawi ◽

Muhammad Alfan

Keyword(s):

Data Collection ◽

Data Processing ◽

Learning Process ◽

Quantitative Data ◽

Qualitative Data ◽

Effectiveness And Efficiency ◽

Process Material

The purpose of this study was to determine the learning process (material, methods, media, and evaluation), effectiveness, and efficiency of learning mahārat al-kalām on the Ramadan Special Arabic course program at Pondok Pesantren Darul Lughah Waddirasatil Islamiyah (PP DLWI), Pamekasan, Madura. Data collection techniques used were observation, interviews, questionnaires, and documentation. Qualitative data were analyzed using descriptive methods, while quantitative data used simple statistics consisting of the stages of preparation, tabulation, and data processing. The results of this study prove that (1) the learning process of mahārat al-kalām consists of materials, methods, media, and evaluations that are tailored to each level; mubtadi’, mutawassiṭ, and mutaqaddim; (2) the effectiveness of mahārat al-kalām learning in this program is, the mubtadi’ level of 87.33% (very effective), the mutawassiṭ rate of 95.6% (very effective), and the mutaqaddim rate of 98% (very effective); (3) The efficiency of mahārat al-kalām learning in this program is, the mubtadi’ level of 88.25% (very efficient), the mutawassiṭ rate of 90.88% (very efficient), and the mutaqaddim rate of 94.05% (very efficient).

Download Full-text