scholarly journals Validity and reliability study of the Web Based Listening Comprehension Test

2013 ◽  
Vol 3 (3) ◽  
pp. 01-10
Author(s):  
M. Bahaddin Acat ◽  
Hilmi Demiral ◽  
Mehmet Fatih Kaya

The purpose of this study is to examine validity and reliability of the web based test designed to measure listening skills of the 5th graders. The test's content validity supplied 27 of 36 listening objectives described in the curriculum for the 5th graders' Turkish course. After, the constructs were prepared for measuring if the students can gain the listening objectives. Firstly 56 items were prepared. Then two experts working on the fields of Turkish instruction and two experts working on the fields of measurement and evaluation were asked for their opinion about content validity. After making necessary corrections proposed by the experts, eventually, 41 items were left in the test and pilot studies were conducted. KR-20 and Cronbach Alpha coefficients were estimated both being as .77 in an attempt to determine internal consistency of the test. The reliability coefficient calculated by means of Spearman-Brown prophecy formula was found as .80. Such findings point out that the test is reliable. It was also observed during the study that students tend to have higher motivation and concentration level when they engage in web based systems. Therefore, it could be said that web-based environments could be used for measuring and evaluating language skills.

2021 ◽  
pp. 105477382110598
Author(s):  
Ganime Can Gür ◽  
Yasemin Altinbaş

The current study was planned to test the validity and reliability of the Turkish version of the COVID-19 Literacy Scale. The sample of the study was taken from 473 individuals. In this study, language validity, content validity and construct validity were examined to determine the validity of the scale. Its reliability was evaluated by internal consistency, split-half reliability, and test-retest reliability method. It was defined that the scale has a two-factor structure as a result of EFA and its factor loadings are in the appropriate range (0.852–0.324). According to the CFA result, it was determined that the model-data fit was at a good level. The Cronbach values for the whole scale and subscales were .92, .90, and .87, respectively. It was observed that the test-retest value was .95. It was concluded that the Turkish form of the COVID-19 Literacy Scale is a reliable and valid tool.


SAGE Open ◽  
2021 ◽  
Vol 11 (3) ◽  
pp. 215824402110318
Author(s):  
H. Tolga Esen ◽  
Meriç Eraslan ◽  
Mustafa Altınkök ◽  
Hakan Eravşar ◽  
Bahadır Demir ◽  
...  

It is aimed to develop a measurement tool which is a basic motor movement, social skill, attitude observation and evaluation scale for Basic Movement Education. In the study, the natural observation from qualitative research methods is used. The scale outline with 40 items is formed as a result of literature review and negotiations. To determine the content validity of the scale draft, the opinions of six field experts (lecturers), two preschool teachers, two physical education (PE) teachers, and two language experts were analyzed using the Lashwe technique. By analyzing the experts’ opinions according to Lashwe technique, four items are removed since their content validity rate (CVR) assets are less than 0.75. CVR shows that the scale provides 4-point Likert-type construct validity and consists of two subdimensions with 36 items (the basic motor movement skill dimension is 16 items and social skill dimension is 20 items). Total points of the Spearman correlation coefficient are checked among the observers. While the correlation coefficient of the basic motor movement skill dimension is .71 ( p = .000), the correlation coefficient of social skill dimension is .82 ( p = .002). The correlation coefficient among the total points is more than .70, and the results ( p < .01) are meaningful. This shows that the measurement tool is reliable, and the scale provides reliability with 4-point Likert-type gradation.


2020 ◽  
Vol 5 (2) ◽  
pp. 244
Author(s):  
Ovan Ovan ◽  
Andika Saputra

Testing research instruments can be done using several applications such as SPSS, AMOS, Lisrell, and several other applications. However, the use of these applications encounters several obstacles for its users, the first is that some of these applications are paid, the costs that are not small to buy a license for this application often force users to use a pirated version of the application, which of course is detrimental for developers and tarnish the world of education itself. And the second is that the use of this application sometimes confuses the users, the cause is that the items in the application are too complex, making it difficult to use, and in some applications, there are demands that users have an understanding of programming to be able to use the application. Therefore, in this research, a web-based application was developed to test the validity and reliability of research instruments that are free of charge and easy to use by academics and researchers (this application is then called CAMI). The stages taken in this research are the study of the theory of testing the validity and reliability of the research instrument, collecting data, compiling the syntax for making applications, installing applications on a web server (so that they can be accessed online), and testing applications from the data obtained. The data used in this research is secondary data obtained from theses and journals. Furthermore, the data is used to test the web application that has been created, then the results of the test data output are compared with the test results using the SPSS application with the same data. From the test results, it was found that both validity and reliability tests gave the same output 100% as the SPSS application.


SAGE Open ◽  
2021 ◽  
Vol 11 (2) ◽  
pp. 215824402110231
Author(s):  
Mehmet Kurudayıoğlu ◽  
Emre Yazıcı ◽  
Talha Göktentürk

This study aimed to develop Turkish Teacher Candidates’ Self-Efficacies to Use Listening Strategies Scale. Therefore, the study was designed in sequential explanatory design, and sequential timing has been followed. First, the interview study was conducted with 40 participants, and the qualitative data were analyzed through content analysis. Subsequently, an item pool was designed via the findings obtained from the qualitative findings and literature review. Afterward, the draft form was applied to Turkish teacher candidates and 345 valid forms were obtained. As a result of the exploratory factor analysis conducted for the data obtained, we determined that the items were collected in four factors in total. The Cronbach’s alpha coefficient was calculated as .927 for the scale. Confirmatory factor analysis was performed in the last stage, and finally, we found that all factors are statistically significant and the obtained model has a good fit. In addition, we determined that the qualitative findings have chronological categorization and the quantitative findings have thematical categorization. This means that thematic categorization to the listening strategies can be more appropriate for listening skills. Consequently, the scale can be used in determining the self-efficacy perceptions of Turkish teacher candidates to use listening strategies. Furthermore, the scale can contribute to similar studies in the literature.


2018 ◽  
Author(s):  
A. Paykari ◽  
A. Mazloumi ◽  
G. H. Halvani ◽  
S. Ghaneh ◽  
Musa Mashayekhi

Background: Usability is an index to assess a product from the viewpoint of users satisfaction, efficiency and productivity improvement. The main attributes of usability that are derived from the human factors are  and used  in usability design of the interfaces Include: compatibility, consistency, flexibility, minimal action, perceptual limitation, usefulness, learnability, ease of use, minimal memory load, user guidance, satisfaction and errors. The main aim of this study was to assess the usability of interface design tool for a ventilator utilized in the hospitals of Arak city, Iran; and study its validation and reliability. Methods and Materials After constructing the initial questionnaire from the standard sources, specific techniques to determine the validity,  and Cronbach's alpha coefficient were used for the validity and reliability study. The study procedure was: determining the scope and dimensions of the questions, drafting questionnaire, assigning members of the expert panel, study, questionnaire data acquisition  and analysis methods, determining acceptance criteria of the questions and the content validity and reliability index. Results Final tool was a 42-items questionnaire. The content validity index (CVI) of questionnaire was 0.86. The results showed that the total Cronbach's alpha coefficient was 0.89 as an acceptable value for the reliability of questionnaire. Conclusion After the final questionnaire design and the appropriate validity and reliability of it, adopting this tool to assess the usability of breathing apparatus (ventilator) is recommended. With usability assessment of such vital instruments, quality improvement, higher efficiency and productivity as well as errors reduction and good design user interface will be achieved. Keywords: usability, ventilator, evaluation questionnaire, content validity, reliability


2021 ◽  
Vol 12 (1) ◽  
Author(s):  
Oğuz Dicle ◽  
Sema Özan ◽  
Hatice Şahin ◽  
Mustafa Seçil

Abstract Background Board exams are now considered as means of quality procedures that aim to keep the professional knowledge and skills of the physicians at the highest level. In addition, for an assessment to be scientifically valid, it has to be done within defined standards. Although there are different sources in this field, there is a need for a resource that details the steps required for the examinations to be performed perfectly, brings descriptions of the reasons for the procedure and associates the steps with assessment standards. Experts with national and international experience both in radiology and medical education contributed to the preparation of this checklist. Results The guide includes 174 elements to consider before, after the exam order and examination. From the perspective of assessment standards, it has been observed that the steps to be considered before the exam have a greater impact on the validity and reliability of the exam. The standard in which the questions are most associated was validity with 117 (67.24%) questions. Conclusions We think that our guide, which will be accessible in the web environment, will be useful to the teams with a development goal or just start the exam, the candidates who will take the exam and the examiners.


2010 ◽  
Author(s):  
Ran Zhao ◽  
Chia-Lin Tsai ◽  
Adipat Chaichanasakul ◽  
Lisa Y. Flores ◽  
Shane J. Lopez

Sign in / Sign up

Export Citation Format

Share Document