measure reliability
Recently Published Documents


TOTAL DOCUMENTS

42
(FIVE YEARS 15)

H-INDEX

6
(FIVE YEARS 2)

2021 ◽  
Vol 4 (12) ◽  
pp. e2137647
Author(s):  
Laurent G. Glance ◽  
David R. Nerenz ◽  
Karen E. Joynt Maddox ◽  
Bruce L. Hall ◽  
Andrew W. Dick

2021 ◽  
Vol 2 ◽  
pp. 97-104
Author(s):  
Nurul Lathifah ◽  
Annisa Hutami Adi ◽  
Tri Na’imah

The researcher conducted a psychometric analysis to know the school well-being scale’s validity and reliability and understand the dimensions that could form the school well-being variable. School well-being is a complex concept because it involves various essential elements in the teaching and learning process. School well-being is useful to help create a conducive learning environment and achieve learning goals in schools. The school well-being variable was measured using four dimensions from Konu & Rimpelä, namely having, loving, being, and health status. Forty students of SMK Muhammadiyah X in Ajibarang District, Banyumas, Indonesia, were involved. Analysis of research data to measure validity uses the corrected item-total correlation formula, while to measure reliability using Cronbach’s alpha which is analyzed using SPSS version 25. The analysis results prove that from the four dimensions of school well-being, there are 26 valid items and have a reliability coefficient of 0.903. Thus, the school well-being scale can be used for research.


2021 ◽  
Vol 12 ◽  
Author(s):  
José Rodrigues ◽  
Filipe Rodrigues ◽  
Rui Resende ◽  
Mário Espada ◽  
Fernando Santos

ObjectiveThe purpose of this study was to present the reliability of three validated measures, namely the System of Analysis of Instruction in Competition, the Questionnaire on Coach Instructional Behavior Expectations, and the Questionnaire on Coach Instructional Behavior Perception that could be used in a mix-method approach.MethodsThree instruments underwent a robust process of construct and reliability analysis. Inter− and intra-observer reliability was tested for the observational instrument using Cohen’s k-agreement measure. Reliability values above 0.85 were considered as a good agreement between and within observers. To verify the internal consistency of the questionnaires, the correlation coefficients were considered.ResultsThe results related to intra-observer and inter-observer reliability showed that intra-observer reliability k-agreement values ranged between 0.912 and 1 for observer 1, and 0.82 and 1 for observer 2. For inter-observer reliability, k-agreement values ranged between 0.885 and 1 between observers. Thus, values for reliability are above acceptable. The correlation coefficient values recorded for the questionnaires on instruction expectations in the competitive moment were above 0.82 and significant (p < 0.05), and for the questionnaire on instruction perception in competition above 0.88 and significant (p < 0.05). The pilot study showed some divergent results across expectations, behavior during competition, and perception about the instruction behavior.ConclusionThe observational system and the expectations and perceptions questionnaires, used in a complementary way, can be considered as a mix-method approach for studies aiming to examine coaches’ competitive behavior.


2021 ◽  
Vol 5 (02) ◽  
pp. 155-169
Author(s):  
Iis Makhisoh

Purpose-assessments conducted at the national level require good quality in these assessment instruments. This research focuses on analyzing item of the arabic final exam questions with the standard indicators set by the ministry of religion for the 2021 madrasahs’ final exams (UM). Design/Methodology/Approach- the researcher used the quantitative approach and the quantitative non-experimental method. As for the basic data are the question items for the Arabic language and the standards set by the Ministry of Religion 2021. the next data is the student's answer items needed to measure reliability and validity. Analysis of the suitability of the questions using a percentage scale, added with Bloom's taxonomy; to measure reliability the anates program was used.  Findings— the results are (1) the arabic language questions tested in jombang are in accordance with the UM standars with a validiity score 92%, (2) as bloom's taxonomy, the cognitive level shows that 42.5% are at level one, 3% at cognitive level two, and 27.5% at cognitive level three. (3) the anates program got reliability score of 0.83.   Research Limitation - collecting much data is difficult because some schools use a randomization program, made the required data cannot be included in the anates.


Author(s):  
Eric J. Hunter ◽  
Mark L. Berardi ◽  
Miriam van Mersbergen

Purpose Patients with voice problems commonly report increased vocal effort, regardless of the underlying pathophysiology. Previous studies investigating vocal effort and voice production have used a range of methods to quantify vocal effort. The goals of the current study were to use the Borg CR100 effort scale to (a) demonstrate the relation between vocal intensity or vocal level (dB) and tasked vocal effort goals and (b) investigate the repeated measure reliability of vocal level at tasked effort level goals. Method Three types of speech (automatic, read, and structured spontaneous) were elicited at four vocal effort level goals on the Borg CR100 scale (2, 13, 25, and 50) from 20 participants (10 females and 10 males). Results Participants' vocal level reliably changed approximately 5 dB between the elicited effort level goals; this difference was statistically significant and repeatable. Biological females produced a voice with consistently less intensity for a vocal effort level goal compared to biological males. Conclusions The results indicate the utility of the Borg CR100 in tracking effort in voice production that is repeatable with respect to vocal level (dB). Future research will investigate other metrics of voice production with the goal of understanding the mechanisms underlying vocal effort and the external environmental influences on the perception of vocal effort.


Author(s):  
Mirriam Wanza Mulei ◽  
Joyce Gakobo

Women in the pastoralist societies have always been considered as major pillars of both social and economic sustenance of their communities. Their role in the society is mainly as caregivers as opposed to being income earners. However, with increased women empowerment, more women are taking up income generating activities with a great number being involved in entrepreneurship activities. This study examined the contribution of women entrepreneurs towards economic development in Wajir township. The specific objectives included to assess how two important attributes of entrepreneurs contribute to economic development, thus establish the contribution of competitiveness of women entrepreneurs to economic development as well as the contribution of innovativeness of the women entrepreneurs to economic development and finally identify the characteristics of women entrepreneurs in Wajir township. This research was conducted among the eight hundred and forty-eight (848) women entrepreneurs operating within the township registered by the Department of Gender and special programs in the county. A total of one hundred (100) women were selected as a sample for the study. Data collection was done using closed ended questionnaires as the main tool whereas focused group discussions and key informant interviews were employed to triangulate the data. To measure reliability of the instrument, the questionnaire was tested and retested with a sample of respondents and the results measured against the Cronbach’s Alpha correlation coefficient test. To test the validity of the instrument, a pilot test was carried out. Analysis of data was done using SPSS and presented using tables and figures. The study revealed that there is an evident relationship between women enterepreneurial behaviour and consequent contribution to economic development in Wajir township. It was observed that the knack of an entrepreneur to be more innovative contributes more to job creation and better productivity in Wajir township compared to their competitive ability. On the other hand, a competitive women entrepreneur is more likely to contribute to personal wealth creation compared to an innovative one. This means that necessary support that promotes innovation and competitiveness amongst women entrepreneurs in Wajir township should be encouraged. The conclusion from this study is thus, women run enterprises in Wajir township contribute to the overall socio-economic development of the county.


Author(s):  
Alexander T. Sandhu ◽  
Rose Do ◽  
Joyce Lam ◽  
James Blankenship ◽  
William Van Decker ◽  
...  

Background: The Merit-Based Incentive Payment System adjusts clinician payments based on a performance score that includes cost measures. With the Centers for Medicare & Medicaid Services, we developed a novel cost measure that compared interventional cardiologists on a targeted set of costs related to elective percutaneous coronary intervention (PCI). We describe the measure and compare it to a hypothetical version including all expenditures post-PCI. Methods: Measure development was guided by 39 clinician experts. They identified services within 30 days of PCI that could be potentially affected by the interventional cardiologist. Expenditures for these PCI-related services were included as measure costs in a process termed service assignment. We used 1 year of Medicare claims to calculate clinician scores using the final measure that included only PCI-related costs (with service assignment) and a hypothetical version that included all costs post-PCI (without service assignment). We calculated reliability for both measures. This marker of precision breaks measure variance into signal (difference between clinicians) versus noise (difference between PCI episodes for a clinician). We also determined the change in clinician performance quintile between measures. Results: We identified 100 992 elective outpatient PCI episodes from May 2, 2016, to May 1, 2017. Total Medicare expenditures within 30 days of PCI averaged $13 234. After excluding costs unrelated to PCI, average cost was $10 966. For individual clinicians, mean reliability for the hypothetical measure without service assignment was 0.36. After service assignment, final measure reliability increased to 0.53. When evaluated as clinician groups, reliability increased from 0.43 to 0.73 following service assignment. Approximately 66% (2340 of 3527) of clinicians were reclassified into a different performance quintile after excluding unrelated costs. Conclusions: The elective outpatient PCI cost measure had increased precision and reclassified clinician performance relative to a hypothetical version that included total expenditures.


Author(s):  
Ma. de la Luz Quezada-Flores ◽  
Camilo Márquez-De Anda ◽  
Ma. Guadalupe Serrano-Torres ◽  
Liliana González-Arredondo

The coronavirus pandemic (COVID-19) broke into the lives of people around the world, (WHO, 2020) led to changes in the way of working and studying. For students it represents a challenge. The educational community has made efforts to sustain student learning; This represented the need to use information technologies and depend on their own resources to guarantee the continuity of learning, forcing them to take distance classes through digital means (UNESCO, 2020). This research will allow to know the conditions and how the students of the Administrative Economic area of the Technological University of León face the challenges. For this, a questionnaire was designed in order to collect information, it was validated to measure reliability and it was applied to a sample of 249 students. The data was analyzed and showed how many of them have a computer; if it is for exclusive use or shared; how many have internet and the quality of the service; how many have cell phones; how many hours they use their devices for classes; the platforms they use; if they have what it takes to work at home and if they prefer distance or face-to-face classes.


2020 ◽  
Author(s):  
Sam Parsons

Analytic flexibility is known to influence the results of statistical tests, e.g. effect sizes and p-values. Yet, the degree to which flexibility in data-processing decisions influences the reliability of our measures is unknown. In this paper I attempt to address this question using a series of reliability multiverse analyses. The methods section incorporates a brief tutorial for readers interested in implementing multiverse analyses reported in this manuscript; all functions are contained in the R package splithalf. I report six multiverse analyses of data-processing specifications, including accuracy and response time cutoffs. I used data from a Stroop task and Flanker task at two time points. This allowed for an internal consistency reliability multiverse at time 1 and 2, and a test-retest reliability multiverse between time 1 and 2. Largely arbitrary decisions in data-processing led to differences between the highest and lowest reliability estimate of at least 0.2. Importantly, there was no consistent pattern in the data-processing specifications that led to greater reliability, across time as well as tasks. Together, data-processing decisions are highly influential, and largely unpredictable, on measure reliability. I discuss actions researchers could take to mitigate some of the influence of reliability heterogeneity, including adopting hierarchical modelling approaches. Yet, there are no approaches that can completely save us from measurement error. Measurement matters and I call on readers to help us move from what could be a measurement crisis towards a measurement revolution.


Author(s):  
Juan Comesaña

Experientialism is compared and contrasted with Evidentialism, Reliabilism, and Evidentialist Reliabilism. The generality problem for Reliabilism is discussed, as well as the issue of how to measure reliability. A probabilistic understanding of reliability is put forward. In particular, reliability is understood in terms of evidential probabilities, not physical probabilities. An extension to credences is explored. Experientialism is non-Evidentialist insofar as it does not take experience to be evidence, and is non-Reliabilist insofar as it appeals to a normatively loaded notion of evidential probability.


Sign in / Sign up

Export Citation Format

Share Document