scholarly journals Evaluating the Reliability and Validity of the Short Gambling Harm Screen: Are Binary Scales worse than Likert Scales at capturing Gambling Harm?

2020 ◽  
Vol 44 ◽  
Author(s):  
James McLauchlan ◽  
Matthew Browne ◽  
Alex M T Russell ◽  
Matthew Rockloff

Gambling-related harm has become a key metric for measuring the adverse consequences of gambling on a population level. Yet, despite this renewed understanding in contemporary research, little exploration has been conducted to evaluate which instrument is best suited to capture the harmful consequences of gambling. This study was designed with the aim of determining whether Likert scales were better suited to capture gambling harm than binary scales. We hypothesized that the Short Gambling Harm Screen (SGHS), initially scored using a binary scale, would perform similarly to the alternate form that was Likertized for the purpose of this study. A corresponding comparison in the reverse direction was executed for the Problem Gambling Severity Index. The SGHS’s performance was assessed via a repeated-measures design in combination with three other measures of validity administered at the conclusion of the survey. In the end, we found that changing the scoring format (i.e., from binary to Likert) had negligible impact on the SGHS’s psychometric performance. We conclude that the original scoring method of the SGHS is not only appropriate but also no less suitable than Likert scales in measuring gambling harm.RésuméLes dommages liés au jeu sont devenus une mesure clé pour évaluer les conséquences néfastes du jeu à l’échelle de la population. Pourtant, malgré cette compréhension renouvelée dans la recherche contemporaine, on effectue très peu d’exploration pour évaluer quel instrument est le mieux adapté pour comprendre les conséquences néfastes du jeu. Cette étude a été conçue dans le but de déterminer si les échelles de Likert étaient mieux adaptées que les échelles binaires pour saisir les dommages liés au jeu. Nous avons émis l’hypothèse que le dépistage rapide du jeu problématique (Short Gambling Harm Screen ou SGHS), initialement évalué à l’aide d’une échelle binaire, ne fonctionnera pas différemment de la forme de Likert alternative qui a été créée aux fins de cette étude. Une comparaison correspondante dans la direction inverse a été effectuée pour l'indice de gravité du jeu excessif (PGSI). Les performances du SGHS ont été évaluées par un plan de mesures répétées, combinés à trois autres mesures de validité administrées à la fin du sondage. En fin de compte, nous avons constaté que le changement du format de pointage (c.-à-d. du binaire au Likert) avait un impact négligeable sur le rendement psychométrique du SGHS. Nous concluons que la méthode de pointage originale du SGHS est non seulement appropriée, mais également non moins appropriée que les échelles de Likert pour évaluer les dommages liés au jeu.

1970 ◽  
Vol 27 (3) ◽  
pp. 919-924
Author(s):  
Alan D. Price

The Modified Bennett Test (MBT) is briefly described and preliminary reliability and validity data are provided by a report of the results of a study in which it was used to test the effects of role-inducing instructions on creative thinking. Ss came for 2 sessions in which they were given an instructional set to assume the role of either an unregulated character or a regulated character. Subsequent to the role-inducing instructions, Ss responded to half of the items of the MBT. The role-inducing instructions and the items of the MBT were counterbalanced in a repeated measures design with each S serving as his own control. It was hypothesized that the responses given in the unregulated condition would, in general, be more creative than those given in the regulated condition. The hypothesis was confirmed.


2008 ◽  
Vol 17 (1) ◽  
pp. 50-59 ◽  
Author(s):  
Lisa S. Jutte ◽  
Kenneth L. Knight ◽  
Blaine C. Long

Objective:Examine thermocouple model uncertainty (reliability + validity).Design:First, a 3 × 3 repeated measures design with independent variables electrothermometers and thermocouple model. Second, a 1 × 3 repeated measures design with independent variable subprobe.Intervention:Three electrothermometers, 3 thermocouple models, a multi-sensor probe and a mercury thermometer measured a stable water bath.Main Outcome Measures:Temperature and absolute temperature differences between thermocouples and a mercury thermometer.Results:Thermocouple uncertainty was greater than manufactures’ claims. For all thermocouple models, validity and reliability were better in the Iso-Themex than the Datalogger, but there were no practical differences between models within an electrothermometers. Validity of multi-sensor probes and thermocouples within a probe were not different but were greater than manufacturers’ claims. Reliability of multiprobes and thermocouples within a probe were within manufacturers claims.Conclusion:Thermocouple models vary in reliability and validity. Scientists should test and report the uncertainty of their equipment rather than depending on manufactures’ claims.


2017 ◽  
Vol 38 (2) ◽  
pp. 83-93
Author(s):  
Jeffrey M. Cucina ◽  
Nicholas L. Vasilopoulos ◽  
Arwen H. DeCostanza

Abstract. Varimax rotated principal component scores (VRPCS) have previously been offered as a possible solution to the non-orthogonality of scores for the Big Five factors. However, few researchers have examined the reliability and validity of VRPCS. To address this gap, we use a lab study and a field study to investigate whether using VRPCS increase orthogonality, reliability, and criterion-related validity. Compared to the traditional unit-weighting scoring method, the use of VRPCS enhanced the reliability and discriminant validity of the Big Five factors, although there was little improvement in criterion-related validity. Results are discussed in terms of the benefit of using VRPCS instead of traditional unit-weighted sum scores.


Methodology ◽  
2017 ◽  
Vol 13 (1) ◽  
pp. 9-22 ◽  
Author(s):  
Pablo Livacic-Rojas ◽  
Guillermo Vallejo ◽  
Paula Fernández ◽  
Ellián Tuero-Herrero

Abstract. Low precision of the inferences of data analyzed with univariate or multivariate models of the Analysis of Variance (ANOVA) in repeated-measures design is associated to the absence of normality distribution of data, nonspherical covariance structures and free variation of the variance and covariance, the lack of knowledge of the error structure underlying the data, and the wrong choice of covariance structure from different selectors. In this study, levels of statistical power presented the Modified Brown Forsythe (MBF) and two procedures with the Mixed-Model Approaches (the Akaike’s Criterion, the Correctly Identified Model [CIM]) are compared. The data were analyzed using Monte Carlo simulation method with the statistical package SAS 9.2, a split-plot design, and considering six manipulated variables. The results show that the procedures exhibit high statistical power levels for within and interactional effects, and moderate and low levels for the between-groups effects under the different conditions analyzed. For the latter, only the Modified Brown Forsythe shows high level of power mainly for groups with 30 cases and Unstructured (UN) and Autoregressive Heterogeneity (ARH) matrices. For this reason, we recommend using this procedure since it exhibits higher levels of power for all effects and does not require a matrix type that underlies the structure of the data. Future research needs to be done in order to compare the power with corrected selectors using single-level and multilevel designs for fixed and random effects.


2020 ◽  
Author(s):  
Resti Tito Villarino ◽  
Christopher Arcay ◽  
Maria Concepcion Temblor

BACKGROUND Hypertension is a serious health issue and a major cardiovascular disease and stroke risk factor. In hypertensive patients, various health educational models have been used to improve their lifestyle, but the findings are inconsistent. OBJECTIVE The study assessed the effects of a lifestyle intervention program using modified Beliefs, Attitude, Subjective Standards, Enabling Factors (BASNEF) model among non-adherent hypertensive respondents in relation to the introduction of a lifestyle intervention program in the management of hypertension. METHODS This is a quantitative quasi-experimental research particularly utilizing a repeated-measures design of within-subjects approach on the 50 non-adherent patients diagnosed with essential hypertension at Moalboal, Cebu, Philippines in 2019. The respondents received five sessions of trainings based on modified BASNEF model. The Morisky Medication Adherence instrument was used. The first phase included a demographic questionnaire and the last phase comprised the evaluation of the program. Frequencies, percentages, means and standard deviations for descriptive statistics while t-test, repeated measures, ANOVA, and Pearson product moment correlation for inferential statistics. RESULTS The result indicated that the phase 1 mean (146.5) of the systolic readings differ significantly from the phase 4 mean (134.92) of the systolic readings. However, since these two means came from phases that were not consecutive, the result, as a whole, did not show a significant decrease or change when analyzed chronologically from one phase to the next. CONCLUSIONS The study has established that BASNEF model approach can be an effective BP management technique.


2021 ◽  
Author(s):  
Stephen M Kareha ◽  
Philip W McClure ◽  
Alicia Fernandez-Fernandez

Abstract Objective Rating tissue irritability has been recommended to aid decision making in several recent clinical practice guidelines. An explicit method for rating tissue irritability was proposed as part of the Staged Algorithm for Rehabilitation Classification: Shoulder Disorders (STAR-Shoulder), but the reliability and validity of this classification are unknown. The purpose of this study was to examine the reliability and concurrent validity of shoulder tissue irritability ratings as part of a system designed to guide appropriate treatment strategy and intensity. Methods A clinical measurement, prospective repeated-measures cross-sectional design was used. The 101 consecutive participants with primary complaints of shoulder pain were assessed by pairs of blinded raters (24 raters in total) and rated for tissue irritability. Patients completed 3 patient-rated outcome (PRO) measures reflecting both pain and disability, and these scores were compared with ratings of tissue irritability. Paired ratings of irritability were analyzed for reliability with prevalence-adjusted, bias-adjusted Kappa for ordinal scales (PABAK-OS). Analysis of variance (ANOVA) was used to compare PRO measures across different levels of irritability. Receiver operating characteristic (ROC) curve analysis was utilized to derive cut-off scores for 3 PRO instruments. Results Interrater reliability was 0.69 (95% CI = 0.59–0.78), with 67% agreement. All PRO measures were significantly different among 3 levels of tissue irritability. Conclusion There appear to be acceptable reliability and a strong relationship between PRO measures and therapist-rated tissue irritability, supporting the use of the STAR-Shoulder irritability rating system. Impact Several clinical practice guidelines have recommended that clinicians rate tissue irritability as part of their examination. This study provides important new information supporting the reliability and validity of the STAR-Shoulder tissue irritability rating system.


2020 ◽  
pp. 104973152098235
Author(s):  
Kuei-Min Chen ◽  
Hui-Fen Hsu ◽  
Li-Yen Yang ◽  
Chiang-Ching Chang ◽  
Yu-Ming Chen ◽  
...  

Purpose: This study aimed to test the effectiveness of High-Need Community-Dwelling Older Adults Care Delivery Model (HCOACDM) in Taiwan. Methods: A cluster randomized controlled trial with repeated measures design was conducted in eight community care centers, involving 145 high-need older adults who were assigned to the intervention group or comparison group. The HCOACDM was provided over 6 months. Functional ability, quality of life, depressive symptoms, and health care and social service utilizations were measured at baseline, at 3 months, and 6 months into the intervention. The participants’ satisfaction was measured at the end of 6-month intervention. Results: Positive effects were shown on all variables in the intervention group at both the 3-month and 6-month intervals (all p < .05). The intervention group had a higher satisfaction with care delivery than the comparison group ( p < .05). Discussion: The promising findings supported a long-term implementation of the HCOACDM as applicable and beneficial.


Author(s):  
Nuno Batalha ◽  
Jose A. Parraca ◽  
Daniel A. Marinho ◽  
Ana Conceição ◽  
Hugo Louro ◽  
...  

The purpose of this study was to analyze the acute effects of a standardized water training session on the shoulder rotators strength and balance in age group swimmers, in order to understand whether a muscle-strengthening workout immediately after the water training is appropriate. A repeated measures design was implemented with two measurements performed before and after a standardized swim session. 127 participants were assembled in male (n = 72; age: 16.28 ± 1.55 years, height: 174.15 ± 7.89 cm, weight: 63.97 ± 6.51 kg) and female (n = 55; age: 15.29 ± 1.28 years, height: 163.03 ± 7.19 cm, weight: 52.72 ± 5.48 kg) cohorts. The isometric torque of the shoulder internal (IR) and external (ER) rotators, as well as the ER/IR ratios, were assessed using a hand-held dynamometer. Paired sample t-tests and effect sizes (Cohen’s d) were used (p ≤ 0.05). No significant differences were found on the shoulder rotators strength or balance in males after training. Females exhibited unchanged strength values after practice, but there was a considerable decrease in the shoulder rotators balance of the non-dominant limb (p < 0.01 d = 0.366). This indicates that a single practice seems not to affect the shoulders strength and balance of adolescent swimmers, but this can be a gender specific phenomenon. While muscle-strengthening workout after the water session may be appropriate for males, it can be questionable regarding females. Swimming coaches should regularly assess shoulder strength levels in order to individually identify swimmers who may or may not be able to practice muscle strengthening after the water training.


2017 ◽  
Vol 3 (3) ◽  
pp. 88-93 ◽  
Author(s):  
Maureen Anne Jersby ◽  
Paul Van-Schaik ◽  
Stephen Green ◽  
Lili Nacheva-Skopalik

BackgroundHigh-Fidelity Simulation (HFS) has great potential to improve decision-making in clinical practice. Previous studies have found HFS promotes self-confidence, but its effectiveness in clinical practice has not been established. The aim of this research is to establish if HFS facilitates learning that informs decision-making skills in clinical practice using MultipleCriteria DecisionMaking Theory (MCDMT).MethodsThe sample was 2nd year undergraduate pre-registration adult nursing students.MCDMT was used to measure the students’ experience of HFS and how it developed their clinical decision-making skills. MCDMT requires characteristic measurements which for the learning experience were based on five factors that underpin successful learning, and for clinical decision-making, an analytical framework was used. The study used a repeated-measures design to take two measurements: the first one after the first simulation experience and the second one after clinical placement. Baseline measurements were obtained from academics. Data were analysed using the MCDMT tool.ResultsAfter their initial exposure to simulation learning, students reported that HFS provides a high-quality learning experience (87%) and supports all aspects of clinical decision-making (85%). Following clinical practice, the level of support for clinical decision-making remained at 85%, suggesting that students believe HFS promotes transferability of knowledge to the practice setting.ConclusionOverall, students report a high level of support for learning and developing clinical decision-making skills from HFS. However, there are no comparative data available from classroom teaching of similar content so it cannot be established if these results are due to HFS alone.


Sign in / Sign up

Export Citation Format

Share Document