A Gamification Effect in Longitudinal Web Surveys among Children and Adolescents

2015 ◽  
Vol 57 (3) ◽  
pp. 413-438 ◽  
Author(s):  
Aigul Mavletova
Keyword(s):  
Children And Adolescents ◽  
Participation Rates ◽  
Web Surveys ◽  
Cross Sectional ◽  
Retest Reliability ◽  
Visual Survey ◽  
Online Access ◽  
Lower Test ◽  
Test Retest Reliability ◽  
Second Wave

The paper measures a gamification effect in longitudinal web surveys among children and adolescents 7–15 years old. Two waves of the study were conducted using a volunteer online access panel in Russia among 737 children. Respondents were randomly assigned to one of the three conditions in the first wave without changing the treatment in the second wave: (1) a text-only survey, (2) a visual survey and (3) a gamified survey. Though in the first wave of the study respondents found it more enjoyable and easier to complete the gamified survey, no differences in participation rates were found between the conditions in the second wave. Contrary to expectations, a higher breakoff was found in the gamified condition. Moreover, it produced lower test-retest reliability correlations than the text-only and visual conditions in all survey questions. The promising gamification effect found in the first wave of the study faded in the second wave. It seems that implementing gamified elements in longitudinal web surveys might differ from the implementation of gamified elements in cross-sectional surveys.

scholarly journals Translation and Cross-Cultural Adaptation of the Aphasia Check List (ACL) for Farsi-Speaking Persons with Aphasia

2021 ◽  
Author(s):  
Ahmad Reza Khatoonabadi ◽  
◽  
Amin Modarres Zadeh ◽  
Azar Mehri ◽  
Elke Kalbe ◽  
...  
Keyword(s):  
Internal Consistency ◽  
Discriminant Validity ◽  
Control Group ◽  
Check List ◽  
Time Saving ◽  
Cross Sectional ◽  
Retest Reliability ◽  
Ceiling Effects ◽  
Language And Cognition ◽  
Test Retest Reliability

The Aphasia Check List (ACL) test is a comprehensive, time-saving tool for language evaluation in aphasia, including a cognitive assessment part. This cross-sectional study aimed to translate this test into Farsi and analyze the psychometric features of the translated version. The original version of the ACL was translated and adapted from German; its psychometric features were then determined. Twenty participants with aphasia (PWA) and 50 age- and education-matched, cognitively healthy controls participated. Possible floor and ceiling effects, discriminant validity, test-retest reliability, and internal consistency were analyzed in addition to the evaluation of internal correlations between the test parts (Language and Cognition). Regarding the performance of PWAs in the language section and the cognitive subtests assessing attention, memory, and reasoning, there were no floor and ceiling effects. Adequate discriminant validities for the language section of the test (i.e., total score: [Mann-Whitney U= 6.000, p<0.001]; diagnostic subtests scores: [U=3.000, p<0.001]; and each subtest individually) and for the attention subtest of the cognition section [U=16.500, p<0.001] were observed. There was no difference between the control group and the patient group in the subtests of memory [U=497.500, p=0.973] and reasoning [U=3.000, p=308]. The test-retest reliability was acceptable in all subtests (ICCagreement =0.573-0.984). The ACL-P test showed appropriate internal consistency (Cronbach’s alpha=0.761 for test and retest scores). There were also significant correlations between language and cognition in the control and patient groups. The ACL-P test showed sufficient reliability and validity for the evaluation of Farsi-speaking PWAs and used in studies on this population

scholarly journals Development of a patient safety culture scale for maternal and child health institutions in China: a cross-sectional validation study

BMJ Open ◽  
2019 ◽  
Vol 9 (9) ◽  
pp. e025607
Author(s):  
Yuanyuan Wang ◽  
Hui Han ◽  
Liqian Qiu ◽  
Chaojie Liu ◽  
Yan Wang ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Patient Safety ◽  
Safety Culture ◽  
Health Workers ◽  
Reliability And Validity ◽  
Patient Safety Culture ◽  
Cross Sectional ◽  
Retest Reliability ◽  
Confirmatory Factor ◽  
Test Retest Reliability

ObjectiveThis study aimed to develop a patient safety culture (PSC) scale for maternal and child healthcare (MCH) institutions in China.MethodsA theoretical framework of PSC for MCH institutions was proposed through in-depth interviews with MCH workers and patients and Delphi expert consultations. The reliability and validity of the PSC scale were tested in a cross-sectional survey of 1256 MCH workers from 14 MCH institutions in Zhejiang province of China. The study sample was randomly split into half for exploratory and confirmatory factor analyses, respectively. Test–retest reliability was assessed through a repeated survey of 63 voluntary participants 2 weeks apart.ResultsThe exploratory factor analysis extracted 10 components: patient engagement in patient safety (six items), managerial response to patient safety risks (four items), perceived management support (five items), staff empowerment (four items), staffing and workloads (four items), reporting of adverse events (three items), defensive medical practice (three items), work commitment (three items), training (two items) and transfer and handoff (three items). A good model fit was found in the confirmatory factor analysis: χ2/df=1.822, standardised root mean residual=0.048, root mean square error of approximation=0.038, comparative fit index=0.921, Tucker-Lewis index=0.907. The PSC scale had a Cronbach’s α coefficient of 0.89 (0.59–0.90 for dimensional scales) and a test–retest reliability of 0.81 (0.63–0.87 for dimensional reliability), respectively. The intracluster correlation coefficients confirmed a hierarchical nature of the data: individual health workers nested within MCH institutions.ConclusionThe PSC scale for MCH institutions has acceptable reliability and validity. Further studies are needed to establish benchmarking in a national representative sample through a multilevel modelling approach.

scholarly journals A-058 Test–Retest Reliability of the Grooved Pegboard Test in a Pediatric Medical Population

2020 ◽  
Vol 35 (6) ◽  
pp. 848-848
Author(s):  
David C ◽  
Vasserman M ◽  
Brooks B ◽  
Macallister W
Keyword(s):  
Children And Adolescents ◽  
Test Reliability ◽  
Practice Effects ◽  
Fine Motor ◽  
Limited Data ◽  
Motor Tasks ◽  
Retest Reliability ◽  
Medical Population ◽  
Test Retest Reliability ◽  
Grooved Pegboard Test

Abstract Objective The Grooved Pegboard Test (GPT) is among the most commonly used fine motor tasks, though there is limited data on its basic psychometric properties in children and adolescents with medical conditions. The purpose of this study was to establish test reliability for the GPT within this group. Method Participants (N = 44; 22 males, 22 females) were children and adolescents clinically referred for neuropsychological evaluation. Diagnoses included epilepsy (n = 24), cardiac conditions (n = 13), other (n = 5). Each completed the GPT twice: once in the morning and once in the afternoon, ranging from 64-390 minutes apart (x-=263 min., SD = 60 min.). Spearman correlations assessed test–retest reliability for speed of completion for both dominant (DH) and non-dominant hands (NDH) trials and number of peg drops. Paired sample t-test assessed for practice effects between administrations. Results Ages ranged between 6.11 to 18.10 years (x-=12.52 yrs., SD = 3.19 yrs.). GPT raw scores for first presentation ranged from 25-296 seconds (DH x-=80.91, SD = 25.1; NDH x-=95.34, SD = 49.42). The GPT showed high test–retest reliability for DH (ρ = 0.80, p &lt; 0.001) and NDH (ρ = 0.83, p &lt; 0.001). Number of drops showed non-significant correlations across trials (DH ρ = −0.03, p = 0.87; NDH ρ = 0.11, p = 0.49). Practice effects were identified for the DH (t = −3.25, p = 0.002) but not NDH (t = −1.83, p = 0.074). Conclusion Strong test–retest reliability of the GPT speed of completion in this population supports stability of test results over time, though practice effects are seen at short intervals. Number of pegs dropped, however, lacks sufficient retest reliability and may be of lesser clinical utility. Overall, this study provides increased confidence for continued use of the GPT.

scholarly journals Comparison of two different optical coherence tomography angiography devices in detecting healthy versus glaucomatous eyes – an observational cross-sectional study

2020 ◽  
Vol 20 (1) ◽  
Author(s):  
A. R. Kee ◽  
V. C. H. Yip ◽  
E. L. T. Tay ◽  
C. W. Lim ◽  
J. Cheng ◽  
...  
Keyword(s):  
Optical Coherence Tomography ◽  
Diagnostic Accuracy ◽  
Optic Disc ◽  
Optical Coherence Tomography Angiography ◽  
Optical Coherence ◽  
Cross Sectional ◽  
Swept Source ◽  
Retest Reliability ◽  
Significant Difference ◽  
Test Retest Reliability

Abstract Background To understand the differences between two different optical coherence tomography angiography (OCTA) devices in detecting glaucomatous from healthy eyes by comparing their vascular parameters, diagnostic accuracy and test-retest reliability. Methods A cross-sectional observational study was performed on healthy and glaucoma subjects, on whom two sets of OCTA images of optic disc and macula were acquired using both AngioVue (Optovue, USA) and Swept Source (Topcon, Japan) OCTA devices during one visit. A novel in-house software was used to calculate the vessel densities. Diagnostic accuracy of the machines in differentiating healthy versus glaucomatous eyes was determined using area under the receiver operating characteristic curve (AUROC) and test-retest repeatability of the machines was also evaluated. Results A total of 80 healthy and 38 glaucomatous eyes were evaluated. Glaucomatous eyes had reduced mean vessel density compared to healthy controls in all segmented layers of the optic disc and macula using AngioVue (p ≤ 0.001). However, glaucomatous eyes had higher mean vessel density on optic disc scans using Swept Source, with lack of statistically significant difference between healthy and glaucomatous eyes. The AUROC showed better diagnostic accuracy of AngioVue (0.761–1.000) compared to Swept Source (0.113–0.644). The test-retest reliability indices were generally better using AngioVue than Swept Source. Conclusions AngioVue showed better diagnostic capability and test-retest reliability compared to Swept Source. Further studies need to be undertaken to evaluate if there is any significant difference between the various machines in diagnosing and monitoring glaucoma.

Quality of life of the mentally ill. Reliability of the Swedish version of the Lancashire Quality of Life profile

1998 ◽  
Vol 13 (5) ◽  
pp. 231-234 ◽  
Author(s):  
L Hansson ◽  
B Svensson ◽  
T Björkman
Keyword(s):  
Quality Of Life ◽  
Internal Consistency ◽  
Social Relations ◽  
Mentally Ill ◽  
Well Being ◽  
Swedish Version ◽  
Cross Sectional ◽  
Retest Reliability ◽  
Test Retest Reliability

SummaryThere has been a growing interest in the quality of life (QoL) of the mentally ill, subsequently a number of instruments to measure QoL have been developed. One of the measures of QoL which has received considerable attention is the Lancashire QoL Profile (LQOLP). The present study investigated test-retest reliability and internal consistency in the Swedish translation of the LQOLP using a cross-sectional sample of 29 inpatients. The results showed that test-retest reliability of subjective life satisfaction in the nine life domains covered by the LQOLP was satisfactory in seven of the domains, and acceptable in two (social relations and religion). Test-retest reliability for total subjective satisfaction score, global well-being, and an interviewer rated QoL were all on a satisfactory level (r > 0.80). The internal consistency and homogeneity of the total subjective QoL scale and the nine life domain subscales was satisfactory except for the social relations scale, where it was somewhat low.

scholarly journals The Inventory of Physical Activity Barriers for Adults 50 Years and Older: Refinement and Validation

2021 ◽  
Vol 5 (Supplement_1) ◽  
pp. 789-789
Author(s):  
Mariana Wingood ◽  
Salene Jones ◽  
Nancy Gell ◽  
Denise Peters ◽  
Jennifer Brach
Keyword(s):  
Physical Activity ◽  
Factor Analysis ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Assessment Tool ◽  
Intraclass Correlation ◽  
Community Dwelling ◽  
Cross Sectional ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Addressing physical activity (PA) barriers is an essential component of increasing PA among the 56-73% of community-dwelling adults 50 years and older who are not performing the recommended 150 minutes of moderate-to-vigorous PA. As there is no feasible, multi-factorial tool to assess PA barriers among this population, we developed and validated a PA barrier assessment tool called the Inventory of Physical Activity Barriers (IPAB). We collected cross-sectional data on 503 adults (mean age 70.1), with 79 participants completing the scale twice for test-retest reliability and 64 completing a cross-over design examining the ability to use two administration formats interchangeably. Our analyses consisted of exploratory and confirmatory factor analysis, Cronbach alpha, intraclass correlation coefficient, Bland-Altman Plot, and t-tests. Using factor analysis, we identified and confirmed an eight-factor solution consisting of 27 items. The 27-item IPAB is internally consistent (alpha= 0.91), has a high test-retest reliability (intraclass correlation coefficient=0.99), and can differentiate between individuals who meet the recommended levels of PA and those who do not (p &lt; 0.001). The IPAB scores ranged between 1.00-3.11 for the paper format (mean=1.78) and 1.07-3.48 for the electronic format (mean=1.78), with no statistical difference between the paper and electronic administration formats (p=0.94), resulting in the conclusion that the two administration formats can be used interchangeably. Participant feedback illustrates that the IPAB is easy to use, has clear instruction, and is an appropriate length. The newly validated IPAB scale can be used to develop individualized PA interventions that address PA barriers among patients 50 years and older.

Test–Retest Reliability and Construct Validity of the German Translation of the Gait Outcome Assessment List (GOAL) Questionnaire for Children with Ambulatory Cerebral Palsy

2021 ◽  
Author(s):  
Michaela V. Bonfert ◽  
Evelyn Jelesch ◽  
A. Sebastian Schroeder ◽  
Julia Hartmann ◽  
Helene Koenig ◽  
...  
Keyword(s):  
Cerebral Palsy ◽  
Children And Adolescents ◽  
Motor Function ◽  
Related Function ◽  
Retest Reliability ◽  
Level Ii ◽  
Children With Cerebral Palsy ◽  
Level I ◽  
Test Retest Reliability ◽  
Gmfcs Level

AbstractThe Gait Outcome Assessment List (GOAL) is a patient or caregiver-reported assessment of gait-related function across different domains of the International Classification of Functioning, Disability, and Health (ICF) developed for ambulant children with cerebral palsy (CP). So far, the questionnaire is only available in English. The aim of this study was to translate the GOAL into German and to evaluate its reliability and validity by studying the association between GOAL scores and gross motor function as categorized by the gross motor function classification system (GMFCS) in children with cerebral palsy (CP). The GOAL was administered to primary caregivers of n = 91 children and adolescents with CP (n = 32, GMFCS levels I; n = 27, GMFCS level II; and n = 32, GMFCS level III) and n = 15 patients were capable of independently completing the whole questionnaire (GMFCS level I). For assessing test–retest reliability, the questionnaire was completed for a second time 2 weeks after the first by the caregivers of n = 36 patients. Mean total GOAL scores decreased significantly with increasing GMFCS levels with scores of 71 (95% confidence interval [CI]: 66.90–74.77) for GMFCS level I, 56 (95% CI: 50.98–61.86) for GMFCS level II, and 45 (95% CI: 40.58–48.48) for GMFCS level III, respectively. In three out of seven domains, caregivers rated their children significantly lower than children rated themselves. The test–retest reliability was excellent as was internal consistency given the GOAL total score. The German GOAL may serve as a much needed patient-reported outcome measure of gait-related function in ambulant children and adolescents with CP.

Sign in / Sign up

Export Citation Format

Share Document