scholarly journals The development of a questionnaire to assess leisure time screen-based media use and its proximal correlates in children (SCREENS-Q)

2020 ◽  
Author(s):  
Heidi Klakk ◽  
Christian Tolstrup Wester ◽  
Line Grønholt Olesen ◽  
Martin Gillies Rasmussen ◽  
Peter Lund Kristensen ◽  
...  
Keyword(s):  
Ordinal Data ◽  
Media Use ◽  
Rapid Development ◽  
Intraclass Correlation ◽  
Kappa Statistics ◽  
Media Environment ◽  
Retest Reliability ◽  
Screen Media ◽  
Screen Media Use ◽  
Test Retest Reliability

Abstract Background: The screen-media landscape has changed drastically during the last decade with wide-scale ownership and use of new portable touchscreen-based devices plausibly causing changes in the volume of screen media use and the way children and young people entertain themselves and communicate with friends and family members. This rapid development is not sufficiently mirrored in available tools for measuring children’s screen media use. The aim of this study was to develop and evaluate a parent-reported standardized questionnaire to assess 6-10-year old children’s multiple screen media use and habits, their screen media environment, and its plausible proximal correlates based on a suggested socio-ecological model. Methods: An iterative process was conducted developing the SCREENS questionnaire. Informed by the literature, media experts and end-users, a conceptual framework was made to guide the development of the questionnaire. Parents and media experts evaluated face and content validity. Pilot and field testing in the target group was conducted to assess test-retest reliability using Kappa statistics and intraclass correlation coefficients (ICC). Construct validity of relevant items was assessed using pairwise non-parametric correlations (Spearman’s). The SCREENS questionnaire is based on a multidimensional and formative model. Results: The SCREENS questionnaire covers six domains validated to be important factors of screen media use in children and comprises 19 questions and 92 items. Test-retest reliability (n=37 parents) for continuous variables was moderate to substantial with ICC’s ranging from 0.67 to 0.90. For relevant nominal and ordinal data, kappa values were all above 0.50 with more than 80 percent of the values above 0.61 indicating good test-retest reliability. Internal consistency between two different time use variables (from n=243) showed good correlations with rho ranging from 0.59 to 0.66. Response-time was within 15 min for all participants. Conclusions: SCREENS-Q is a comprehensive tool to assess children’s screen media habits, the screen media environment and possible related correlates. It is a feasible questionnaire with multiple validated constructs and moderate to substantial test-retest reliability of all evaluated items. The SCREENS-Q is a promising tool to investigate children screen media use.

scholarly journals The development of a questionnaire to assess leisure time screen-based media use and its proximal correlates in children (SCREENS-Q)

2020 ◽  
Author(s):  
Heidi Klakk ◽  
Christian Tolstrup Wester ◽  
Line Grønholt Olesen ◽  
Martin Gillies Rasmussen ◽  
Peter Lund Kristensen ◽  
...  
Keyword(s):  
Ordinal Data ◽  
Media Use ◽  
Rapid Development ◽  
Intraclass Correlation ◽  
Kappa Statistics ◽  
Media Environment ◽  
Retest Reliability ◽  
Screen Media ◽  
Screen Media Use ◽  
Test Retest Reliability

Abstract Background: The screen-media landscape has changed drastically during the last decade with wide-scale ownership and use of new portable touchscreen-based devices plausibly causing changes in the volume of screen media use and the way children and young people entertain themselves and communicate with friends and family members. This rapid development is not sufficiently mirrored in available tools for measuring children’s screen media use. The aim of this study was to develop and evaluate a parent-reported standardized questionnaire to assess 6-10-year old children’s multiple screen media use and habits, their screen media environment, and its plausible proximal correlates based on a suggested socio-ecological model. Methods: An iterative process was conducted developing the SCREENS questionnaire. Informed by the literature, media experts and end-users, a conceptual framework was made to guide the development of the questionnaire. Parents and media experts evaluated face and content validity. Pilot and field testing in the target group was conducted to assess test-retest reliability using Kappa statistics and intraclass correlation coefficients (ICC). Construct validity of relevant items was assessed using pairwise non-parametric correlations (Spearman’s). The SCREENS questionnaire is based on a multidimensional and formative model. Results: The SCREENS questionnaire covers six domains validated to be important factors of screen media use in children and comprises 19 questions and 92 items. Test-retest reliability (n=37 parents) for continuous variables was moderate to substantial with ICC’s ranging from 0.67 to 0.90. For relevant nominal and ordinal data, kappa values were all above 0.50 with more than 80 percent of the values above 0.61 indicating good test-retest reliability. Internal consistency between two different time use variables (from n=243) showed good correlations with rho ranging from 0.59 to 0.66. Response-time was within 15 min for all participants. Conclusions: SCREENS-Q is a comprehensive tool to assess children’s screen media habits, the screen media environment and possible related correlates. It is a feasible questionnaire with multiple validated constructs and moderate to substantial test-retest reliability of all evaluated items. The SCREENS-Q is a promising tool to investigate children screen media use. Keywords: screen-media use, children, questionnaire, correlates

scholarly journals The development of a questionnaire to assess leisure time screen-based media use and its proximal correlates in children (SCREENS-Q)

2020 ◽  
Author(s):  
Heidi Klakk ◽  
Christian Tolstrup Wester ◽  
Line Grønholt Olesen ◽  
Martin Gillies Rasmussen ◽  
Peter Lund Kristensen ◽  
...  
Keyword(s):  
Ordinal Data ◽  
Media Use ◽  
Rapid Development ◽  
Intraclass Correlation ◽  
Kappa Statistics ◽  
Media Environment ◽  
Retest Reliability ◽  
Screen Media ◽  
Screen Media Use ◽  
Test Retest Reliability

Abstract Background: The screen-media landscape has changed drastically during the last decade with wide-scale ownership and use of new portable touchscreen-based devices plausibly causing changes in the volume of screen media use and the way children and young people entertain themselves and communicate with friends and family members. This rapid development is not sufficiently mirrored in available tools for measuring children’s screen media use. The aim of this study was to develop and evaluate a parent-reported standardized questionnaire to assess 6-10-year old children’s multiple screen media use and habits, their screen media environment, and its plausible proximal correlates based on a suggested socio-ecological model. Methods: An iterative process was conducted developing the SCREENS questionnaire. Informed by the literature, media experts and end-users, a conceptual framework was made to guide the development of the questionnaire. Parents and media experts evaluated face and content validity. Pilot and field testing in the target group was conducted to assess test-retest reliability using Kappa statistics and intraclass correlation coefficients (ICC). Construct validity of relevant items was assessed using pairwise non-parametric correlations (Spearman’s). The SCREENS questionnaire is based on a multidimensional and formative model. Results: The SCREENS questionnaire covers six domains validated to be important factors of screen media use in children and comprises 19 questions and 92 items. Test-retest reliability (n=37 parents) for continuous variables was moderate to substantial with ICC’s ranging from 0.67 to 0.90. For relevant nominal and ordinal data, kappa values were all above 0.50 with more than 80 percent of the values above 0.61 indicating good test-retest reliability. Internal consistency between two different time use variables (from n=243) showed good correlations with rho ranging from 0.59 to 0.66. Response-time was within 15 min for all participants. Conclusions: SCREENS-Q is a comprehensive tool to assess children’s screen media habits, the screen media environment and possible related correlates. It is a feasible questionnaire with multiple validated constructs and moderate to substantial test-retest reliability of all evaluated items. The SCREENS-Q is a promising tool to investigate children screen media use.

scholarly journals How reproducible is self-reported information on exposure to smoking, drinking, and dietary patterns? Evidence among Brazilian adults in the Pró-Saúde Study

2003 ◽  
Vol 121 (2) ◽  
pp. 63-66 ◽  
Author(s):  
Dóra Chor ◽  
Eduardo Faerstein ◽  
Márcia Guimarães Mello Alves ◽  
Claudia de Souza Lopes
Keyword(s):  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Dietary Patterns ◽  
Rio De Janeiro ◽  
Alcohol Intake ◽  
Dietary Habits ◽  
Intraclass Correlation ◽  
Kappa Statistics ◽  
Retest Reliability ◽  
Test Retest Reliability

CONTEXT: Epidemiological studies of the validity and reliability of self-reported information on important risk factors for non-communicable chronic diseases are scarce in Brazil. OBJECTIVE: We evaluated the test-retest reliability of information overall and stratified by gender, age and education on active and passive smoking, alcohol intake and aspects of dietary habits. TYPE OF STUDY: Test-retest reliability. SETTING: Universidade do Estado do Rio de Janeiro, Rio de Janeiro, Brazil. PARTICIPANTS: 192 University employees. PROCEDURES: Self-administered questionnaires were completed on two occasions, two weeks apart. MAIN MEASUREMENTS: Kappa Statistics; Intraclass Correlation Coefficient. RESULTS: Information on smoking status and pack-years smoked had almost perfect levels of agreement, respectively, kappa = 0.97 (95% CI, 0.92-1.00), and intraclass correlation coefficient = 0.93 (CI 95%, 0.89-0.96). Characteristics of alcohol intake yielded substantial levels of agreement (kappa ranging from 0.62 to 0.69). The reproducibility of the information on dietary habits varied from 0.67 to 0.79 (kappa). No clear-cut patterns could be identified comparing information by age or gender. There was a slight tendency towards greater reliability among people with higher levels of education. CONCLUSION: The reproducibility of information on smoking, drinking, and dietary patterns ranged from substantial to excellent, as investigated in the Pró-Saúde Study, a longitudinal investigation recently launched in Rio de Janeiro.

Test–Retest Reliability of Concussion Baseline Assessments in United States Service Academy Cadets: A Report from the National Collegiate Athletic Association (NCAA)–Department of Defense (DoD) CARE Consortium

2020 ◽  
pp. 1-12
Author(s):  
Megan N. Houston ◽  
Kathryn L. Van Pelt ◽  
Christopher D’Lauro ◽  
Rachel M. Brodeur ◽  
Darren E. Campbell ◽  
...  
Keyword(s):  
Mixed Model ◽  
Intraclass Correlation ◽  
Kappa Statistics ◽  
Management Service ◽  
Baseline Assessment ◽  
Test Interval ◽  
Retest Reliability ◽  
Service Academies ◽  
The Stability ◽  
Test Retest Reliability

Abstract Objective: In response to advancing clinical practice guidelines regarding concussion management, service members, like athletes, complete a baseline assessment prior to participating in high-risk activities. While several studies have established test stability in athletes, no investigation to date has examined the stability of baseline assessment scores in military cadets. The objective of this study was to assess the test–retest reliability of a baseline concussion test battery in cadets at U.S. Service Academies. Methods: All cadets participating in the Concussion Assessment, Research, and Education (CARE) Consortium investigation completed a standard baseline battery that included memory, balance, symptom, and neurocognitive assessments. Annual baseline testing was completed during the first 3 years of the study. A two-way mixed-model analysis of variance (intraclass correlation coefficent (ICC)3,1) and Kappa statistics were used to assess the stability of the metrics at 1-year and 2-year time intervals. Results: ICC values for the 1-year test interval ranged from 0.28 to 0.67 and from 0.15 to 0.57 for the 2-year interval. Kappa values ranged from 0.16 to 0.21 for the 1-year interval and from 0.29 to 0.31 for the 2-year test interval. Across all measures, the observed effects were small, ranging from 0.01 to 0.44. Conclusions: This investigation noted less than optimal reliability for the most common concussion baseline assessments. While none of the assessments met or exceeded the accepted clinical threshold, the effect sizes were relatively small suggesting an overlap in performance from year-to-year. As such, baseline assessments beyond the initial evaluation in cadets are not essential but could aid concussion diagnosis.

scholarly journals The Home Screen Media Environment of Saudi Toddlers

2021 ◽  
Author(s):  
Haifa Alroqi ◽  
Ludovica Serratrice ◽  
Thea Cameron-Faulkner
Keyword(s):  
Saudi Arabia ◽  
Young Children ◽  
Online Survey ◽  
Media Use ◽  
The United States ◽  
Mobile Media ◽  
Media Environment ◽  
Screen Media ◽  
Use Of Technology ◽  
Screen Media Use

The past few years have witnessed a rapid increase in the use of screen media by adults and children alike. Despite the widespread use of technology in Saudi Arabia, previous findings on Saudi children’s screen media use have been inconsistent and contradictory. The current study provides a comprehensive picture of screen media use among young children in Saudi Arabia. It explored the home screen media environment of 220 children aged 1 to 3 years, whose primary caregivers completed an online survey. Findings showed that the vast majority of these children had started using screens before the age of 2 years. On average, Saudi toddlers watched television for about 2 hours a day and used mobile media devices for about 1 hour a day. Their overall screen time was about 3 hours a day. Results also indicated that media use rates among Saudi toddlers are higher than those reported in the United States and the United Kingdom. The most viewed content genre on mobile media was children’s songs. Understanding children’s patterns of media use is an important first step in guiding the development of research-driven recommendations for all stakeholders on the use of screen media by young children.

scholarly journals Intra-Rater Test-Retest Reliability of a Modified Child Functioning Module, Self-Report Version

2020 ◽  
Vol 17 (19) ◽  
pp. 6958
Author(s):  
Kwok Ng ◽  
Piritta Asunta ◽  
Niko Leppä ◽  
Pauli Rintala
Keyword(s):  
Intraclass Correlation ◽  
Self Care ◽  
Self Report ◽  
Kappa Statistics ◽  
Young Adolescents ◽  
Special Educational Needs ◽  
Child Functioning ◽  
Retest Reliability ◽  
Functional Difficulties ◽  
Test Retest Reliability

Determining disability prevalence is a growing area for population statistics, especially among young adolescents. The Washington Group on Disability Statistics is one source of reporting disabilities through functional difficulties. Yet, young adolescents self-reporting through this measure is in its infancy. The purpose of this study was to carry out an intra-rater test-retest reliability study on a modified set of items for self-reporting functional difficulties. Young adolescents (N = 74; boys = 64%; age M = 13.7, SD = 1.8) with special educational needs in Finland completed a self-reported version of the Child Functioning Module in a supervised classroom. The second administration took place two weeks later. Intraclass correlation coefficient (ICC) and Kappa (k) statistics were used to test the reliability of the items, and interpretation took place through Landis and Koch, and Cohen, respectively. The majority of items had substantial or moderate agreement, although there was only fair agreement for self-care (ICC = 0.59), concentration (ICC = 0.50), and routine changes (ICC = 0.54). Kappa statistics of behavior control were interpreted to be large (k = 0.65), and seeing (k = 0.49), walking (k = 0.49), and speaking (k = 0.49) difficulties were moderate. The majority of the items in the self-reported version of the Child Functioning Module can be used in a scale format, although some caution may be required on items of self-care and concentration when used as a dichotomous variable.

scholarly journals Intra-Rater Test-Retest Reliability of Self-Reported Child Functioning Module

2020 ◽  
Author(s):  
Kwok Ng ◽  
Piritta Asunta ◽  
Niko Leppä ◽  
Pauli Rintala
Keyword(s):  
Intraclass Correlation ◽  
Self Care ◽  
Test Reliability ◽  
Kappa Statistics ◽  
Young Adolescents ◽  
Child Functioning ◽  
Retest Reliability ◽  
Functional Difficulties ◽  
Disability Prevalence ◽  
Test Retest Reliability

Determining disability prevalence is an important area for population statistics, especially among young adolescents. The Washington Group on Disability Statistics is one source of reporting disabilities through functional difficulties. However, young adolescents self-reporting this measure is in its infancy. The purpose of this study was to carry out an intra-rater test-retest reliability study on a modified set of items for self-reporting functional difficulties. Young adolescents (n=74; boys=64%; age m=13.7, SD=1.8) completed a self-reported version of the child functioning module in a supervised classroom. The second administration took place two weeks later. Intraclass correlation coefficient (ICC) and Kappa (k) statistics were used to test reliability of the items, and interpretation through Landis & Koch, and Cohen, respectively. The majority of items had substantial or moderate agreement, although there was only fair agreement for self-care (ICC=0.59), concentration (ICC=0.50), and routine (ICC=0.54). Kappa statistics of behaviour were interpreted to be large (k=0.65), and seeing (k=0.49), walking (k=0.49), and speaking (k=0.49) difficulties were moderate. The majority of the items in the self-reported version of the child functioning module can be used in a scale format, although some caution may be required on items of self-care and concentration when used as a dichotomous variable.

scholarly journals Test–Retest Reliability of a Questionnaire on Motives for Physical Activity among Adolescents

2020 ◽  
Vol 17 (20) ◽  
pp. 7551
Author(s):  
Jaroslava Kopcakova ◽  
Zuzana Dankulincova Veselska ◽  
Michal Kalman ◽  
Daniela Filakovska Bobakova ◽  
Dagmar Sigmundova ◽  
...  
Keyword(s):  
Physical Activity ◽  
Health Behavior ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Cross Sectional Study ◽  
Kappa Statistics ◽  
Cross Sectional ◽  
Retest Reliability ◽  
School Aged Children ◽  
Test Retest Reliability

The aim of this study was to investigate the test–retest reliability of the motives for undertaking physical activity (PA) items from the Health Behavior in School-Aged Children (HBSC) study questionnaire among Slovak and Czech adolescents and to determine whether this reliability differs by gender, age group and country. We obtained data from 580 students aged 11 and 15 years old (51.2% boys) who participated in a test and retest study with a four-week interval in 2013 via the Health Behavior in School-Aged Children cross-sectional study in the Czech Republic and Slovakia. We estimated the test–retest reliability of all 13 dichotomized motives by using Intraclass Correlation Coefficients (ICC) and Cohen’s Kappa statistics, for continuous and dichotomized motives, respectively. Test–retest reliability showed moderate agreement for nine motives (ICC from 0.41 to 0.60) and fair agreement for four motives (ICC from 0.33 to 0.40). Kappa statistics were similarly moderate to large (0.33 to 0.61), except for three motives with small or trivial correlations. The motives “To improve my health” and “To enjoy the feeling of using my body” had consistently low Kappas and correlations. Overall, the results of this study suggest that most questions on motives for PA on the HBSC questionnaire have acceptable test–retest characteristics for use among adolescents.

Test-Retest-Reliability of Computer-Based Metamorphopsia Measurement in Macular Diseases

2020 ◽  
Author(s):  
Daniela Claessens ◽  
Alexander K. Schuster ◽  
Ronald V. Krüger ◽  
Marian Liegl ◽  
Laila Singh ◽  
...  
Keyword(s):  
Macular Edema ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Measuring Method ◽  
Repeated Measurements ◽  
Retest Reliability ◽  
Macular Diseases ◽  
Computer Based ◽  
Test Retest Reliability

AbstractIn this study, the test-retest-reliability as one aspect of reliability of metamorphopsia measurements using a computer-based measuring method was determined in patients with macular diseases. Metamorphopsia amplitude, position, and area were quantified using AMD – A Metamorphopsia Detector software (app4eyes GmbH & Co. KG, Germany) in patients with diabetic, myopic, or uveitic macular edema, intermediate or neovascular age-associated macular degeneration, epiretinal membrane, vitelliform maculopathy, Irvine-Gass syndrome, or macular edema due to venous retinal occlusion. The intraclass correlation coefficient (ICC) was calculated in order to determine the repeatability of two repeated measurements and was used as an indicator of the reliability of the measurements. In this study, metamorphopsia measurements were conducted on 36 eyes with macular diseases. Metamorphopsia measurements made using AMD – A Metamorphopsia Detector software were highly reliable and repeatable in patients with maculopathies. The intraclass correlation coefficient of all indices was excellent (0.95 – 0.97). For diseases of the vitreoretinal interface or macular diseases with intra- or subretinal edema, this metamorphopsia measurement represents a supplement for visual function testing in the clinic, as well as in clinical studies.

scholarly journals Validation of a menstrual pictogram and a daily bleeding diary for assessment of uterine fibroid treatment efficacy in clinical studies

2020 ◽  
Vol 4 (1) ◽  
Author(s):  
Claudia Haberland ◽  
Anna Filonenko ◽  
Christian Seitz ◽  
Matthias Börner ◽  
Christoph Gerlinger ◽  
...  
Keyword(s):  
Uterine Fibroid ◽  
Full Range ◽  
Intraclass Correlation ◽  
Phase Iii ◽  
Measurement Properties ◽  
Retest Reliability ◽  
Response Options ◽  
Patient Global Impression ◽  
Patient Reported ◽  
Test Retest Reliability

Abstract Background To evaluate the psychometric and measurement properties of two patient-reported outcome instruments, the menstrual pictogram superabsorbent polymer-containing version 3 (MP SAP-c v3) and Uterine Fibroid Daily Bleeding Diary (UF-DBD). Test-retest reliability, criterion, construct validity, responsiveness, missingness and comparability of the MP SAP-c v3 and UF-DBD versus the alkaline hematin (AH) method and a patient global impression of severity (PGI-S) were analyzed in post hoc trial analyses. Results Analyses were based on data from up to 756 patients. The full range of MP SAP-c v3 and UF-DBD response options were used, with score distributions reflecting the cyclic character of the disease. Test-retest reliability of MP SAP-c v3 and UF-DBD scores was supported by acceptable intraclass correlation coefficients when stability was defined by the AH method and Patient Global Impression of Severity (PGI-S) scores (0.80–0.96 and 0.42–0.94, respectively). MP SAP-c v3 and UF-DBD scores demonstrated strong and moderate-to-strong correlations with menstrual blood loss assessed by the AH method. Scores increased in monotonic fashion, with greater disease severities, defined by the AH method and PGI-S scores; differences between groups were mostly statistically significant (P < 0.05). MP SAP-c v3 and UF-DBD were sensitive to changes in disease severity, defined by the AH method and PGI-S. MP SAP-c v3 and UF-DBD showed a lower frequency of missing patient data versus the AH method, and good agreement with the AH method. Conclusions This evidence supports the use of the MP SAP-c v3 and UF-DBD to assess clinical efficacy endpoints in UF phase III studies replacing the AH method.

Sign in / Sign up

Export Citation Format

Share Document