scholarly journals Adaptation and Validation of the Program Sustainability Assessment Tool (PSAT) for Use in the Elementary School Setting

2021 ◽  
Vol 18 (21) ◽  
pp. 11414
Author(s):  
Alix Hall ◽  
Adam Shoesmith ◽  
Rachel C. Shelton ◽  
Cassandra Lane ◽  
Luke Wolfenden ◽  
...  
Keyword(s):  
Public Health ◽  
Physical Activity ◽  
Elementary School ◽  
Convergent Validity ◽  
Interrater Reliability ◽  
Assessment Tool ◽  
Sustainability Assessment ◽  
School Setting ◽  
Program Sustainability ◽  
Structural Validity

There is a lack of valid and reliable measures of determinants of sustainability specific to public health interventions in the elementary school setting. This study aimed to adapt and evaluate the Program Sustainability Assessment Tool (PSAT) for use in this setting. An expert reference group adapted the PSAT to ensure face validity. Elementary school teachers participating in a multi-component implementation intervention to increase their scheduling of physical activity completed the adapted PSAT. Structural validity was assessed via confirmatory factor analysis. Convergent validity was assessed using linear mixed regression evaluating the associations between scheduling of physical activity and adapted PSAT scores. Cronbach’s alpha was used to evaluate internal consistency and intracluster correlation coefficients for interrater reliability. Floor and ceiling effects were also evaluated. Following adaptation and psychometric evaluation, the final measure contained 26 items. Domain Cronbach’s alpha ranged from 0.77 to 0.92. Only one domain illustrated acceptable interrater reliability. Evidence for structural validity was mixed and was lacking for convergent validity. There were no floor and ceiling effects. Efforts to adapt and validate the PSAT for the elementary school setting were mixed. Future work to develop and improve measures specific to public health program sustainment that are relevant and psychometrically robust for elementary school settings are needed.

scholarly journals The Program Sustainability Assessment Tool: A New Instrument for Public Health Programs

2014 ◽  
Vol 11 ◽  
Author(s):  
Douglas A. Luke ◽  
Annaliese Calhoun ◽  
Christopher B. Robichaux ◽  
Michael B. Elliott ◽  
Sarah Moreland-Russell
Keyword(s):  
Public Health ◽  
Assessment Tool ◽  
Sustainability Assessment ◽  
Health Programs ◽  
Program Sustainability ◽  
Public Health Programs ◽  
New Instrument

Children’s Physical Activity While Gardening: Development of a Valid and Reliable Direct Observation Tool

2015 ◽  
Vol 12 (4) ◽  
pp. 522-528 ◽  
Author(s):  
Beth M. Myers ◽  
Nancy M. Wells
Keyword(s):  
Physical Activity ◽  
New York ◽  
Elementary Schools ◽  
Convergent Validity ◽  
Interrater Reliability ◽  
Assessment Tool ◽  
New York State ◽  
Activity Level ◽  
Momentary Time Sampling ◽  
Children’S Physical Activity

Background:Gardens are a promising intervention to promote physical activity (PA) and foster health. However, because of the unique characteristics of gardening, no extant tool can capture PA, postures, and motions that take place in a garden.Methods:The Physical Activity Research and Assessment tool for Garden Observation (PARAGON) was developed to assess children’s PA levels, tasks, postures, and motions, associations, and interactions while gardening. PARAGON uses momentary time sampling in which a trained observer watches a focal child for 15 seconds and then records behavior for 15 seconds. Sixty-five children (38 girls, 27 boys) at 4 elementary schools in New York State were observed over 8 days. During the observation, children simultaneously wore Actigraph GT3X+ accelerometers.Results:The overall interrater reliability was 88% agreement, and Ebel was .97. Percent agreement values for activity level (93%), garden tasks (93%), motions (80%), associations (95%), and interactions (91%) also met acceptable criteria. Validity was established by previously validated PA codes and by expected convergent validity with accelerometry.Conclusions:PARAGON is a valid and reliable observation tool for assessing children’s PA in the context of gardening.

CODEM Instrument

GeroPsych ◽  
2014 ◽  
Vol 27 (1) ◽  
pp. 23-31 ◽  
Author(s):  
Anne Kuemmel (This author contributed eq ◽  
Julia Haberstroh (This author contributed ◽  
Johannes Pantel
Keyword(s):  
Convergent Validity ◽  
Interrater Reliability ◽  
Discriminant Validity ◽  
Assessment Tool ◽  
Intraclass Correlation ◽  
Well Being ◽  
Communication Behavior ◽  
People With Dementia ◽  
Pearson's R ◽  
Pearson’S R

Communication and communication behaviors in situational contexts are essential conditions for well-being and quality of life in people with dementia. Measuring methods, however, are limited. The CODEM instrument, a standardized observational communication behavior assessment tool, was developed and evaluated on the basis of the current state of research in dementia care and social-communicative behavior. Initially, interrater reliability was examined by means of videoratings (N = 10 people with dementia). Thereupon, six caregivers in six German nursing homes observed 69 residents suffering from dementia and used CODEM to rate their communication behavior. The interrater reliability of CODEM was excellent (mean κ = .79; intraclass correlation = .91). Statistical analysis indicated that CODEM had excellent internal consistency (Cronbach’s α = .95). CODEM also showed excellent convergent validity (Pearson’s R = .88) as well as discriminant validity (Pearson’s R = .63). Confirmatory factor analysis verified the two-factor solution of verbal/content aspects and nonverbal/relationship aspects. With regard to the severity of the disease, the content and relational aspects of communication exhibited different trends. CODEM proved to be a reliable, valid, and sensitive assessment tool for examining communication behavior in the field of dementia. CODEM also provides researchers a feasible examination tool for measuring effects of psychosocial intervention studies that strive to improve communication behavior and well-being in dementia.

scholarly journals Using the Program Sustainability Assessment Tool to Assess and Plan for Sustainability

2014 ◽  
Vol 11 ◽  
Author(s):  
Annaliese Calhoun ◽  
Avia Mainor ◽  
Sarah Moreland-Russell ◽  
Ryan C. Maier ◽  
Laura Brossart ◽  
...  
Keyword(s):  
Assessment Tool ◽  
Sustainability Assessment ◽  
Program Sustainability

scholarly journals Efecto del ejercicio y la actividad física sobre las funciones ejecutivas en niños y en jóvenes. Una revisión sistemática

2019 ◽  
Vol 8 (2) ◽  
pp. 43-53
Author(s):  
JA Medina-Cascales ◽  
F. Alarcón-López ◽  
A. Castillo-Díaz ◽  
D. Cárdenas-Vélez
Keyword(s):  
Public Health ◽  
Physical Activity ◽  
Assessment Tool ◽  
Public Health Practice ◽  
Google Scholar ◽  
Healthy Children ◽  
Health Practice ◽  
Revisión Sistemática ◽  
Web Of Knowledge ◽  
Effective Public Health

En la presente revisión sistemática cualitativa se intenta avanzar en el conocimiento sobre la incidencia de la actividad física sobre las funciones ejecutivas, focalizada en poblaciones sanas infantiles, adolescentes y jóvenes. Se identificaron, categorizaron y analizaron artículos de bases de datos electrónicas como ISI Web of Knowledge, SCOPUS, PubMed, SPORTDiscus, PsyINFO, ERIC, Google Scholar y Dialnet. Atendiendo a los criterios de inclusión/exclusión, siguiendo la declaración PRISMA para registrar y categorizar los resultados, y mediante la herramienta de evaluación de calidad “The Effective Public Health Practice Project”, se seleccionaron finalmente 44 investigaciones experimentales, estructuradas en episodios agudos y crónicos de actividad física bajo dos enfoques: cuantitativos y cualitativos. Los resultados muestran una superior cantidad de experimentos con episodios agudos cuantitativos (45,45%), frente a los agudos cualitativos (18,18%), crónicos cuantitativos (20,45%) y crónicos cualitativos (15,92%). Los análisis de estas investigaciones han permitido identificar los beneficios de los diferentes tipos de actividad física estudiados sobre los componentes ejecutivos. This qualitative systematic review tries to advance knowledge about the effect of physical activity on executive functions, paying special attention to healthy children, teenagers and youngsters.  Several articles have been identified, categorized and analyzed in electronic databases such as ISI Web of Knowledge, SCOPUS, PubMed, SPORTDiscus, PsyINFO, ERIC, Google Scholar and Dialnet. According to the inclusion/exclusion criteria, following the PRISMA statement to record and categorize the results and throughout the quality assessment tool "The Effective Public Health Practice Project”, 44 pieces of research, structured in acute and chronic episodes of physical activity under two approaches: qualitative and quantitative, were chosen. The results show a higher number of experiments with quantitative acute episodes (45,45%) against qualitative ones (18,18%), chronic quantitative (20,45%) and chronic qualitative episodes (15,92%). The analysis of these investigations has allowed identifying the benefits of different types of physical activity studied on executive components.

Program Sustainability Assessment Tool

2014 ◽  
Author(s):  
Douglas A. Luke ◽  
Annaliese Calhoun ◽  
Christopher B. Robichaux ◽  
Michael B. Elliott ◽  
Sarah Moreland-Russell
Keyword(s):  
Assessment Tool ◽  
Sustainability Assessment ◽  
Program Sustainability

Psychosocial Aspects of Exercise and Physical Activity in Childhood

2015 ◽  
Vol 27 (1) ◽  
pp. 26-29
Author(s):  
Lindsay E. Kipp
Keyword(s):  
Physical Activity ◽  
Construct Validity ◽  
Youth Development ◽  
Internal Consistency ◽  
Life Skills ◽  
Convergent Validity ◽  
Assessment Tool ◽  
Evaluation Research ◽  
Internal Consistency Reliability ◽  
Skills Transfer

Purpose:A signature characteristic of positive youth development (PYD) programs is the opportunity to develop life skills, such as social, behavioral, and moral competencies, that can be generalized to domains beyond the immediate activity. Although context-specific instruments are available to assess developmental outcomes, a measure of life skills transfer would enable evaluation of PYD programs in successfully teaching skills that youth report using in other domains. The purpose of our studies was to develop and validate a measure of perceived life skills transfer, based on data collected with The First Tee, a physical activity-based PYD program.Method:In 3 studies, we conducted a series of steps to provide content and construct validity and internal consistency reliability for the life skills transfer survey (LSTS), a measure of perceived life skills transfer.Results:Study 1 provided content validity for the LSTS that included 8 life skills and 50 items. Study 2 revealed construct validity (structural validity) through a confirmatory factor analysis and convergent validity by correlating scores on the LSTS with scores on an assessment tool that measures a related construct. Study 3 offered additional construct validity by reassessing youth 1 year later and showing that scores during both time periods were invariant in factor pattern, loadings, and variances and covariances. Studies 2 and 3 demonstrated internal consistency reliability of the LSTS.Conclusion:Results from 3 studies provide evidence of content and construct validity and internal consistency reliability for the LSTS, which can be used in evaluation research with youth development programs.

Sign in / Sign up

Export Citation Format

Share Document