A Five-Stage Process for Establishing Contextually Valid Systematic Observation Instruments: The Case of Rugby Union

2002 ◽  
Vol 16 (2) ◽  
pp. 138-159 ◽  
Author(s):  
Clive J. Brewer ◽  
Robyn L. Jones
Keyword(s):  
Interobserver Agreement ◽  
Rugby Union ◽  
Face Validity ◽  
Validity And Reliability ◽  
Systematic Observation ◽  
Observation Instrument ◽  
Observation Instruments ◽  
Elite Level ◽  
Stage Process ◽  
Reliability Check

The purpose of this paper is to propose a five-stage process for establishing both validity and reliability in new systematic observation instruments. The process is contextualized within the working behaviors of elite level rugby union coaches within the practice setting. The sequential stages began with observer training and progressed through the identification of coaching behaviors through induction (to establish content validity), to establishing face validity through a domain-referenced test. The objectivity and reliability of the developed behavioral classifications are determined through an interobserver agreement test while, finally, the researcher’s ability to reliably reproduce data with the developed instrument is determined using a test/retest intraobserver reliability check. The developed instrument (the Rugby Union Coaches Observation Instrument: RUCOI) is deemed able to record the situationally unique behaviors arising from the nature of the sport and of the elite standard, both of which were considered to impinge upon the pedagogical process in the said context.

Trends and Analysis of Research on Teaching in Doctoral Programs

1987 ◽  
Vol 7 (1) ◽  
pp. 61-70 ◽  
Author(s):  
Stephen Silverman
Keyword(s):  
Data Analysis ◽  
Instrument Development ◽  
Teaching Methods ◽  
Doctoral Programs ◽  
Systematic Observation ◽  
Observation Instrument ◽  
Descriptive Research ◽  
Research On Teaching ◽  
Observation Instruments ◽  
Univariate Statistics

The purpose of this study was to describe and analyze research on teaching in doctoral programs. Research on teaching was differentiated from research on teacher education. Abstracts of research were obtained from Dissertation Abstracts International for dissertations completed from 1975 to 1984. Data were recorded for the year the dissertation was completed, primary and secondary (if any) focus of the study, observation instruments used, population, and the type of statistics used to analyze the data. Some 120 studies were identified as research on teaching in physical education. A majority of the studies (55) were comparisons of teaching methods using no observation instrument. Methods research was followed in frequency by descriptive research (22), instrument development (16), and comparisons among student subgroups (15). Systematic observation was not used in 60 studies. Of those studies where systematic observation was used, specific instruments were developed for research and other common instruments were employed. Most research occurred in elementary and secondary schools. A large proportion of the studies used univariate statistics to complete the data analysis.

The Development of a Behavior Checklist for Mentally Tough Behaviors in Volleyball

2020 ◽  
Vol 34 (3) ◽  
pp. 177-186
Author(s):  
Leilani Madrigal
Keyword(s):  
Behavioral Assessment ◽  
Mental Toughness ◽  
Systematic Observation ◽  
Mental Performance ◽  
Game Play ◽  
Observation Instrument ◽  
Stage Process ◽  
And Behaviors ◽  
Behavioral Checklist

Mental toughness is a factor related to performance, better coping, and increased confidence. There has been a growing trend toward assessing mental toughness behaviorally. The purpose of this paper was to develop a behavioral assessment of mental toughness in volleyball. Following a five-stage process to develop a systematic observation instrument, the current study identified 10 mental toughness behaviors in volleyball, specifically, six behaviors occurring during a play and four behaviors after a play (i.e., when a point is scored from the opposing team). Furthermore, eight behaviors represent mentally tough actions, while two behaviors represent mentally weak actions. The results indicate that the behavioral checklist is a reliable systematic observation instrument. Coaches and certified mental performance consultants can benefit from using this checklist by discussing mental toughness and behaviors corresponding to mental toughness during game play, and then have a quantifiable way to track behaviors with individuals and volleyball teams.

Development of the Assessment of Coach Emotions systematic observation instrument: A tool to evaluate coaches’ emotions in the youth sport context

2016 ◽  
Vol 11 (6) ◽  
pp. 859-871 ◽  
Author(s):  
Veronica Allan ◽  
Jennifer Turnnidge ◽  
Matthew Vierimaa ◽  
Paul Davis ◽  
Jean Côté
Keyword(s):  
Emotion Regulation ◽  
Youth Sport ◽  
Extensive Literature ◽  
Supporting Evidence ◽  
Coding System ◽  
Validity And Reliability ◽  
Systematic Observation ◽  
Observation Instrument ◽  
Sport Coaches ◽  
Recent Attention

Current research on emotions in sport focuses heavily on athletes’ intrapersonal emotion regulation; however, interpersonal consequences of emotion regulation are garnering recent attention. As leaders in sport, coaches have the opportunity to regulate not only their own emotions, but also those of athletes, officials, and spectators. As such, the present study set out to develop an observational tool, demonstrating evidence of validity and reliability, for measuring coaches’ overt emotions in the youth sport context. Categories were derived and refined through extensive literature and video review, resulting in 12 categories of behavioural content and eight emotion modifiers ( Neutral, Happy, Affectionate, Alert, Tense, Anxious, Angry and Disappointed). The final coding system is presented herein, complete with supporting evidence for validity and reliability. As a tool for both researchers and practitioners in sport, the Assessment of Coach Emotions (ACE) offers enhanced insight into the contextual qualities underlying coaches’ interactive behaviours.

scholarly journals Development of the Adult Pandemic Attitude Scale (A-PAS)

2021 ◽  
Vol 18 (12) ◽  
pp. 6311
Author(s):  
Mihyeon Seong ◽  
Juyoung Park ◽  
Soojin Chung ◽  
Sohyune Sok
Keyword(s):  
Construct Validity ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Item Analysis ◽  
Preliminary Investigation ◽  
Attitude Scale ◽  
Face Validity ◽  
Validity And Reliability ◽  
Five Dimensions ◽  
Development Step

This study aimed to develop an instrument for measuring the attitudes that reflect the characteristics of the pandemic (Adult Pandemic Attitude Scale (A-PAS)) and verifying its validity and reliability. This study used a methodological research design and was conducted with a development step and an evaluation step. The development step included development of preliminary items, content validity, face validity, and preliminary investigation. The evaluation step included item analysis, construct validity, convergent validity, discriminant validity, criterion validity, factor naming, reliability, and completion of the final instrument. The A-PAS developed in this study consisted of a total of 20 items in five dimensions. The internal consistency of 20 items of the A-PAS, Cronbach’s α was 0.92 for 20 items, Cronbach’s α for each factor, a subscale of instrument, was 0.61~0.87 and Raykov’s p coefficient of each factor, which is a subscale of the tool, was found to be 0.60 to 0.88. Analysis of construct validity showed the results as follows: χ2 (p) = 134.05 (p < 0.001), RMSEA = 0.02, RMR = 0.02, GFI = 0.94, CFI = 0.99. The study findings suggest that the developed instrument can be utilized to measure the attitudes of adults toward pandemics, and reflect the reality of the pandemic situation. The outcomes can be used as valuable data for intervention, prevention activities, and policy preparation. The instrument will be applied in the event of a pandemic, such as COVID-19, and will be helpful in promoting the health of the people.

Validation of a social-cognitive theory-based tool for measuring factors influencing obesity prevention behaviors in 4-6 years old children using confirmatory factor analysis (CFA)

2021 ◽  
Vol 15 (6) ◽  
pp. 2025-2030
Author(s):  
Maryam Seraji ◽  
Maryam Zahmatkeshan ◽  
Victoria Momen Abadi ◽  
Elham Nejadsadeghi
Keyword(s):  
Factor Analysis ◽  
Confirmatory Factor Analysis ◽  
Social Cognitive Theory ◽  
Obesity Prevention ◽  
Social Cognitive ◽  
Cognitive Theory ◽  
Child Obesity ◽  
Face Validity ◽  
Validity And Reliability ◽  
Confirmatory Factor

Background: Child obesity is one of the main health problems all across the world, which leads to mental and physical health problems. Various models are used in designing intervention to prevent child obesity, one of which is social-cognitive theory (SCT). The constructs of social-cognitive theory are commonly used for designing preventive interventions. However, there is no specific tool based on the constructs of social-cognitive theory to assess the factors associated with child obesity. Aim: The aim of this study was to investigate the validity and confirmatory factor analysis of a SCT-based questionnaire for assessing obesity preventing behaviors among 4-6 years old children. Method: A cross-sectional study was first conducted in 2016 on 240 preschool children aged 4-6 years in Behbahan city (a city in southwest Iran) to assess the obesity prevention behaviors among them using a SCT-based questionnaire. To investigate the validity and confirmatory factor analysis of the SCT-based questionnaire, content and face validity as well as forward-backward translation method were used. Reliability of the questionnaire was also measured by Cronbach’s alpha coefficient and Intra-class Correlation Coefficient (ICC). Construct validity was assured by confirmatory factor analysis. To measure the obesity prevention behaviors in 4-6 years old children, the construct of SCT, including environment, emotional coping, outcome expectations, goal setting and self-efficacy were used. Also, the obesity prevention behaviors used in the model included physical activity, consumption of fruit and vegetable, consumption of sugar-free drinks, and screen. Results: Results of this study confirmed the acceptable content and face validity of the SCT-based questionnaire. The results of confirmatory factor analysis also confirmed the factor loading of more than 0.3 for all variables; therefore, the SCT-based questionnaire had an acceptable validity and reliability. Conclusions: Since the SCT-based questionnaire had an acceptable validity and reliability, it can be used to assess the obesity prevention behaviors in 4-6 year old children, and also to design relevant educational interventions. Keywords: Validation, Social-Cognitive Theory, Behavior, Childhood obesity, Preschool, Prevention

A Systems Study on Interprofessional Collaboration in Healthcare

2021 ◽  
Vol 12 (3) ◽  
pp. 93-108
Author(s):  
Hironobu Matsushita ◽  
Carole Orchard ◽  
Katsumi Fujitani ◽  
Kaori Ichikawa
Keyword(s):  
Interprofessional Collaboration ◽  
Japanese Version ◽  
Face Validity ◽  
Validity And Reliability ◽  
Alpha Coefficient ◽  
Cross Sectional ◽  
Team Collaboration ◽  
Interprofessional Team ◽  
Excellent Internal Consistency ◽  
Acute Healthcare

This study aims to translate and adapt the Assessment of Interprofessional Team Collaboration Scale II (AITCS-II) cross-culturally for effective and systemic use in Japan, to describe floor and ceiling values, and to examine in terms of such criteria as reliability and face and content validity. The AITCS-II was translated from English into Japanese to develop the Japanese version of the Assessment of Interprofessional Team Collaboration Scale II (hereinafter referred to AITCS-II-J). Then, cross-sectional and cross-professional data analyses were carried out to seek evidence of construct validity. Analysis demonstrated good content and face validity. With a Cronbach's alpha coefficient greater than 0.9 (r varied from 0.912 to 0.940), the AITCS-II-J exhibited excellent internal consistency. The AITCS-II-J showed evidence of acceptable validity and reliability; therefore, this measurement system will be useful for informing the enhancement of interprofessional team collaboration within the Japanese acute healthcare context.

scholarly journals Designing a Comprehensive Pattern of Structural-Psychological Empowerment for Employees of Medical Sciences Universities

2019 ◽  
Vol 8 ◽  
pp. e1486
Author(s):  
Nayereh Sadat Roohollahi ◽  
Iravan Masoudi Asl ◽  
Somayeh Hessam ◽  
Mahmoud Mahmodi
Keyword(s):  
Internal Consistency ◽  
Cultural Context ◽  
Psychological Empowerment ◽  
Face Validity ◽  
Exploratory Research ◽  
Validity And Reliability ◽  
Medical Sciences ◽  
Significance Level ◽  
Self Sufficiency ◽  
Bachelor's Degrees

Background: The concept of empowerment requires the abandonment of traditional models. The need to design and develop employee empowerment patterns has been emphasized in several studies. The present study aims to design a comprehensive structural-psychological empowerment pattern for employees of medical sciences universities. Materials and Methods: Our exploratory research was conducted on 410 employees of medical universities of Tehran, Iran, and Islamic Azad University. Firstly, a primary pattern was designed according to a review of available literature, texts, patterns, and tools. Then, the psychometric analysis was done using validation (face validity, content validity, construct validity, factor validity) and reliability (internal consistency and stability). Lastly, the final pattern was introduced after having been approved by experts. Data were analyzed using SPSS version 24 and AMOS software. P<0.05 was considered as the significance level. Results: Based on our study, 83.9% of participants were holders of bachelor's degrees or higher degrees. The results of validation (face, content, structure, and confirmation validity) and reliability (internal consistency [α=0.90] and stability [0.91] ) showed that the structural-psychological empowerment pattern was appropriate, which was validated with 31 items and 8 domains. The scope of this pattern included resources, self-sufficiency, competence, support, effectiveness, and opportunity, significance, and information domains. The highest impact on the model was related to the support domain (impact factor=0.87). Conclusion: The present pattern is an appropriate and verified Iranian model in the field of structural-psychological empowerment, which is suggested in the cultural context of Iran, especially in medical universities.[GMJ.2019;8:e1486] 

scholarly journals Validity and Reliability of the Scale, Role Taking in Caregivers of People with Chronic Disease, ROL

10.3823/2575 ◽  
2018 ◽  
Vol 11 ◽  
Author(s):  
Mauricio Arias ◽  
Sonia Carreño ◽  
Lorena Chaparro
Keyword(s):  
Factor Analysis ◽  
Chronic Disease ◽  
Construct Validity ◽  
Internal Consistency ◽  
Content Validity ◽  
Three Dimensions ◽  
Face Validity ◽  
Validity And Reliability ◽  
Role Taking ◽  
Phase Study

Objective: To determine face, content, and construct validity, and internal consistency of ROL scale. Methods and Findings: A three-phase study was conducted. First, content analysis of the scale was carried out consulting 10 professional experts. Then, face validity was analyzed with 60 caregivers. Finally, construct validity was evaluated by performing an exploratory factor analysis (EFA) with 110 participants. Internal consistency of ROL scale was also assessed. Face validity of ROL scale reached a high acceptance index in three dimensions: role performance (0.97), role organization (0.98), and response to the role (0.98). Content validity showed coherence, clarity, and relevance of the scale. From factor analysis, three components emerged and were grouped in the same manner for varimax, quartimax, and equimax rotations. Cronbach's alpha was 0.816, which is an acceptable overall value. Conclusion: ROL scale makes objective the concept of role taking in family caregivers of people with chronic disease. It demonstrated to have acceptable reliability, and construct, face, and content validity to be used in the Colombian context. Keywords: Validation Study, Caregivers, Health Transitions, Chronic Disease.

Sign in / Sign up

Export Citation Format

Share Document