generalizability analysis
Recently Published Documents


TOTAL DOCUMENTS

62
(FIVE YEARS 13)

H-INDEX

15
(FIVE YEARS 1)

2021 ◽  
Vol 3 ◽  
Author(s):  
Juan Pablo Morillo-Baro ◽  
Belén Troyano-Gallegos ◽  
José Luis Pastrana-Brincones ◽  
Juan Antonio Vázquez-Diz ◽  
Rafael E. Reigal ◽  
...  

The open nature of basketball gives it a large uncertainty that makes hard the tactical analysis of the situations that happen in the game. Specifically, screens are one of the offensive tactical elements most used in basketball and one example of a tactical situation that needs the highest preparation level to get a good performance in the competition. The aim of this study is to differentiate these player behaviors by gender using data mining and polar coordinates analysis. Therefore, one ad hoc observational tool made by 17 criteria and 97 exhaustive and mutually exclusive (E/ME) categories has been designed and validated using the data quality analysis (correlation coefficients and concordance index 0.98) and generalizability analysis (G coefficients 0.94) to perform such a study. The observational design is nomothetic, punctual, and multidimensional. A total of 176 ball screens situations have been analyzed for the men's category and 118 for women's category, corresponding to three different teams of each gender playing in the highest competition level in Spain during the 2018/2019 season using Hoisan software tool. The analysis of the relationships among behaviors has been performed using Polar Coordinates analysis as well as data mining analysis: clustering and decision tree classifier. Results show significant relationships that allow us to tactically interpret the pick and roll situations in men's and women's professional basketball players in Spain, allowing us to develop more intervention programs which will optimize training and improve players performance.


2021 ◽  
Vol 21 (68) ◽  
Author(s):  
Marta Terroba ◽  
Juan Miguel Ribera ◽  
Daniel Lapresa Ajamil ◽  
M. Teresa Anguera

Se presenta una secuencia de problemas de dificultad creciente para desarrollar el pensamiento computacional en el primer nivel del segundo ciclo de Educación Infantil -3 años- mediante un robot de suelo de direccionalidad programada. En el seno de la metodología observacional se ha conseguido caracterizar la capacidad de pensamiento computacional de los escolares de Educación Infantil-3años, en los diferentes problemas que conforman la propuesta de intervención diseñada. La fiabilidad de los datos, en forma de concordancia inter-observadores, ha sido garantizada mediante el coeficiente Kappa. Un análisis de generalizabilidad avala el muestreo observacional realizado. El desarrollo de las capacidades de organización espacial y autoevaluación del alumno, así como la intervención de la maestra, se han relevado como aspectos claves en la resolución de problemas matemáticos por medio del pensamiento computacional en Educación Infantil-3años. A sequence of problems of increasing difficulty is presented to develop computational thinking in the first level of the second cycle of Early Childhood Education -3 years- by means of a programmed directionality ground robot. With the use the observational methodology, it has been possible to characterize the computational thinking capacity of Early Childhood Education -3 years old- schoolchildren, in the different problems that make up the intervention proposal designed. The reliability of the data has been guaranteed, in the form of inter-observer agreement, by means of the Cohen's Kappa coefficient. A generalizability analysis supports the observational sampling carried out. The development of the capacities of spatial organization and self-evaluation of the student, as well as the intervention of the teacher, have been revealed as key aspects in the resolution of mathematical problems through computational thinking in Early Childhood Education -3 years old-.


2021 ◽  
Vol 12 ◽  
Author(s):  
Wei Chen ◽  
Rongfen Gao

The level of meaning in life not only affects the physical health of individuals, but also is closely related to their mental health. At present, many self-reported questionnaires are being used to measure the meaning in life of Chinese adolescents. Using the multivariate generalizability theory, this study investigated the psychometric properties and the internal structure of the Meaning in Life Questionnaires (MLQs), the most widely used questionnaire for assessing the level of meaning in life of Chinese adolescents. The data were sample of 1,951 junior high school students from Guizhou, China. Multivariate random measurement mode p × i° is the primary analytic approach. Results showed that the generalizability coefficient and dependability index of the scale were 0.86 and 0.85, respectively. The generalizability coefficients of presence of meaning and search for meaning were 0.76 and 0.85, respectively, and the dependability indexes were 0.75 and 0.85 for MLQ-P and MLQ-S, respectively. The design of each factor for MLQ is reasonable in terms of score ratio and the number of projects. In brief, the reliability and factor structure of the scale are satisfactory.


2021 ◽  
Author(s):  
Monica Pena Acosta ◽  
Faridaddin Vahdatikhaki ◽  
Joao Oliveira dos Santos ◽  
Amin Hammad ◽  
Andre Doree

2021 ◽  
pp. JNM-D-20-00003
Author(s):  
Ida Torunn Bjørk ◽  
Karin Larsen ◽  
Monika Ravik ◽  
Inger Åse Reierson ◽  
Irene Sommer ◽  
...  

Background and PurposeMany newly graduated nurses lack proficiency in practical skill performance. Presently, nursing students’ practical skill is assessed by summative instruments with overarching items. The purpose of this study was to develop a more detailed instrument to use in summative assessment of nursing students’ practical skill performance and to assess its psychometric properties.MethodsA 50-item instrument was developed. Video-recorded performances were rated by experienced clinical supervisors. A multifacet measurement design was developed. Relevant parameters were estimated by generalizability analysis.ResultsFindings indicated that error of measurement were mainly caused by raters far more than by items. Conclusions: The present study suggested that summative assessment in realistic settings may not apply one rater only. Two to three/four raters appear necessary to dependably measure most skills.


2021 ◽  
Vol 13 (12) ◽  
pp. 6780
Author(s):  
Rubén Sánchez-López ◽  
Ibon Echeazarra ◽  
Julen Castellano

The use of instruments for the evaluation of a player’s procedural tactical knowledge (PTK) in sociomotor sports, such as football, is a line of research of growing interest since it allows a pertinent description of the player’s football competence. The aim of this study is to configure and validate an ad-hoc observational tool that allows evaluating the player’s PTK, understood as football competence, from the observation, coding and recording of the roles, the actions of the acquired subroles and the operational and specific principles of football in the attack and defense phases. Based on the Delphi method, a field format coding instrument was designed and validated where each criterion is a system of categories, exhaustive and mutually exclusive. The results showed excellent content validity (9.02 out of 10), and high values of intra-observer stability (k = 0.747) and inter-observer agreement (k = 0.665). Generalizability analysis showed an excellent reliability (G = 0.99). Additionally, the construct validity of the tool was calculated through a small-sided game Gk + 4v4 + Gk, using two independent samples: semi-professional and amateur players. The results reflected significant differences (α < 0.05) between both samples in the variables total score, offensive score and defensive score. Therefore, this study provides a valid and reliable instrument that allows data collection in a rigorous and pertinent way, as well as their analysis and evaluation in attack and defense according to the roles of the players and based on the motor behaviors that they perform using the subroles that they acquired, associated with the technical dimension, along with the principles that they develop in parallel, in support of the tactical dimension.


CJEM ◽  
2020 ◽  
Vol 22 (S1) ◽  
pp. S34-S34
Author(s):  
S. Dewhirst ◽  
W. Cheung ◽  
N. Dudek ◽  
T. Wood ◽  
J. Frank

Introduction: The Ottawa Emergency Department Shift Observation Tool (O-EDShOT) was recently developed to assess a resident's ability to safely run an ED shift and is supported by multiple sources of validity evidence. The O-EDShOT uses entrustability scales, which reflect the degree of supervision required for a given task. It was found to discriminate between learners of different levels, and to differentiate between residents who were rated as able to safely run the shift and those who were not. In June 2018 we replaced norm-based daily encounter cards (DECs) with the O-EDShOT. With the ideal assessment tool, most of the score variability would be explained by variability in learners’ performances. In reality, however, much of the observed variability is explained by other factors. The purpose of this study is to determine what proportion of total score variability is accounted for by learner variability when using norm-based DECs vs the O-EDShOT. Methods: This was a prospective pre-/post-implementation study, including all daily assessments completed between July 2017 and June 2019 at The Ottawa Hospital ED. A generalizability analysis (G study) was performed to determine what proportion of total score variability is accounted for by the various factors in this study (learner, rater, form, pgy level) for both the pre- and post- implementation phases. We collected 12 months of data for each phase, because we estimated that 6-12 months would be required to observe a measurable increase in entrustment scale scores within a learner. Results: A total of 3908 and 3679 assessments were completed by 99 and 116 assessors in the pre- and post- implementation phases respectively. Our G study revealed that 21% of total score variance was explained by a combination of post-graduate year (PGY) level and the individual learner in the pre-implementation phase, compared to 59% in the post-implementation phase. An average of 51 vs 27 forms/learner are required to achieve a reliability of 0.80 in the pre- and post-implementation phases respectively. Conclusion: A significantly greater proportion of total score variability is explained by variability in learners’ performances with the O-EDShOT compared to norm-based DECs. The O-EDShOT also requires fewer assessments to generate a reliable estimate of the learner's ability. This study suggests that the O-EDShOT is a more useful assessment tool than norm-based DECs, and could be adopted in other emergency medicine training programs.


2019 ◽  
Vol 20 (1) ◽  
pp. 103-117
Author(s):  
Jorge Jimenez Salas ◽  
Juan Pablo Morillo Baro ◽  
Rafael E. Reigal ◽  
Verónica Morales-Sánchez ◽  
Antonio Hernández-Mendo

El objetivo de este estudio fue analizar la relación de diferentes comportamientos tácticos ofensivos con las conductas mostradas en los dos principales sistemas defensivos en balonmano. Para ello se realizó un análisis de coordenadas polares utilizando como conductas focales aquellas que identifican los principales sistemas defensivos y las acciones ofensivas con o sin transformaciones. Se observaron 538 situaciones correspondientes a 5 partidos de la primera división nacional española masculina con el software Hoisan utilizándose una herramienta diseñada ad hoc. El diseño observacional usado fue nomotético, puntual y seguimiento, siendo la unidad de observación la situación de defensa del equipo observado. Los resultados del análisis de la Calidad del Dato y Generalizabilidad muestran índices convincentes para los modelos utilizados. Los resultados del análisis de Coordenadas Polares muestran la mayor capacidad de oposición del sistema defensivo 5:1 al ataque. También destaca que la transformación atacante de 3:3 a 2:4 se usa más ante defensas abiertas y elicita el aumento de aparición de sanciones disciplinarias La herramienta observacional diseñada y la utilización de la técnica de coordenadas polares para la estimación de relaciones tácticas permite definir procedimientos de intervención que optimicen los recursos del entrenamiento y la competición en balonmano. The objective of this study was to analyze the relationship of different offensive tactical performances with the behaviours shown in the two main defensive systems in handball. For this, an analysis of polar coordinates was carried out using as focal behaviors those wich identify the main defensive systems and the offensive actions with or without transformations. There were 538 situations corresponding to 5 matches of the first Spanish national men's division with the Hoisan software by making use of an ad hoc tool. The observational design used was nomothetic, punctual and monitoring, the observation unit being the defense situation of the monitored team. The results of the Data Quality and Generalizability analysis show convincing rates for the models used. The results of the Polar Coordinates analysis show the greater oppositional capacity of the 5: 1 defensive system to attack. It also highlights that the attacking transformation from 3:3 to 2:4 is used more in the face of open defenses and it elicits an increase in the appearances of disciplinary sanctions. The observational tool designed and the use of the polar coordinate technique for the estimation of tactical relationships allows to define intervention procedures that optimize the resources of training and competition in handball. O objetivo deste estudo foi analisar a relação de diferentes comportamentos táticos ofensivos com os comportamentos mostrados nos dois principais sistemas defensivos do handebol. Para tanto, foi realizada uma análise das coordenadas polares utilizando como comportamentos focais aqueles que identificam os principais sistemas defensivos e as ações ofensivas com ou sem transformações. Havia 538 situações correspondentes a 5 partidas da primeira divisão masculina nacional espanhola com o software Hoisan, usando uma ferramenta projetada ad hoc. O desenho observacional utilizado foi nomotético, pontual e de acompanhamento, sendo a unidade de observação a situação de defesa do equipamento observado. Os resultados da análise de qualidade dos dados e generalização mostram índices convincentes para os modelos utilizados. Os resultados da análise das coordenadas polares mostram a maior capacidade de oposição do sistema defensivo 5: 1 de ataque. Destaca também que a transformação de ataque de 3: 3 para 2: 4 é mais usada em face de defesas abertas e provoca o aumento da aparência de sanções disciplinares. A ferramenta de observação projetada e o uso da técnica de coordenadas polares para a estimativa de relações táticas permitem definir procedimentos de intervenção que otimizam os recursos de treinamento e competição no handebol.


2019 ◽  
Vol 10 ◽  
Author(s):  
Lee J. Moore ◽  
Paul Freeman ◽  
Adrian Hase ◽  
Emma Solomon-Moore ◽  
Rachel Arnold

Sign in / Sign up

Export Citation Format

Share Document