scholarly journals Simple questionnaires outperform behavioral tasks to measure socio-emotional skills in students

2022 ◽  
Vol 12 (1) ◽  
Author(s):  
Mélusine Boon-Falleur ◽  
Adrien Bouguen ◽  
Axelle Charpentier ◽  
Yann Algan ◽  
Élise Huillery ◽  
...  
Keyword(s):  
Academic Achievement ◽  
Cognitive Development ◽  
Empirical Research ◽  
Behavioral Outcomes ◽  
Reliability And Validity ◽  
Self Control ◽  
Education Economics ◽  
Life Outcomes ◽  
Behavioral Task ◽  
Emotional Skills

AbstractRecent empirical research has shown that improving socio-emotional skills such as grit, conscientiousness and self-control leads to higher academic achievement and better life outcomes. However, both theoretical and empirical works have raised concerns about the reliability of the different methods used to measure socio-emotional skills. We compared the reliability and validity of the three leading measurements methods—a student-reported questionnaire, a teacher-reported questionnaire, and a behavioral task—in a sample of 3997 French students. Before analyzing the data, we polled 114 international researchers in cognitive development and education economics; most researchers in both fields predicted that the behavioral task would be the best method. We found instead that the teacher questionnaire was more predictive of students’ behavioral outcomes and of their grade progression, while the behavioral task was the least predictive. This work suggests that researchers may not be using optimal tools to measure socio-emotional skills in children.

scholarly journals Measuring socio-emotional skills in schools: simple questionnaires outperform behavioral tasks

2020 ◽  
Author(s):  
Melusine Boon-Falleur ◽  
Adrien Bouguen ◽  
Axelle Charpentier ◽  
Yann Algan ◽  
Elise Huillery ◽  
...  
Keyword(s):  
Academic Achievement ◽  
Cognitive Development ◽  
Empirical Research ◽  
Behavioral Outcomes ◽  
Reliability And Validity ◽  
Self Control ◽  
Education Economics ◽  
Life Outcomes ◽  
Behavioral Task ◽  
Emotional Skills

Recent empirical research has shown that improving socio-emotional skills such as grit, conscientiousness and self-control leads to higher academic achievement and better life outcomes. However, both theoretical and empirical works have raised concerns about the reliability of the different methods used to measure socio-emotional skills. We compared the reliability and validity of the three leading measurements methods - a student-reported questionnaire, a teacher-reported questionnaire, and a behavioral task - in a sample of 3,997 French students. Before analyzing the data, we polled 114 experts in cognitive development and education economics; most experts in both fields predicted that the behavioral task would be the best method. We found instead that the teacher questionnaire was more predictive of students' behavioral outcomes and of their grade progression, while the behavioral task was the least predictive. This work suggests that researchers may not be using optimal tools to measure socio-emotional skills in children.

scholarly journals Attitudes Towards Self-change: A Comparison of Japanese and American University Students

1995 ◽  
Vol 18 (4) ◽  
pp. 577-593 ◽  
Author(s):  
David S. Crystal ◽  
Kazuo Kato ◽  
Sheryl Olson ◽  
Hirozumi Watanabe
Keyword(s):  
United States ◽  
College Students ◽  
Academic Achievement ◽  
University Students ◽  
Empirical Research ◽  
Cognitive Abilities ◽  
The United States ◽  
The Self ◽  
Self Control ◽  
American University

This study examined attitudes related to the possibility of changing cognitions and behaviours among samples of college students in the United States and Japan. Students were asked to identify three things about themselves that they wanted to change, the method they would use to effect these changes, how difficult they thought making such changes would be, and how much they desired to make the changes. Japanese and US students differed significantly in the frequency with which they mentioned all seven aspects of the self that were targeted for change. Students in the United States expressed a desire to improve their sociability, academic achievement and cognitive abilities, physical appearance, and sense of individuality. Students in Japan were most concerned about enhancing their relationships with others, self-control and motivation, and ability to manage practical affairs. In addition, US respondents were more likely than their Japanese counterparts to use behaviour-oriented strategies, to believe it was easy to make self-changes, and to indicate a strong desire to improve the self. The findings are discussed in the context of theories describing different cultural construals of self, and of empirical research on differences between collectivistic and individualistic cultures.

scholarly journals Same Data Set, Different Conclusions: Preschool Delay of Gratification Predicts Later Behavioral Outcomes in a Preregistered Study

2020 ◽  
Vol 31 (2) ◽  
pp. 193-201 ◽  
Author(s):  
Laura E. Michaelson ◽  
Yuko Munakata
Keyword(s):  
Problem Behavior ◽  
Multilevel Models ◽  
Behavioral Outcomes ◽  
Secondary Analysis ◽  
Delay Of Gratification ◽  
Self Control ◽  
Life Outcomes ◽  
Data Set ◽  
Early Environment ◽  
Adolescent Outcomes

One simple marshmallow test in preschool children predicts an array of important life outcomes, according to multiple studies spanning several decades. However, a recent conceptual replication casts doubt on these famous findings. We conducted an independent, preregistered secondary analysis to test whether previously observed longitudinal associations between preschool delay of gratification and adolescent outcomes would be conceptually replicated. Associations were significant for three of the five outcomes we tested using the analytic approach employed in the original studies of the marshmallow test. Relationships between delay of gratification and problem behavior held in bivariate, multivariate, and multilevel models; in contrast, no significant relationships between delay and problem behavior were found in the other recent replication, even though both studies used the same data set. These relationships were better explained by social support than by self-control, suggesting that the marshmallow test is predictive because it reflects aspects of a child’s early environment that are important over the long term. This novel interpretation of the classic findings points to new directions for intervention.

scholarly journals Same dataset, different conclusions: Preschool delay of gratification predicts later behavioral outcomes in a preregistered study

2019 ◽  
Author(s):  
Laura Elizabeth Michaelson ◽  
Yuko Munakata
Keyword(s):  
Problem Behavior ◽  
Multilevel Models ◽  
Behavioral Outcomes ◽  
Secondary Analysis ◽  
Delay Of Gratification ◽  
Self Control ◽  
Life Outcomes ◽  
Data Set ◽  
Early Environment ◽  
Adolescent Outcomes

One simple marshmallow test in preschool children predicts an array of important life outcomes, according to multiple studies spanning several decades. However, a recent conceptual replication casts doubt on these famous findings. We conducted an independent, preregistered secondary analysis to test whether previously observed longitudinal associations between preschool delay of gratification and adolescent outcomes would be conceptually replicated. Associations were significant for three of the five outcomes we tested using the analytic approach employed in the original studies of the marshmallow test. Relationships between delay of gratification and problem behavior held in bivariate, multivariate, and multilevel models; in contrast, no significant relationships between delay and problem behavior were found in the other recent replication, even though both studies used the same data set. These relationships were better explained by social support than by self-control, suggesting that the marshmallow test is predictive because it reflects aspects of a child’s early environment that are important over the long term. This novel interpretation of the classic findings points to new directions for intervention.

Inhibition tasks are not associated with self-regulation outcomes in healthy college students

2019 ◽  
Author(s):  
Curtis David Von Gunten ◽  
Bruce D Bartholow ◽  
Jorge S. Martins
Keyword(s):  
Latent Variable ◽  
Convergent Validity ◽  
Self Regulation ◽  
Poor Performance ◽  
Self Control ◽  
Self Report ◽  
Life Outcomes ◽  
Variable Level ◽  
Cast Doubt ◽  
The Individual

Executive functioning (EF) is defined as a set of top-down processes used in reasoning, forming goals, planning, concentrating, and inhibition. It is widely believed that these processes are critical to self-regulation and, therefore, that performance on behavioral task measures of EF should be associated with individual differences in everyday life outcomes. The purpose of the present study was to test this core assumption, focusing on the EF facet of inhibition. A sample of 463 undergraduates completed five laboratory inhibition tasks, along with three self-report measures of self-control and 28 self-report measures of life outcomes. Results showed that although most of the life outcome measures were associated with self-reported self-control, none of the life outcomes were associated with inhibition task performance at the latent-variable level, and few associations were found at the individual task level. These findings challenge the criterion validity of lab-based inhibition tasks. More generally, when considered alongside the known lack of convergent validity between inhibition tasks and self-report measures of self-control, the findings cast doubt on the task’s construct validity as measures of self-control processes. Potential methodological and theoretical reasons for the poor performance of laboratory-based inhibition tasks are discussed.

Early Adverse Childhood Experiences and Self-Control Development among Youth in Fragile Families

2021 ◽  
pp. 0044118X2199637
Author(s):  
Melissa S. Jones ◽  
Hayley Pierce ◽  
Constance L. Chapple
Keyword(s):  
Life Course ◽  
Adverse Childhood Experiences ◽  
Behavioral Outcomes ◽  
Self Control ◽  
Fragile Families ◽  
Childhood Experiences ◽  
Considerable Research ◽  
Adverse Childhood ◽  
Using Data

Though considerable research links both a lack of self-control and adverse childhood experiences (ACEs) to a variety of negative health and behavioral outcomes, few studies to date have explored whether ACEs are associated with deficits in self-control. Using data from the Fragile Families and Child Wellbeing Study (FFCW; n = 3,444) and a life course theoretical framework, this study aims to address this gap in the literature by examining the relationships between individual ACEs, cumulative ACEs, timing of ACEs, and durations of early ACEs and self-control development among youth. Our results indicate that as the number of ACEs (by age 5) experienced incrementally increases, the likelihood of reported self-control decreases. Moreover, when it comes to the timing and duration of ACE exposure, ACEs that are high but late, intermittent, or chronically high significantly decrease self-control. Based on our findings, researchers should continue to explore the role of ACEs in youth self-control development.

scholarly journals Feasibility of Race by Sex Intersectionality Research on Suicidality in the Adolescent Brain Cognitive Development (ABCD) Study

Children ◽  
2021 ◽  
Vol 8 (6) ◽  
pp. 437
Author(s):  
Shervin Assari ◽  
Shanika Boyce ◽  
Mohsen Bazargan
Keyword(s):  
Cognitive Development ◽  
Sample Size ◽  
Child Behavior Checklist ◽  
Reliability And Validity ◽  
Self Report ◽  
Large Sample Size ◽  
Cross Sectional ◽  
Cronbach Alpha ◽  
Rich Data ◽  
Suicidal Ideas

Intersectional research on childhood suicidality requires studies with a reliable and valid measure of suicidality, as well as a large sample size that shows some variability of suicidality across sex by race intersectional groups. Objectives: We aimed to investigate the feasibility of intersectionality research on childhood suicidality in the Adolescent Brain Cognitive Development (ABCD) study. We specifically explored the reliability and validity of the measure, sample size, and variability of suicidality across sex by race intersectional groups. Methods: We used cross-sectional data (wave 1) from the ABCD study, which sampled 9013 non-Hispanic white (NHW) or non-Hispanic black (NHB) children between the ages of 9 and 10 between years 2016 and 2018. Four intersectional groups were built based on race and sex: NHW males (n = 3554), NHW females (n = 3158), NHB males (n = 1164), and NHB females (n = 1137). Outcome measure was the count of suicidality symptoms, reflecting all positive history and symptoms of suicidal ideas, plans, and attempts. To validate our measure, we tested the correlation between our suicidality measure and depression and Child Behavior Checklist (CBCL) sub-scores. Cronbach alpha was calculated for reliability across each intersectional group. We also compared groups for suicidality. Results: We observed some suicidality history in observed 3.2% (n = 101) of NHW females, 4.9% (n = 175) of NHW males, 5.4% (n = 61) of NHB females, and 5.8% (n = 68) of NHB males. Our measure’s reliability was acceptable in all race by sex groups (Cronbach alpha higher than .70+ in all intersectional groups). Our measure was valid in all intersectional groups, documented by a positive correlation with depression and CBCL sub-scores. We could successfully model suicidality across sex by race groups, using multivariable models. Conclusion: Given the high sample size, reliability, and validity of the suicidality measure, variability of suicidality, it is feasible to investigate correlates of suicidality across race by sex intersections in the ABCD study. We also found evidence of higher suicidality in NHB than NHW children in the ABCD study. The ABCD rich data in domains of social context, self-report, schools, parenting, psychopathology, personality, and brain imaging provides a unique opportunity to study intersectional differences in neural circuits associated with youth suicidality.

scholarly journals The Issue of Alternative Assessment on Students' Achievement from the Viewpoints of Teachers’ at Elementary Schools in Gaza

2019 ◽  
Vol 8 (2S3) ◽  
pp. 414-418
Keyword(s):  
Academic Achievement ◽  
Elementary Schools ◽  
Alternative Assessment ◽  
Gaza Strip ◽  
Reliability And Validity ◽  
Study Population ◽  
The Gaza Strip ◽  
Level Of Significance ◽  
High Level ◽  
High Degree

This study aimed at identifying the effect of alternative assessment on academic achievement, from the viewpoint of teachers in elementary schools in Gaza. To achieve the study objectives, a questionnaire developed consisting of 21 items then reliability and validity were calculated, the study population consisted of 120 teachers. The study sample consisted of 92 teachers, selected in a stratified random method, where the total of 87 valid statistical analyzes retrieved by 94.56%. The results of the study showed: The perceptions of the members of the study sample to the alternative assessment came to a high degree, the academic achievement from teachers in the basic schools in the Gaza Strip came at the macro level at a high level, and there is a statistically significant effect at the level of significance (α<=0.05) of alternative assessment on academic achievement. In light of the results, a set of recommendations were proposed, including The Directorate of Education in the Gaza Strip should be concerned with the adoption of alternative assessment methods in its affiliated schools, because of the importance of alternative assessment in improving the level of academic achievement of students

Sign in / Sign up

Export Citation Format

Share Document