scholarly journals Using Generalizability Theory in the Evaluation of L2 Writing 一般化可能性理論を用いた高校生の自由英作文評価の検討

2005 ◽  
Vol 27 (2) ◽  
pp. 169 ◽  
Keyword(s):  
High School ◽  
High School Students ◽  
Variance Components ◽  
Rating Scales ◽  
Rating Scale ◽  
Generalizability Theory ◽  
Composition Profile ◽  
L2 Writing ◽  
Sufficient Information ◽  
School Students

This paper aims to investigate the characteristics of the evaluation of L2 writing—particularly free English compositions by Japanese high school students—using Generalizability Theory (G theory). Although usually considered to be a difficult topic to examine, the evaluation of free compositions can be thoroughly investigated by using G theory. It enables researchers to provide sufficient information regarding the main effects and the interactions of complicated factors within an evaluation by examining its measurement errors. I focused on two factors (more specifically, facets) in order to obtain the data on the evaluation of free compositions. These facets were: (a) the raters—10 high school teachers (expert raters) teaching English at a national high school and two public high schools, and six university students (novice raters) studying English language education at a national university; and (b) the rating scales, which were Jacobs, Zinkgraf, Wormuth, Hartfiel, and Hughey’s (1981) ESL Composition Profile, and a modified version of Kantenbetsu Hyoka of the National Institute for Educational Policy Research (2002). Using these scales, the raters (expert and novice raters) evaluated free compositions written by 20 high school students studying at a national high school in the Chugoku region of Japan. The type of G theory design used in this paper is termed a two-facet crossed design (all the raters evaluate all the compositions using all the items of the rating scales). Studies using G theory are usually comprised of two substudies: a Generalizability Study (G study) and a Decision Study (D study). A G study investigates the manner in which the facets and their interactions (termed as sources of variance) affected the evaluation results by estimating the magnitude of variance components. A D study investigates the degree of reliability of the evaluation by examining generalizability coefficients, which correspond to classical test theory’s reliability coefficients, using simulations that vary the number of raters or items of the rating scales. The G study in this paper dealt with seven sources of variance—persons (p), raters (r), rating scale items (i), and their interactions (p x r, p x i, r x i, and p x r x i). The D study in this paper particularly focused on varying the number of raters for simulations. Several observations resulting from both the G study and the D study were as follows: (a) there was a halo effect tendency in the evaluations by the expert raters because the estimated variance components of the interactions of the sources of variance p x r and r x i were large; (b) the novice raters’ rating experience was insufficient to perform reliable evaluations because the generalizability coefficients of both of the rating scales were low, while the estimated variance component of the interaction of the sources of variance p x r x i, which is regarded as unmeasured error, was large; and (c) the ESL Composition Profile was a more reliable rating scale than the Kantenbetsu Hyoka as shown by the D study simulation results. This paper presentsseveral pedagogical implications based on the results with reference to improvement in the evaluation of free compositions. In particular, I have presented possible methods of diagnostically utilizing the results of G theory to develop and modify the rating scales, and to train the raters.

ATTRIBUTION OF PERSONAL CHARACTERISTICS IN TWO CULTURES

1978 ◽  
Vol 6 (1) ◽  
pp. 117-133 ◽  
Author(s):  
M. Y. Quereshi
Keyword(s):  
High School ◽  
High School Students ◽  
Rating Scales ◽  
Rating Scale ◽  
Personal Characteristics ◽  
Female Students ◽  
School Students ◽  
Ability Test ◽  
Two Cultures ◽  
Perceptual Differentiation

Data on a set of rating scales and on an ability test were collected from 766 persons in two cultures. The American sample (n = 413) consisted of 186 college (90 male and 96 female) and 227 high school (110 male and 117 female) students. The Pakistani sample (n =353) consisted of 170 college (75 male and 95 female) and 183 high school (96 male and 87 female) students. Every person rated self and 15 significant others on a rating scale and took an ability test involving letter-series items. Results of factor analyses and multivariate analyses of variance demonstrated (a) substantial cross-cultural generality of psychosocial characteristics attributed to self and others, (b) significant (p < 0.001) cultural differences in self-esteem and esteem of others, as well as in perceptual differentiation, (c) significant (p <0.05) differences between males and females in the level of esteem and in perceptual diversity, (d) significant (p < 0.05) differences between high and low ability persons and between college and high school students in measures of esteem and perceptual discrimination, and (e) significant (p < 0.05) interaction effects involving two or more of the four independent variables (culture, education, ability, and sex). Results generally confirmed the main hypotheses postulated here and in some other related studies.

scholarly journals Developing an instrument for measuring the spiritual attitude of high school students

2018 ◽  
Vol 4 (1) ◽  
pp. 35-44 ◽  
Author(s):  
Safa'at Ariful Hudha ◽  
Djemari Mardapi
Keyword(s):  
High School ◽  
High School Students ◽  
Construct Validity ◽  
Goodness Of Fit ◽  
Rating Scale ◽  
Operational Definition ◽  
School Students ◽  
Average Variance ◽  
Instrument Reliability ◽  
Spiritual Attitude

Attitudinal competence is one the most fundamental concepts in social psychology. It is related to personal identity, moral, and ethics that gains popularity and becomes important in educational development. This research aims to develop an instrument to measure the spiritual attitude of high school students. The study was a research and development study consisting of four stages: (a) determining conceptual definition, (b) determining operational definition, (c) drawing indicators, and (d) constructing instrument. The quantitative data analysis was used to test the construct validity through Confirmatory Factor Analysis and the coefficient of construct reliability was used to estimate the instrument reliability. The results of the study show that: (1) the instrument to measure Moslems’ spiritual attitude is an inventory model of summated rating scale containing 35 items; (2) the construct validity was proven by the value of the standardized loading factor and considered as significant. The instrument reliability regarded as the construct reliability coefficient is 0.890 and the average variance extracted is 0.542; (3) the construct of the instrument produces a fit statistical evidence indicated by the Goodness of Fit Index = 0.91 (≥0.90), and Root Mean Square Error of Approximation = 0.032 (≤0.08). The results indicate that the construct of the measurement is suitable with the data. In addition, this research has confirmed that the spiritual attitude of high school students is constructed by seven aspects, namely resignation (tawakal), sincerity (ikhlas), thankfulness (syukur), patience (shabr), fear (khauf), hopefulness (raja’), and righteousness (takwa).

scholarly journals A Pilot Study of Social Competence Assessment Using Interaction Rating Scale Advanced

2011 ◽  
Vol 2011 ◽  
pp. 1-6 ◽  
Author(s):  
T. Anme ◽  
T. Watanabe ◽  
K. Tokutake ◽  
E. Tomisaki ◽  
Y. Mochizuki ◽  
...  
Keyword(s):  
High School ◽  
High School Students ◽  
Social Skills ◽  
Pilot Study ◽  
Social Competence ◽  
Rating Scale ◽  
Competence Assessment ◽  
Evidence Based ◽  
School Students ◽  
Practical Evaluation

Purpose. The purpose of this paper is to clarify the validity of the Interaction Rating Scale Advanced (IRSA) as an evidence-based practical index of social skills. Methods. The participants in our study were 17 high school students. The participants completed the five-minute interaction session and were observed using the IRSA. Their teacher evaluated their social competence based on regular observation in school. Results. The results indicated the high correlation between IRSA scores and teacher's practical evaluation. IRSA can measure social competence with high validity. Conclusion. The IRSA provides further evidence of the fact that in order to study social competence development, it is important to evaluate various features of the interaction like IRSA subscales.

scholarly journals High school students’ feelings: Discoveries from a large national survey and an experience sampling study

2019 ◽  
Author(s):  
Julia Moeller ◽  
Marc A. Brackett ◽  
Zorana Ivcevic ◽  
Arielle E. White
Keyword(s):  
High School ◽  
High School Students ◽  
School Engagement ◽  
Rating Scales ◽  
Experience Sampling ◽  
School Students ◽  
Demographic Groups ◽  
Positive Feelings ◽  
The Moment ◽  
Nation Wide Survey

We investigated students’ feelings at high school in a nation-wide survey of 21,678 US students (study 1), and in a four-week study using experience sampling methodology (ESM) with 472 students across 5 high schools (study 2). Both studies combined mixed methods, including open-ended questions and rating scales (e.g., PANAS). In study 1, seventy-five percent of the feelings students reported in their responses to open-ended questions were negative. The three most frequently mentioned feelings were “tired”, “stressed”, and “bored”. Similar findings emerged with rated items, The prevalence of negative feelings was largely similar across demographic groups. Study 2 largely corroborated the findings from study 1. Although the retrospective measures showed similar results to study 1, the in-the-moment measures also showed frequent positive feelings. We discuss the findings in light of the ‘sleep deprivation epidemic’, the school engagement literature, and implications for the validity of state- and trait measures of academic emotions.

Sequential explanatory analysis of environmental awareness towards responsible environmental behavior (REB) of high school students in Depok City, West Java, Indonesia

2021 ◽  
Vol 2 (1) ◽  
pp. 33-40
Author(s):  
Novia El Savada ◽  
Eka Suhardi ◽  
Rita Istiana
Keyword(s):  
High School ◽  
High School Students ◽  
Quantitative Data ◽  
Rating Scale ◽  
Environmental Behavior ◽  
Environmental Awareness ◽  
School Students ◽  
Kolmogorov Smirnov ◽  
Responsible Environmental Behavior ◽  
Sequential Explanatory

Objective of this study is to obtain information about the interrelationship between environmental awareness and the responsible environmental behavior of high school students. Research conducted toward students of the Masjid Terminal  High School (SMA) at Depok City in December 2019 to July 2020 with samples of 111 respondents by proportional random sampling technique. A mix-method was employed in this study, which is a combination of quantitative and qualitative methods as sequential explanatory. Collection of quantitative data was conducted using a questionnaire with rating scale for X and Y variables. The validity test used Pearson's product moment and the reliability test used alpha Cronbach. The analysis of quantitative data with a prerequisite test in the form of a normality test employed the Kolmogorov-Smirnov test and a homogeneity test using a Levine statistic. Testing the data hypothesis was using the correlation test with Pearson product moment using SPSS 26. Qualitative research data was obtained from the interviews, and the data was analyzed by reducing data, presenting data and drawing conclusions. The results showed that there was a positive correlation between environmental awareness and responsible environmental behavior with the regression equation Ŷ = 99.939 + 0.161x with a correlation coefficient of r = 0.195 and r2 of 3.80%. The contribution of r2 means that 3.80% of responsible environmental behavior is influenced by environmental awareness, while 96.20% is influenced by other factors. Based on above results, can be conclude that there are positive correlation between environmental awareness and responsible environmental behavior which influenced by the factors of family background, habits, information, as well as social environment.Tujuan penelitian ini adalah untuk memperoleh informasi tentang hubungan antara kesadaran lingkungan dengan perilaku tanggung jawab lingkungan pada siswa SMA. Penelitian dilakukan terhadap siswa sekolah (SMA/High School) Masjid Terminal, Kota Depok, Jawa Barat, pada bulan Desember 2019 hingga Juli 2020 dengan jumlah sampel 111 responden dengan teknik proporsional random sampling. Mix-method digunakan dalam penelitian ini, yang merupakan kombinasi antara metode kuantitatif dan kualitatif sebagai sequential explanatory. Pengumpulan data kuantitatif dilakukan dengan menggunakan kuesioner dengan skala sikap (rating scale) untuk variabel X dan Y. Uji validitas menggunakan Pearson’s product moment dan uji reliabilitas menggunakan alpha Cronbach. Analisis data kuantitatif dengan uji prasyarat berupa uji normalitas menggunakan uji Kolmogorov-Smirnov dan uji homogenitas menggunakan statistik Levine. Pengujian hipotesis data menggunakan uji korelasi dengan Pearson’s product moment menggunakan SPSS 26. Data penelitian kualitatif diperoleh dari wawancara, dan data dianalisis dengan mereduksi data, menyajikan data dan menarik kesimpulan. Hasil penelitian menunjukkan bahwa terdapat hubungan positif antara kesadaran lingkungan dengan perilaku tanggung jawab lingkungan dengan persamaan regresi Ŷ = 99,939 + 0,161x dengan koefisien korelasi r = 0,195 dan r2 sebesar 3,80%. Kontribusi r2 berarti 3,80% perilaku tanggung jawab lingkungan dipengaruhi oleh kesadaran lingkungan, sedangkan 96,20% dipengaruhi oleh faktor-faktor lain. Berdasarkan hasil di atas, dapat disimpulkan bahwa terdapat hubungan positif antara kesadaran lingkungan dengan perilaku tanggung jawab lingkungan yang dipengaruhi oleh faktor latar belakang keluarga, kebiasaan, informasi, serta lingkungan sosial.

scholarly journals Rasch Analysis, Dimensionality, and Scoring of Aggressive Behavior Inventory for Junior High-School Students

2021 ◽  
Vol 58 (1) ◽  
pp. 4067-4080
Author(s):  
Afdal Afdal Et al.
Keyword(s):  
High School ◽  
High School Students ◽  
Aggressive Behavior ◽  
Junior High School ◽  
Rasch Analysis ◽  
Rating Scale ◽  
Junior High ◽  
Threshold Value ◽  
Junior High School Students ◽  
School Students

Aggressive behavior often appears in junior high-school students who are entering adolescent development and requires serious attention from many parties. To measure these behavioral tendencies, many assessment instruments have been developed but none of them use Item Response Theory. This study aims to develop and test the validity of the instrument of aggressive behavior of junior high-school students, see the level of suitability of the item and see the level of difficulty of the item and be able to see variable maps of the ability of the person to answer and the ability of items to reveal aggressive behavior. This study used a sample of 360 students with 47 items. The analysis technique used is Rasch analysis to test the reliability, person validity, item validity, and rating validity. The analysis showed that overall the inventory developed is valid and reliable (person reliability is 0.89 and item reliability is 0.98.) The rating scale results using the Andrich Threshold Value indicate that the five choices given are valid for respondents. It can be concluded that the inventory behavior aggressive is valid internally to assess aggressive behavior of junior high-school students and can be used by teachers, school counselors in identifying aggressive behavior.

scholarly journals Psychological Status of High School Students 1 Year After the COVID-19 Emergency

2021 ◽  
Vol 12 ◽  
Author(s):  
Cong Zhou ◽  
Rongqin Li ◽  
Mingchuan Yang ◽  
Shanshan Duan ◽  
Chuanming Yang
Keyword(s):  
High School ◽  
High School Students ◽  
Sleep Disturbances ◽  
Rating Scale ◽  
Sleep Problems ◽  
Anxiety Symptoms ◽  
Psychological Status ◽  
Depression Symptoms ◽  
Cross Sectional Survey ◽  
School Students

Background: With the control of the epidemic, adolescents' mental outlook might have improved. However, little evidence existed with regard to the psychological status of adolescents in post-COVID-19 era. This present study aimed to explore the psychological status of high school students after the epidemic getting eased.Methods: A web-based cross-sectional survey was used to obtain data from three high schools, including the demographic information, the Patient Health Questionnaire-9 (PHQ-9), the Generalized Anxiety Disorder-7 (GAD-7), the Self-Rating Scale of Sleep (SRSS), and self-designed general recent-status questionnaire. Correlation analysis was performed to explore potential associations between the depression symptoms, anxiety symptoms, and sleep status. The PHQ-9 and GAD-7 differences between nowadays data and the data enrolled 12 months before were also compared.Result: A total of 1,108 qualified questionnaires were obtained. The prevalence of depressive and anxious symptoms was 27.5 and 21.3%, respectively, from mild to severe in all students, while 11.8% of these high students got sleep disturbances. Both the rate and the severity of depression, anxiety and sleep problems of female students were higher than male students. Grade three students suffered higher prevalence and severer mental disturbances than the other two grades. There were significant correlations between the depression symptoms, anxiety symptoms, and sleep status. The psychological status has been improved in nowadays high school students compared with the sample enrolled 12 months before.Conclusion: As a supplement to our former study, this present research provided a perspective on the psychological status of high school students 1 year after the COVID-19 pandemic being well controlled. We should pay attention to the psychological status of high school students, and should also notice the progresses made by this special group after the epidemic.

scholarly journals HUBUNGAN PERSEPSI HARAPAN ORANG TUA TERHADAP PENGAMBILAN JURUSAN SMA/SMK SISWA KELAS VIII SMPN 1 BALONGBENDO

2020 ◽  
Vol 4 (2) ◽  
pp. 46
Author(s):  
Pief Gustida Aji Rajasa
Keyword(s):  
High School ◽  
High School Students ◽  
Junior High School ◽  
Rating Scale ◽  
Total Sample ◽  
Vocational School ◽  
Vocational High School ◽  
School Students ◽  
Eighth Grade Students ◽  
Using Data

Abstract   This research is the result of observations we made in the field about the perspective of elections in high school / vocational high school students held by parents' expectations. The purpose of this study was to examine the expectations of parents of eighth grade students of SMP Negeri 1 Balongbendo in choosing majors in high school / vocational school. This research is a quantitative study using a correlational descriptive method using data collection techniques in the form of a questionnaire with a total of 22 question items and using a Likert scale rating scale. The population of this research is students of class VIII of SMP Negeri 1 Balongbendo taken as a sample with a total sample of 35 students. An interesting result is the child's perception of expectations that have been adjusted to the selection of high school / vocational school majors in junior high school students.Keywords: Parental expectations, career, outlook, decision making.

Sign in / Sign up

Export Citation Format

Share Document