scholarly journals A Methodologically Improved Study on Raters’ Personality and Rating Severity in Writing Assessment

SAGE Open ◽  
2021 ◽  
Vol 11 (2) ◽  
pp. 215824402110094
Author(s):  
Yu Zhu ◽  
Andy Shui-Lung Fung ◽  
Liuyan Yang
Keyword(s):  
Writing Assessment ◽  
Large Scale ◽  
Measurement Model ◽  
Order Effect ◽  
Language Program ◽  
Writing Assessments ◽  
Relevant Variables ◽  
Homogeneous Background ◽  
The Relationship ◽  
Practical Implications

Personality is an inherent rater’s characteristic influencing rating severity, but very few studies examined their relationship and the findings were inconclusive. This study aimed to re-investigate the relationship between raters’ personality and rating severity with more control on relevant variables and more reliable analysis of rating severity. Female novice raters ( n = 28) from a demographically homogeneous background were recruited to rate on two occasions essays written by 111 students in an intermediate-level Chinese as a foreign language program. Raters’ personality traits were measured using the complete version of NEO-PI-R. Many-faceted Rasch measurement model and repeated measurement were applied to yield more robust estimates of rating severity. In addition, rating order effect was carefully controlled. Extroversion was found to be positively correlated with severity, r(26) = .495, p = .010. Furthermore, Extroversion was found to be a valid predictor of severity, t(24) = 2.792, p = .010, R2 = .21, Cohen’s d = .77, Hattie’s r = .37. Practical implications for developing more individualized online rater calibration for large-scale writing assessments were discussed, followed by limitations of the present study.

Math coaches, specialists, and student achievement: Learning from the data

2020 ◽  
Vol 102 (3) ◽  
pp. 42-45
Author(s):  
Kristin E. Harbour ◽  
Evthokia Stephanie Saclarides
Keyword(s):  
Student Achievement ◽  
Teaching And Learning ◽  
Large Scale ◽  
Elementary Mathematics ◽  
National Assessment ◽  
Mathematics Coaches ◽  
Professional Development Model ◽  
Using Data ◽  
The Relationship ◽  
Practical Implications

To support continuous professional development model in the teaching and learning of mathematics, many districts and schools have begun hiring elementary mathematics coaches and/or specialists (MCSs). However, limited large-scale empirical research exists that determines how the use of MCSs affect student learning and achievement. Kristin E. Harbour and Evthokia Stephanie Saclarides begin to fill in this gap by using data from the National Assessment of Educational Progress to explore the relationship between the presence and responsibilities of elementary MCSs and 4th-grade student achievement in mathematics. Based on their findings, they share practical implications for districts and administrators to consider.

scholarly journals Differences Across Levels in the Language of Agency and Ability in Rating Scales for Large-Scale Second Language Writing Assessments

2017 ◽  
Vol 52 (2) ◽  
pp. 147-172
Author(s):  
Salena Sampson Anderson
Keyword(s):  
Second Language ◽  
Writing Assessment ◽  
Large Scale ◽  
Second Language Writing ◽  
Rating Scales ◽  
Reliability And Validity ◽  
College Level ◽  
Writing Assessments ◽  
The Public ◽  
Language Writing

Abstract While large-scale language and writing assessments benefit from a wealth of literature on the reliability and validity of specific tests and rating procedures, there is comparatively less literature that explores the specific language of second language writing rubrics. This paper provides an analysis of the language of performance descriptors for the public versions of the TOEFL and IELTS writing assessment rubrics, with a focus on linguistic agency encoded by agentive verbs and language of ability encoded by modal verbs can and cannot. While the IELTS rubrics feature more agentive verbs than the TOEFL rubrics, both pairs of rubrics feature uneven syntax across the band or score descriptors with either more agentive verbs for the highest scores, more nominalization for the lowest scores, or language of ability exclusively in the lowest scores. These patterns mirror similar patterns in the language of college-level classroom-based writing rubrics, but they differ from patterns seen in performance descriptors for some large-scale admissions tests. It is argued that the lack of syntactic congruity across performance descriptors in the IELTS and TOEFL rubrics may reflect a bias in how actual student performances at different levels are characterized.

scholarly journals Effects Of Large-Scale Structure Upon The Determination Of Ho From Time Delays

1996 ◽  
Vol 173 ◽  
pp. 91-92
Author(s):  
G.C. Surpi ◽  
D.D. Harari ◽  
J.A. Frieman
Keyword(s):  
Hubble Parameter ◽  
Time Delays ◽  
Large Scale ◽  
Angular Position ◽  
Order Effect ◽  
Gravitational Lens ◽  
Leading Order ◽  
Lens System ◽  
The Relationship

We have analyzed the effects of both large-scale inhomogeneities in the mass distribution and cosmological gravitational waves upon the time delay between two images in a gravitational lens system. We have shown that their leading order effect, which could potentially bias the determination of the Hubble parameter, is indistinguishable from a change in the relative angle between the source and the lens axis. Since the absolute angular position of the source is not directly measurable, nor does it enter the relationship between the Hubble parameter and the lens observables, the determination of Ho from gravitational lens time delays follows in the usual way, as if the metric perturbations were absent.

Screening ability of private insurers in the federal crop insurance program

2019 ◽  
Vol 79 (1) ◽  
pp. 107-118 ◽  
Author(s):  
Sangkyun Park
Keyword(s):  
Crop Insurance ◽  
Federal Agency ◽  
The Novel ◽  
Content Type ◽  
Economic Significance ◽  
Insurance Program ◽  
Relevant Variables ◽  
The Relationship ◽  
Practical Implications ◽  
Better Than

Purpose The purpose of this paper is to scrutinize the structure of the federal crop insurance program and test whether participating private insurers screen insurance buyers better than the federal agency. Design/methodology/approach This paper regresses the claim payout on the risk share of private insurers in insurance pools and other relevant variables. The claim payout should be negatively related with the private insurers’ risk share if private insurers screen insurance buyers better than the federal agency. Findings The payout rates are significantly lower for reinsurance funds with higher risk shares of AIPs, and the relationship between the two variables is not affected much by the aggregate yield (similar relationship in good crop years and bad crop years). Practical implications The federal government could improve the effectiveness and the efficiency of the crop insurance program by restructuring its delivery system. Originality/value The novel contributions of this paper include estimating the economic significance of private insurers’ screening advantage and showing that the economic significance is similar in good crop years and bad crop years.

Relationship between total plasma homocysteine and the risk of aneurysms – a meta-analysis

VASA ◽  
2020 ◽  
pp. 1-6
Author(s):  
Hanji Zhang ◽  
Dexin Yin ◽  
Yue Zhao ◽  
Yezhou Li ◽  
Dejiang Yao ◽  
...  
Keyword(s):  
Large Scale ◽  
Meta Analysis ◽  
Single Species ◽  
Total Plasma ◽  
Control Groups ◽  
Randomized Controlled ◽  
Randomized Controlled Studies ◽  
The Difference ◽  
The Relationship ◽  
Healthy Participants

Summary: Our meta-analysis focused on the relationship between homocysteine (Hcy) level and the incidence of aneurysms and looked at the relationship between smoking, hypertension and aneurysms. A systematic literature search of Pubmed, Web of Science, and Embase databases (up to March 31, 2020) resulted in the identification of 19 studies, including 2,629 aneurysm patients and 6,497 healthy participants. Combined analysis of the included studies showed that number of smoking, hypertension and hyperhomocysteinemia (HHcy) in aneurysm patients was higher than that in the control groups, and the total plasma Hcy level in aneurysm patients was also higher. These findings suggest that smoking, hypertension and HHcy may be risk factors for the development and progression of aneurysms. Although the heterogeneity of meta-analysis was significant, it was found that the heterogeneity might come from the difference between race and disease species through subgroup analysis. Large-scale randomized controlled studies of single species and single disease species are needed in the future to supplement the accuracy of the results.

The Relationship Between Leader–Member Exchange and Employees’ Proactive Behaviors

2019 ◽  
Vol 18 (2) ◽  
pp. 106-111
Author(s):  
Fong-Yi Lai ◽  
Szu-Chi Lu ◽  
Cheng-Chen Lin ◽  
Yu-Chin Lee
Keyword(s):  
Hierarchical Linear Modeling ◽  
Future Research ◽  
Leader Member Exchange ◽  
Voice Behavior ◽  
Linear Modeling ◽  
Team Members ◽  
Member Exchange ◽  
Multi Temporal ◽  
The Relationship ◽  
Practical Implications

Abstract. The present study proposed that, unlike prior leader–member exchange (LMX) research which often implicitly assumed that each leader develops equal-quality relationships with their supervisors (leader’s LMX; LLX), every leader develops different relationships with their supervisors and, in turn, receive different amounts of resources. Moreover, these differentiated relationships with superiors will influence how leader–member relationship quality affects team members’ voice and creativity. We adopted a multi-temporal (three wave) and multi-source (leaders and employees) research design. Hypotheses were tested on a sample of 227 bank employees working in 52 departments. Results of the hierarchical linear modeling (HLM) analysis showed that LLX moderates the relationship between LMX and team members’ voice behavior and creative performance. Strengths, limitations, practical implications, and directions for future research are discussed.

Are There Test Administrator Effects in Large-Scale Educational Assessments?

Methodology ◽  
2007 ◽  
Vol 3 (4) ◽  
pp. 149-159 ◽  
Author(s):  
Oliver Lüdtke ◽  
Alexander Robitzsch ◽  
Ulrich Trautwein ◽  
Frauke Kreuter ◽  
Jan Marten Ihme
Keyword(s):  
Large Scale ◽  
International Student ◽  
Student Assessment ◽  
Student Groups ◽  
Mathematics Scores ◽  
International Student Assessment ◽  
Sample Attrition ◽  
Educational Assessments ◽  
Test Administrator ◽  
Practical Implications

Abstract. In large-scale educational assessments such as the Third International Mathematics and Sciences Study (TIMSS) or the Program for International Student Assessment (PISA), sizeable numbers of test administrators (TAs) are needed to conduct the assessment sessions in the participating schools. TA training sessions are run and administration manuals are compiled with the aim of ensuring standardized, comparable, assessment situations in all student groups. To date, however, there has been no empirical investigation of the effectiveness of these standardizing efforts. In the present article, we probe for systematic TA effects on mathematics achievement and sample attrition in a student achievement study. Multilevel analyses for cross-classified data using Markov Chain Monte Carlo (MCMC) procedures were performed to separate the variance that can be attributed to differences between schools from the variance associated with TAs. After controlling for school effects, only a very small, nonsignificant proportion of the variance in mathematics scores and response behavior was attributable to the TAs (< 1%). We discuss practical implications of these findings for the deployment of TAs in educational assessments.

New ''Cold War''

2020 ◽  
pp. 27-34
Author(s):  
Vladimir Batiuk
Keyword(s):  
Cold War ◽  
Nuclear Weapons ◽  
Armed Conflict ◽  
Large Scale ◽  
Arms Race ◽  
Ideological Struggle ◽  
Nuclear Arms Race ◽  
The Cold War ◽  
The Relationship ◽  
Nuclear Arms

In this article, the ''Cold War'' is understood as a situation where the relationship between the leading States is determined by ideological confrontation and, at the same time, the presence of nuclear weapons precludes the development of this confrontation into a large-scale armed conflict. Such a situation has developed in the years 1945–1989, during the first Cold War. We see that something similar is repeated in our time-with all the new nuances in the ideological struggle and in the nuclear arms race.

KONFLIK DAN KINERJA KARYAWAN

2018 ◽  
Vol 3 (3) ◽  
pp. 431-440
Author(s):  
Santi Retno Sari
Keyword(s):  
Leadership Style ◽  
Structural Equation ◽  
Employee Performance ◽  
Equation Modeling ◽  
Managerial Practices ◽  
Research Findings ◽  
Job Levels ◽  
The Impact ◽  
The Relationship ◽  
Practical Implications

The purpose of this paper is to examine the relationships to which leadership style (task and relations oriented leadership) moderate the impact of conflict on employee performance. Data were collected from 92 employees in different job levels. Partial least squares variance-based structural equation modeling (PLS-SEM) was used to test the relationship in the models. The results showed that task and relation conflict was associated with employee performance. The research findings also showed that leadership styles moderated the relationship between conflict and employee performance. This study offers implications for managerial practices. Practical implications and suggestions described in the paper Keywords: leadership style, conflict, performance.

Investigating Diseases and Chemicals in COVID-19 Literature with Text Mining (Preprint)

2020 ◽  
Author(s):  
Amir Karami ◽  
Brandon Bookstaver ◽  
Melissa Nolan
Keyword(s):  
Text Mining ◽  
Literature Review ◽  
Topic Modeling ◽  
Large Scale ◽  
Clinical Manifestations ◽  
International Health ◽  
Research Papers ◽  
Strategic Plans ◽  
Funding Agencies ◽  
The Relationship

BACKGROUND The COVID-19 pandemic has impacted nearly all aspects of life and has posed significant threats to international health and the economy. Given the rapidly unfolding nature of the current pandemic, there is an urgent need to streamline literature synthesis of the growing scientific research to elucidate targeted solutions. While traditional systematic literature review studies provide valuable insights, these studies have restrictions, including analyzing a limited number of papers, having various biases, being time-consuming and labor-intensive, focusing on a few topics, incapable of trend analysis, and lack of data-driven tools. OBJECTIVE This study fills the mentioned restrictions in the literature and practice by analyzing two biomedical concepts, clinical manifestations of disease and therapeutic chemical compounds, with text mining methods in a corpus containing COVID-19 research papers and find associations between the two biomedical concepts. METHODS This research has collected papers representing COVID-19 pre-prints and peer-reviewed research published in 2020. We used frequency analysis to find highly frequent manifestations and therapeutic chemicals, representing the importance of the two biomedical concepts. This study also applied topic modeling to find the relationship between the two biomedical concepts. RESULTS We analyzed 9,298 research papers published through May 5, 2020 and found 3,645 disease-related and 2,434 chemical-related articles. The most frequent clinical manifestations of disease terminology included COVID-19, SARS, cancer, pneumonia, fever, and cough. The most frequent chemical-related terminology included Lopinavir, Ritonavir, Oxygen, Chloroquine, Remdesivir, and water. Topic modeling provided 25 categories showing relationships between our two overarching categories. These categories represent statistically significant associations between multiple aspects of each category, some connections of which were novel and not previously identified by the scientific community. CONCLUSIONS Appreciation of this context is vital due to the lack of a systematic large-scale literature review survey and the importance of fast literature review during the current COVID-19 pandemic for developing treatments. This study is beneficial to researchers for obtaining a macro-level picture of literature, to educators for knowing the scope of literature, to journals for exploring most discussed disease symptoms and pharmaceutical targets, and to policymakers and funding agencies for creating scientific strategic plans regarding COVID-19.

Sign in / Sign up

Export Citation Format

Share Document