scholarly journals Determinants of grader agreement: an analysis of multiple short answer corpora

2021 ◽  
Author(s):  
Ulrike Padó ◽  
Sebastian Padó
Keyword(s):  
Difficulty Level ◽  
Educational Strategies ◽  
Short Answer ◽  
Content Assessment ◽  
Wide Range ◽  
The Hierarchical Structure ◽  
Short Answer Question ◽  
Question Difficulty ◽  
Active Research ◽  
Open Question

AbstractThe ’short answer’ question format is a widely used tool in educational assessment, in which students write one to three sentences in response to an open question. The answers are subsequently rated by expert graders. The agreement between these graders is crucial for reliable analysis, both in terms of educational strategies and in terms of developing automatic models for short answer grading (SAG), an active research topic in NLP. This makes it important to understand the properties that influence grader agreement (such as question difficulty, answer length, and answer correctness). However, the twin challenges towards such an understanding are the wide range of SAG corpora in use (which differ along a number of dimensions) and the hierarchical structure of potentially relevant properties (which can be located at the corpus, answer, or question levels). This article uses generalized mixed effects models to analyze the effect of various such properties on grader agreement in six major SAG corpora for two main assessment tasks (language and content assessment). Overall, we find broad agreement among corpora, with a number of properties behaving similarly across corpora (e.g., shorter answers and correct answers are easier to grade). Some properties show more corpus-specific behavior (e.g., the question difficulty level), and some corpora are more in line with general tendencies than others. In sum, we obtain a nuanced picture of how the major short answer grading corpora are similar and dissimilar from which we derive suggestions for corpus development and analysis.

scholarly journals An Overview on the Rheology, Mechanical Properties, Durability, 3D Printing, and Microstructural Performance of Nanomaterials in Cementitious Composites

Materials ◽  
2021 ◽  
Vol 14 (11) ◽  
pp. 2950
Author(s):  
Hongwei Song ◽  
Xinle Li
Keyword(s):  
Mechanical Properties ◽  
3D Printing ◽  
Three Dimensional ◽  
Cementitious Materials ◽  
Research Area ◽  
Cementitious Composites ◽  
Split Tensile Strength ◽  
Contour Crafting ◽  
Wide Range ◽  
Active Research

The most active research area is nanotechnology in cementitious composites, which has a wide range of applications and has achieved popularity over the last three decades. Nanoparticles (NPs) have emerged as possible materials to be used in the field of civil engineering. Previous research has concentrated on evaluating the effect of different NPs in cementitious materials to alter material characteristics. In order to provide a broad understanding of how nanomaterials (NMs) can be used, this paper critically evaluates previous research on the influence of rheology, mechanical properties, durability, 3D printing, and microstructural performance on cementitious materials. The flow properties of fresh cementitious composites can be measured using rheology and slump. Mechanical properties such as compressive, flexural, and split tensile strength reveal hardened properties. The necessary tests for determining a NM’s durability in concrete are shrinkage, pore structure and porosity, and permeability. The advent of modern 3D printing technologies is suitable for structural printing, such as contour crafting and binder jetting. Three-dimensional (3D) printing has opened up new avenues for the building and construction industry to become more digital. Regardless of the material science, a range of problems must be tackled, including developing smart cementitious composites suitable for 3D structural printing. According to the scanning electron microscopy results, the addition of NMs to cementitious materials results in a denser and improved microstructure with more hydration products. This paper provides valuable information and details about the rheology, mechanical properties, durability, 3D printing, and microstructural performance of cementitious materials with NMs and encourages further research.

scholarly journals Synthesis of Micro- and Nanoparticles in Sub- and Supercritical Water: From the Laboratory to Larger Scales

2020 ◽  
Vol 10 (16) ◽  
pp. 5508
Author(s):  
F. Ruiz-Jorge ◽  
J. R. Portela ◽  
J. Sánchez-Oneto ◽  
E. J. Martínez de la Ossa
Keyword(s):  
Supercritical Fluids ◽  
Supercritical Water ◽  
Metal Particles ◽  
High Pressure And Temperature ◽  
Particle Generation ◽  
Innovative Method ◽  
Wide Range ◽  
Active Research ◽  
Main Operating ◽  
Temperature Water

The use of micro- and nanoparticles is gaining more and more importance because of their wide range of uses and benefits based on their unique mechanical, physical, electrical, optical, electronic, and magnetic properties. In recent decades, supercritical fluid technologies have strongly emerged as an effective alternative to other numerous particle generation processes, mainly thanks to the peculiar properties exhibited by supercritical fluids. Carbon dioxide and water have so far been two of the most commonly used fluids for particle generation, the former being the fluid par excellence in this field, mainly, because it offers the possibility of precipitating thermolabile particles. Nevertheless, the use of high-pressure and -temperature water opens an innovative and very interesting field of study, especially with regards to the precipitation of particles that could hardly be precipitated when CO2 is used, such as metal particles with a considerable value in the market. This review describes an innovative method to obtain micro- and nanoparticles: hydrothermal synthesis by means of near and supercritical water. It also describes the differences between this method and other conventional procedures, the most currently active research centers, the types of particles synthesized, the techniques to evaluate the products obtained, the main operating parameters, the types of reactors, and amongst them, the most significant and the most frequently used, the scaling-up studies under progress, and the milestones to be reached in the coming years.

scholarly journals Analisis Deskriptif Soal Ujian Nasional dan Cambridge Checkpoint Pelajaran Matematika Tingkat Sekolah Menengah Pertama Tahun Ajaran 2014/2015 Berdasarkan Tipe Penyajian Soal dan Ruang Lingkup Materi

2020 ◽  
Author(s):  
Zainal Abidin
Keyword(s):  
National Curriculum ◽  
Multiple Choice ◽  
Secondary Level ◽  
Qualitative Approach ◽  
Multiple Choice Questions ◽  
Short Answer ◽  
National Examination ◽  
Analysis Question ◽  
Short Answer Question ◽  
Mathematics Examination

National Examination and Cambridge Checkpoint are the instrument for evaluating the standard competence ofstudent which organized in Secondary Level. National Examination’s questions based on the National Curriculum ofIndonesia but Cambridge Checkpoint’s questions taken based on Cambridge Curriculum. The aims of this researchis analyzing the type of each question and distribution of each strands in the National Mathematics Examination 2015and Mathematics of Cambridge Checkpoint for Secondary Level 2015. This type of research is a descriptive studywith a qualitative approach. National Mathematics Examination 2015 has one paper only but Mathematics ofCambridge Checkpoint for Secondary Level 2015 has 2 papers for the test. It can be concluded that all question’stype of the National Mathematics Examination for Secondary Level 2015 are multiple choice questions. OnMathematics of Cambridge Checkpoint for Secondary Level 2015, there are various types of questions which consistof 11,43% short-answer question; 68,57% analysis question; 8,57% completing question; and 11,43% match questionfor paper 1, but 22,22% short-answer question; 58,33% analysis question; 11,11% completing question; 2,78% matchquestion; 2,78% multiple choice question; and 2,78% yes/no question for paper 2. Based on strands analyzing result,It can be determined that National Mathematics Examination for Secondary Level 2015 contain of 22,25% number;27,5 algebra; 40% geometry and measurement; 10% statistic and probability. On Mathematics of CambridgeCheckpoint for Secondary Level 2015, It can be explained that 45,72% number; 20% algebra; 17,14% geometry andmeasurement; and 17,14% statistic and probability for paper 1, and 33,33% number; 19,45% algebra; 25% geometryand measurement; and 22,22% statistic and probability for paper 2.

THE IMPACT ON THE QUALITY AND SATISFACTION OF THE TESTS OF AN UNCUED QUESTION FORMAT VERSUS A SHORT ANSWER QUESTION FORMAT

2016 ◽  
Author(s):  
Beatriz Fevereiro ◽  
Fernando Rafael Gonçalves ◽  
Beatriz Torres-Guimarães ◽  
Diogo Francisco Tomaz ◽  
Ana Clara Vasconcelos-Oliveira ◽  
...  
Keyword(s):  
Question Format ◽  
Short Answer ◽  
Short Answer Question ◽  
The Impact

Intelligent Questioning System Based on Fuzzy Logic

2015 ◽  
pp. 620-642
Author(s):  
Omer Deperlioglu ◽  
Guray Sonugur ◽  
Kadir Suzme
Keyword(s):  
Fuzzy Logic ◽  
Nearest Neighbor ◽  
Difficulty Level ◽  
Knowledge Level ◽  
Clustering Methods ◽  
Multiple Choice Questions ◽  
Student Knowledge ◽  
Question Difficulty ◽  
Knowledge Levels ◽  
And Performance

One of the most important functions of distance learning systems is determining the student knowledge level and performance clearly. In traditional education systems, students can be assessed in single-stage via tests and homework studies, which consist of multiple-choice questions. However, this method cannot provide accurate results since it is not able to evaluate student knowledge level and question difficulty level. In this chapter, a system and software structure that can determine student knowledge levels, topic difficulty level, and question difficulty levels according to instant student answers for the exam is introduced. In forming student knowledge levels, content monitoring and test data taken from distance education vocational school were used. In this way, more accurate results have been obtained. The fuzzy logic technique has been used to determine (classify) student knowledge levels and topic difficulty levels clearly. In order to determine next questions adaptively, the stored questions have been classified with division clustering methods, and the most suitable questions for the related student knowledge level have been found by using the nearest neighbor algorithm.

Editorial to Child and Adolescence Psychopharmacology

2016 ◽  
Vol 49 (06) ◽  
pp. 217-218
Author(s):  
G. Juckel
Keyword(s):  
Young Patients ◽  
Child And Adolescent ◽  
Child And Adolescent Psychiatry ◽  
Mental Illnesses ◽  
Educational Strategies ◽  
Behavioral Disturbances ◽  
Treatment Regimens ◽  
Psychopharmacological Treatment ◽  
Wide Range ◽  
Meta Analyses

The editors of Pharmacopsychiatry have decided in 2016 to prepare special issues regularly in order provide our readers volumes of the journal with a thematic focus 1. The first such special issue is dedicated to the field of child and adolescent psychopharmacology. Many young patients are treated with psychotherapeutic, but also pharmacotherapeutic, methods worldwide. Most of our psychopharmacological agents are not approved by the federal institutions for persons under 18 years old. However, severe mental illnesses like schizophrenia, depression, anxiety, ADHD, and bipolar disorder frequently require pharmacological treatments in children and adolescents. We also see a wide range of rather unspecific emotional and behavioral disturbances up to excitation crises or suicidal acts in this young population, so that we see the necessity for standardized and valid psychopharmacological treatment regimens based on meta-analyses, randomized controlled trials, and guidelines 2. Child and adolescent psychiatry is unfortunately far away from this; industry-supported research is rare in this area, but also not all child and adolescent psychiatrists see the importance of psychopharmacological treatment and trust specific psychotherapy, psychoeducation, and educational strategies. These are all extremely important treatments, but one can/should think that psychopharmacotherapy is an important addition and often a cornerstone for the other treatments.

Short answer question case series: noisy breathing in an adult

2013 ◽  
Vol 30 (10) ◽  
pp. 861-862 ◽  
Author(s):  
Kyle Chong ◽  
Preeti Dalawari ◽  
Joseph Walline ◽  
Timothy B Jang
Keyword(s):  
Case Series ◽  
Short Answer ◽  
Short Answer Question

Surgical sub-specialties

2017 ◽  
Author(s):  
Ashis Banerjee ◽  
Clara Oliver
Keyword(s):  
Emergency Medicine ◽  
Short Answer ◽  
Red Eye ◽  
Short Answer Question ◽  
Ear Infections ◽  
Area Of Concern ◽  
Previous Training ◽  
Nose And Throat

The surgical sub-specialties can may be an area of concern for emergency medicine trainee due to a lack of previous training and exposure for such problems, however they are commonly assessed in the short-answer question (SAQ) paper. This chapter covers ear, nose, and throat (ENT)-related problems such as epistaxis, throat infections, and ear infections. As well as useful section on vertigo, specifically on differentiating between central and peripheral causes which may appear in the SAQ paper. This chapter also covers common eye emergencies and focuses on the assessment of the red eye, as well as dental emergencies, which can easily be assessed in the SAQ paper.

Sign in / Sign up

Export Citation Format

Share Document