scholarly journals Introducing a new definition of a near fall: Intra-rater and inter-rater reliability

2014 ◽  
Vol 39 (1) ◽  
pp. 645-647 ◽  
Author(s):  
I. Maidan ◽  
T. Freedman ◽  
R. Tzemah ◽  
N. Giladi ◽  
A. Mirelman ◽  
...  
Virittäjä ◽  
2019 ◽  
Vol 123 (1) ◽  
Author(s):  
Mari Honko ◽  
Scott Jarvis ◽  
Seppo Vainio

Artikkelissa tarkastellaan leksikaalisen diversiteetin eli tekstin sanastollisen monimuotoisuuden rakentumista. Tavoitteena on esitellä leksikaalisen diversiteetin tutkimuksen metodiikkaa ja osoittaa sen potentiaali kielitaidon arvioinnin välineenä. Tutkimuksessa selvitetään, kuinka yksilöllisiä arvioijien käsitykset tietyn tekstin sanastollisesta monimuotoisuudesta ovat, missä määrin arvioijien käsityksiä voidaan selittää tekstien sanastollisilla piirteillä ja mitkä näistä piirteistä ovat käsitysten selittäjinä tärkeimpiä. Artikkelissa leksikaalista diversiteettiä tutkitaan tekstejä ja niiden tulkintaa vertailemalla. Aineisto koostuu koululaisten kirjoittamista kertomusteksteistä ja aikuisten lukijoiden teksteille antamista sanastollisen monimuotoisuuden arvioista. Kunkin tekstin (yht. 60) arvioi 23 arvioijaa, joiden vastausten yhdenmukaisuutta tarkasteltiin tilastollisesti. Tämän jälkeen selvitettiin tätä tutkimusta varten rakennetun tilastollisen mallin avulla, millaisiin sanastollisiin piirteisiin inhimilliset arvioijat kiinnittävät huomiota tekstien sanastollista monimuotoisuutta arvioidessaan. Tulokset osoittavat, että arvioijien käsitykset yksittäisten tekstien sanastollisesta monimuotoisuudesta ovat hyvin yhdenmukaisia (Cronbachin alfa = 0,959). Arviointien luotettavuutta lisää se, että arvioitavien tekstien suuresta määrästä huolimatta kaikki arvioijat suorittivat tehtävän loppuun saakka eikä arviointilinja olennaisesti muuttunut tehtävän aikana. Leksikaalisen diversiteetin määrittelyn kannalta on olennaista, että tekstien yksittäisistä sanastollisista muuttujista neljä riittää selittämään lähes kolme neljäsosaa (n. 73 %) arvioiden vaihtelusta. Tutkitun aineiston perusteella lukijoiden tulkinta tekstin sanastollisesta monimuotoisuudesta tukeutuu vahvasti 1) tekstin eri sanojen määrään (runsaus), 2) tietyn sanan esiintymien välisiin etäisyyksiin tekstissä (sironta), 3) sanojen laatuun (erityisyys) sekä 4) tekstin sanastolliseen tiheyteen (vaihtelevuus), joka perustuu uusien sanojen tasaiseen ilmaantumiseen tekstissä.   Readers’ perceptions of lexical diversity: Examining lexical diversity at the interface between quantitative and qualitative research This article examines the construct of lexical diversity while focusing on research methodology and the potential for lexical diversity to be used as an index of language proficiency. The study gives attention to questions of inter-rater reliability, the effects of texts’ lexical characteristics on raters’ lexical diversity ratings, and which set of features best accounts for raters’ perceptions of lexical diversity. The present study focuses on lexical diversity in Finnish, and it does this by comparing the lexical characteristics of texts with how they are perceived. The data consists of narrative texts written by school children, as well as lexical diversity ratings assigned to the same texts by adult raters. Each text (n = 60) was rated by 23 raters, whose ratings were tested statistically for inter-rater reliability. A regression model was then used to investigate which lexical features the raters relied on while assessing the texts’ levels of lexical diversity. The results show that the raters’ lexical diversity ratings were highly consistent with one another (Cronbach’s alpha = 0.959). Despite the large number of texts they were asked to rate, all raters rated each of the 60 texts, and their intra-rater consistency remained high from the beginning to the end of the rating task. The results have important implications for the construct definition of lexical diversity: of all the lexical features examined in the present study, four alone suffice to account for nearly three quarters (roughly 73%) of the variance in the ratings. The results suggest that raters’ perceptions of lexical diversity are strongly associated with 1) the number of different words in a text (abundance), 2) the intervals between occurrences of the same word (dispersion), 3) the semantic quality of individual words in the text (specialness) and 4) the overall degree of repetitiveness in the text (variety).  


2020 ◽  
Author(s):  
Laura Hidalgo-Downing ◽  
Paula Pérez-Sobrino ◽  
Laura Filardo-Lamas ◽  
Carmen Maíz Arévalo ◽  
Begoña Núñez Perucha ◽  
...  

This paper is part of the work carried out in the funded research project Stance and subjectivity in discourse: towards an integrated model of the analysis of epistemicity, effectivity, evaluation and intersubjectivity from a critical discourse perspective (PGC2018-095798-B-I00).In this paper we propose a protocol for the annotation of evaluative stance across discourse types. We have used the protocol to annotate four 100,000-word corpora in English: opinion articles (The Guardian and The Times), science popularization in the press (The Guardian and The Times), political discourse (speeches delivered by British politicians) and fora on social issues (REDDIT). The development of the protocol has gone through two main stages. The first stage has consisted in a preliminary theoretical definition of the model of evaluative stance and its main categories, drawing from research on stance, evaluation and critical discourse analysis, together with methods for the identification of metaphoricity (du Bois 2007, Martin and White 2005, Pragglejazz 2007, van Leeuwen 2008, Wodak and Meyer 2015, among others). The preliminary model was tested in samples of the corpora and subsequently, the protocol underwent a first initial refinement and revision. The second stage has consisted in a process of establishing a good degree of inter-rater reliability for the full annotation of the corpora. The procedure of inter-rater reliability was carried out by three researchers (Hidalgo-Downing, Pérez-Sobrino, and Williams-Camus) who individually annotated samples from the corpora in four subsequent rounds. A joint discussion followed each round to discuss conflicting annotations and to refine the protocol for the ensuing round. The goal of these series of annotations was to know whether there was any variation in the inter-rater reliability with which evaluative stance was identified across researchers, rounds and genres. The results of the inter-rater reliability tests show a consistent increase in the kappa scores for the value category (positive vs negative evaluation) and, to a lesser extent, for metaphoricity (although, in both cases, kappa scores showed moderate to high agreement). These rounds were complemented with two rounds of annotation of sample texts by the full team (all seven researchers participating in this project) in order to ensure the understanding and uniform application of the criteria of the protocol for the annotation of the whole corpora.


1966 ◽  
Vol 24 ◽  
pp. 3-5
Author(s):  
W. W. Morgan

1. The definition of “normal” stars in spectral classification changes with time; at the time of the publication of theYerkes Spectral Atlasthe term “normal” was applied to stars whose spectra could be fitted smoothly into a two-dimensional array. Thus, at that time, weak-lined spectra (RR Lyrae and HD 140283) would have been considered peculiar. At the present time we would tend to classify such spectra as “normal”—in a more complicated classification scheme which would have a parameter varying with metallic-line intensity within a specific spectral subdivision.


1975 ◽  
Vol 26 ◽  
pp. 21-26

An ideal definition of a reference coordinate system should meet the following general requirements:1. It should be as conceptually simple as possible, so its philosophy is well understood by the users.2. It should imply as few physical assumptions as possible. Wherever they are necessary, such assumptions should be of a very general character and, in particular, they should not be dependent upon astronomical and geophysical detailed theories.3. It should suggest a materialization that is dynamically stable and is accessible to observations with the required accuracy.


1979 ◽  
Vol 46 ◽  
pp. 125-149 ◽  
Author(s):  
David A. Allen

No paper of this nature should begin without a definition of symbiotic stars. It was Paul Merrill who, borrowing on his botanical background, coined the termsymbioticto describe apparently single stellar systems which combine the TiO absorption of M giants (temperature regime ≲ 3500 K) with He II emission (temperature regime ≳ 100,000 K). He and Milton Humason had in 1932 first drawn attention to three such stars: AX Per, CI Cyg and RW Hya. At the conclusion of the Mount Wilson Ha emission survey nearly a dozen had been identified, and Z And had become their type star. The numbers slowly grew, as much because the definition widened to include lower-excitation specimens as because new examples of the original type were found. In 1970 Wackerling listed 30; this was the last compendium of symbiotic stars published.


Author(s):  
K. T. Tokuyasu

During the past investigations of immunoferritin localization of intracellular antigens in ultrathin frozen sections, we found that the degree of negative staining required to delineate u1trastructural details was often too dense for the recognition of ferritin particles. The quality of positive staining of ultrathin frozen sections, on the other hand, has generally been far inferior to that attainable in conventional plastic embedded sections, particularly in the definition of membranes. As we discussed before, a main cause of this difficulty seemed to be the vulnerability of frozen sections to the damaging effects of air-water surface tension at the time of drying of the sections.Indeed, we found that the quality of positive staining is greatly improved when positively stained frozen sections are protected against the effects of surface tension by embedding them in thin layers of mechanically stable materials at the time of drying (unpublished).


Author(s):  
W. A. Shannon ◽  
M. A. Matlib

Numerous studies have dealt with the cytochemical localization of cytochrome oxidase via cytochrome c. More recent studies have dealt with indicating initial foci of this reaction by altering incubation pH (1) or postosmication procedure (2,3). The following study is an attempt to locate such foci by altering membrane permeability. It is thought that such alterations within the limits of maintaining morphological integrity of the membranes will ease the entry of exogenous substrates resulting in a much quicker oxidation and subsequently a more precise definition of the oxidative reaction.The diaminobenzidine (DAB) method of Seligman et al. (4) was used. Minced pieces of rat liver were incubated for 1 hr following toluene treatment (5,6). Experimental variations consisted of incubating fixed or unfixed tissues treated with toluene and unfixed tissues treated with toluene and subsequently fixed.


Author(s):  
J. D. Hutchison

When the transmission electron microscope was commercially introduced a few years ago, it was heralded as one of the most significant aids to medical research of the century. It continues to occupy that niche; however, the scanning electron microscope is gaining rapidly in relative importance as it fills the gap between conventional optical microscopy and transmission electron microscopy.IBM Boulder is conducting three major programs in cooperation with the Colorado School of Medicine. These are the study of the mechanism of failure of the prosthetic heart valve, the study of the ultrastructure of lung tissue, and the definition of the function of the cilia of the ventricular ependyma of the brain.


Sign in / Sign up

Export Citation Format

Share Document