scholarly journals Comparative Judgement for Linking Two Existing Scales

2021 ◽  
Vol 6 ◽  
Author(s):  
Tom Benton

This article describes an efficient way of using comparative judgement to calibrate scores from different educational assessments against one another (a task often referred to as test linking or equating). The context is distinct from other applications of comparative judgement as there is no need to create a new achievement scale using a Bradley-Terry model (or similar). The proposed method takes advantage of this fact to include evidence from the largest possible number of examples of students’ performances on the separate assessments whilst keeping the amount of time required from expert judges as low as possible. The paper describes the method and shows, via simulation, how it achieves greater accuracy than alternative approaches to the use of comparative judgement for test equating or linking.

2020 ◽  
Vol 76 (10) ◽  
pp. 962-970
Author(s):  
Filomeno Sánchez Rodríguez ◽  
Adam J. Simpkin ◽  
Owen R. Davies ◽  
Ronan M. Keegan ◽  
Daniel J. Rigden

The conventional approach in molecular replacement is the use of a related structure as a search model. However, this is not always possible as the availability of such structures can be scarce for poorly characterized families of proteins. In these cases, alternative approaches can be explored, such as the use of small ideal fragments that share high, albeit local, structural similarity with the unknown protein. Earlier versions of AMPLE enabled the trialling of a library of ideal helices, which worked well for largely helical proteins at suitable resolutions. Here, the performance of libraries of helical ensembles created by clustering helical segments is explored. The impacts of different B-factor treatments and different degrees of structural heterogeneity are explored. A 30% increase in the number of solutions obtained by AMPLE was observed when using this new set of ensembles compared with the performance with ideal helices. The boost in performance was notable across three different fold classes: transmembrane, globular and coiled-coil structures. Furthermore, the increased effectiveness of these ensembles was coupled to a reduction in the time required by AMPLE to reach a solution. AMPLE users can now take full advantage of this new library of search models by activating the `helical ensembles' mode.


2020 ◽  
Author(s):  
Filomeno Sánchez Rodríguez ◽  
Adam J. Simpkin ◽  
Owen R. Davies ◽  
Ronan M. Keegan ◽  
Daniel J. Rigden

AbstractThe conventional approach in molecular replacement (MR) is the use of a related structure as a search model. However, this is not always possible as the availability of such structures can be scarce for poorly characterised families of proteins. In these cases, alternative approaches can be explored, such as the use of small ideal fragments that share high albeit local structural similarity with the unknown protein. Earlier versions of AMPLE enabled the trialling of a library of ideal helices, which worked well for largely helical proteins at suitable resolution. Here we explore the performance of libraries of helical ensembles created by clustering helical segments. The impacts of different B-factor treatments and different degrees of structural heterogeneity are explored. We observed a 30% increase in the number of solutions obtained by AMPLE when using this new set of ensembles compared to performance with ideal helices. The boost of performance was notable across three different folds: transmembrane, globular and coiled-coil structures. Furthermore, the increased effectiveness of these ensembles was coupled to a reduction of the time required by AMPLE to reach a solution. AMPLE users can now take full advantage of this new library of search models by activating the “helical ensembles” mode.


1994 ◽  
Vol 24 (2) ◽  
pp. 253-264 ◽  
Author(s):  
Joel Lexchin

Over the past decade the Canadian drug approval system has come under intensive scrutiny, with the greatest amount of attention being given to the length of time required to approve new drugs. This issue has obviously also been of considerable interest to the pharmaceutical industry, and the question arises as to whether or not the concerns of the industry may be driving the proposed reforms to speed up the approval process. Both industry and government maintain that quicker approval of new drugs will ensure that Canadians have more rapid access to new medications without sacrificing safety. There are problems with these claims. The number of therapeutically important new drugs introduced annually is less than five and these are already “fast tracked,” so the need to speed up approval for all products is dubious. There is also evidence that safety may be compromised with faster approvals. Industry does not need quicker approval times for its financial viability, but getting new, more expensive drugs onto the market more rapidly will increase sales and profit levels. Alternative approaches to dealing with problems such as drug approval times will only be possible when the policy-making process becomes more transparent and open.


Author(s):  
Charles TurnbiLL ◽  
Delbert E. Philpott

The advent of the scanning electron microscope (SCEM) has renewed interest in preparing specimens by avoiding the forces of surface tension. The present method of freeze drying by Boyde and Barger (1969) and Small and Marszalek (1969) does prevent surface tension but ice crystal formation and time required for pumping out the specimen to dryness has discouraged us. We believe an attractive alternative to freeze drying is the critical point method originated by Anderson (1951; for electron microscopy. He avoided surface tension effects during drying by first exchanging the specimen water with alcohol, amy L acetate and then with carbon dioxide. He then selected a specific temperature (36.5°C) and pressure (72 Atm.) at which carbon dioxide would pass from the liquid to the gaseous phase without the effect of surface tension This combination of temperature and, pressure is known as the "critical point" of the Liquid.


Author(s):  
J.M. Cowley

By extrapolation of past experience, it would seem that the future of ultra-high resolution electron microscopy rests with the advances of electron optical engineering that are improving the instrumental stability of high voltage microscopes to achieve the theoretical resolutions of 1Å or better at 1MeV or higher energies. While these high voltage instruments will undoubtedly produce valuable results on chosen specimens, their general applicability has been questioned on the basis of the excessive radiation damage effects which may significantly modify the detailed structures of crystal defects within even the most radiation resistant materials in a period of a few seconds. Other considerations such as those of cost and convenience of use add to the inducement to consider seriously the possibilities for alternative approaches to the achievement of comparable resolutions.


Author(s):  
O. E. Bradfute

Electron microscopy is frequently used in preliminary diagnosis of plant virus diseases by surveying negatively stained preparations of crude extracts of leaf samples. A major limitation of this method is the time required to survey grids when the concentration of virus particles (VPs) is low. A rapid survey of grids for VPs is reported here; the method employs a low magnification, out-of-focus Search Mode similar to that used for low dose electron microscopy of radiation sensitive specimens. A higher magnification, in-focus Confirm Mode is used to photograph or confirm the detection of VPs. Setting up the Search Mode by obtaining an out-of-focus image of the specimen in diffraction (K. H. Downing and W. Chiu, private communications) and pre-aligning the image in Search Mode with the image in Confirm Mode facilitates rapid switching between Modes.


Author(s):  
Anthony S-Y Leong ◽  
David W Gove

Microwaves (MW) are electromagnetic waves which are commonly generated at a frequency of 2.45 GHz. When dipolar molecules such as water, the polar side chains of proteins and other molecules with an uneven distribution of electrical charge are exposed to such non-ionizing radiation, they oscillate through 180° at a rate of 2,450 million cycles/s. This rapid kinetic movement results in accelerated chemical reactions and produces instantaneous heat. MWs have recently been applied to a wide range of procedures for light microscopy. MWs generated by domestic ovens have been used as a primary method of tissue fixation, it has been applied to the various stages of tissue processing as well as to a wide variety of staining procedures. This use of MWs has not only resulted in drastic reductions in the time required for tissue fixation, processing and staining, but have also produced better cytologic images in cryostat sections, and more importantly, have resulted in better preservation of cellular antigens.


1999 ◽  
Vol 4 (5) ◽  
pp. 4-7 ◽  
Author(s):  
Laura Welch

Abstract Functional capacity evaluations (FCEs) have become an important component of disability evaluation during the past 10 years to assess an individual's ability to perform the essential or specific functions of a job, both preplacement and during rehabilitation. Evaluating both job performance and physical ability is a complex assessment, and some practitioners are not yet certain that an FCE can achieve these goals. An FCE is useful only if it predicts job performance, and factors that should be assessed include overall performance; consistency of performance across similar areas of the FCE; consistency between observed behaviors during the FCE and limitations or abilities reported by the worker; objective changes (eg, blood pressure and pulse) that are appropriate relative to performance; external factors (illness, lack of sleep, or medication); and a coefficient of variation that can be measured and assessed. FCEs can identify specific movement patterns or weaknesses; measure improvement during rehabilitation; identify a specific limitation that is amenable to accommodation; and identify a worker who appears to be providing a submaximal effort. FCEs are less reliable at predicting injury risk; they cannot tell us much about endurance over a time period longer than the time required for the FCE; and the FCE may measure simple muscular functions when the job requires more complex ones.


Methodology ◽  
2007 ◽  
Vol 3 (4) ◽  
pp. 149-159 ◽  
Author(s):  
Oliver Lüdtke ◽  
Alexander Robitzsch ◽  
Ulrich Trautwein ◽  
Frauke Kreuter ◽  
Jan Marten Ihme

Abstract. In large-scale educational assessments such as the Third International Mathematics and Sciences Study (TIMSS) or the Program for International Student Assessment (PISA), sizeable numbers of test administrators (TAs) are needed to conduct the assessment sessions in the participating schools. TA training sessions are run and administration manuals are compiled with the aim of ensuring standardized, comparable, assessment situations in all student groups. To date, however, there has been no empirical investigation of the effectiveness of these standardizing efforts. In the present article, we probe for systematic TA effects on mathematics achievement and sample attrition in a student achievement study. Multilevel analyses for cross-classified data using Markov Chain Monte Carlo (MCMC) procedures were performed to separate the variance that can be attributed to differences between schools from the variance associated with TAs. After controlling for school effects, only a very small, nonsignificant proportion of the variance in mathematics scores and response behavior was attributable to the TAs (< 1%). We discuss practical implications of these findings for the deployment of TAs in educational assessments.


Sign in / Sign up

Export Citation Format

Share Document