scholarly journals Examiner Variability in Clinical Assessments: Do Examiner Pairings Influence Candidate Ratings?

2019 ◽  
Author(s):  
Aileen Faherty ◽  
Yvonne Finn ◽  
Tim Counihan
Keyword(s):  
Dominant Role ◽  
Personality Testing ◽  
Clinical Assessments ◽  
Consensus Score ◽  
Personality Score ◽  
Quasi Experimental ◽  
Organisation And Administration ◽  
To Come ◽  
Very High ◽  
Improve Reliability

Abstract Background The reliability of clinical assessments is known to vary considerably and inter-examiner variability is a key contributor. This may result in significant differences in scores between comparable candidates, a serious challenge in medical education. An approach frequently adopted to avoid this and improve reliability is to pair examiners and ask them to come to an agreed score. Little is known however, about what occurs when these paired examiners interact to generate a score.Methods A fully-crossed design was employed with each participant examiner observing and scoring. A quasi-experimental research design used candidate’s observed scores in a mock clinical assessment as the dependent variable. The independent variables were examiner numbers, demographics and personality. Demographic and personality data was collected by questionnaire. A purposeful sample of medical doctors who examine in the Final Medical examination at our institution was recruited.Results Variability between scores given by examiner pairs (N=6) was less than the variability with individual examiners (N=12). 75% of examiners (N=9) scored below average for neuroticism and 75% also scored high or very high for extroversion. Two thirds scored high or very high for conscientiousness. The higher an examiner’s personality score for extroversion, the lower the amount of change in his/her score when paired up with a co-examiner; reflecting possibly a more dominant role in the process of reaching a consensus score.Conclusions While the variability between scores given by examiner pairs (N=6) was less than the variability with individual examiners (N=12), the reliability statistics for both assessments were comparable. Using paired examiners resulted in a more accurate and robust score than simply averaging two independent examiners scores. The higher an examiner’s personality score for extroversion, the lower the amount of change in his/her score when paired up with a co-examiner; reflecting possibly a more dominant role in the process of reaching a consensus score. These findings could have implications for the organisation and administration of clinical assessments. Further studies with larger numbers of participants might establish if personality testing before choosing examiner pairs could be utilised to help pair examiners and improve examiner variability.

scholarly journals Inter-rater Reliability in Clinical Assessments: Do Examiner Pairings Influence Candidate Ratings?

2019 ◽  
Author(s):  
Aileen Faherty ◽  
Yvonne Finn ◽  
Tim Counihan ◽  
Thomas Kropmans
Keyword(s):  
Dominant Role ◽  
Personality Testing ◽  
Personality Factors ◽  
Rater Reliability ◽  
Clinical Assessments ◽  
Consensus Score ◽  
Personality Score ◽  
Quasi Experimental ◽  
Organisation And Administration ◽  
To Come

Abstract BackgroundThe reliability of clinical assessments is known to vary considerably with inter-rater reliability a key contributor. Many of the mechanisms that contribute to inter-rater reliability however remain largely unexplained and unclear. While research in other fields suggests personality of raters can impact ratings, studies looking at personality factors in clinical assessments are few. Many schools use the approach of pairing examiners in clinical assessments and asking them to come to an agreed score. Little is known however, about what occurs when these paired examiners interact to generate a score. Could personality factors have an impact? Methods: A fully-crossed design was employed with each participant examiner observing and scoring. A quasi-experimental research design used candidate’s observed scores in a mock clinical assessment as the dependent variable. The independent variables were examiner numbers, demographics and personality with data collected by questionnaire. A purposeful sample of doctors who examine in the Final Medical examination at our institution was recruited. Results: Variability between scores given by examiner pairs (N=6) was less than the variability with individual examiners (N=12). 75% of examiners (N=9) scored below average for neuroticism and 75% also scored high or very high for extroversion. The higher an examiner’s personality score for extroversion, the lower the amount of change in his/her score when paired up with a co-examiner; reflecting possibly a more dominant role in the process of reaching a consensus score. Conclusions: While the variability between scores given by examiner pairs (N=6) was less than the variability with individual examiners (N=12), the reliability statistics for both assessments were comparable. However, using paired examiners resulted in a more accurate and robust score than simply averaging two independent examiners scores. The higher an examiner’s personality score for extroversion, the lower the amount of change in his/her score when paired up with a co-examiner; reflecting possibly a more dominant role in the process of reaching a consensus score. These findings could have implications for the organisation and administration of clinical assessments. Further studies with larger numbers of participants might establish if personality testing before choosing examiner pairs should be adopted.

scholarly journals Inter-rater Reliability in Clinical Assessments: Do Examiner Pairings Influence Candidate Ratings?

2020 ◽  
Author(s):  
Aileen Faherty ◽  
Tim Counihan ◽  
Thomas Kropmans ◽  
Yvonne Finn
Keyword(s):  
Dominant Role ◽  
Personality Testing ◽  
Personality Factors ◽  
Rater Reliability ◽  
Clinical Assessments ◽  
Consensus Score ◽  
Personality Score ◽  
Quasi Experimental ◽  
To Come ◽  
Very High

Abstract Background: The reliability of clinical assessments is known to vary considerably with inter-rater reliability a key contributor. Many of the mechanisms that contribute to inter-rater reliability however remain largely unexplained and unclear. While research in other fields suggests personality of raters can impact ratings, studies looking at personality factors in clinical assessments are few. Many schools use the approach of pairing examiners in clinical assessments and asking them to come to an agreed score. Little is known however, about what occurs when these paired examiners interact to generate a score. Could personality factors have an impact? Methods: A fully-crossed design was employed with each participant examiner observing and scoring. A quasi-experimental research design used candidate’s observed scores in a mock clinical assessment as the dependent variable. The independent variables were examiner numbers, demographics and personality with data collected by questionnaire. A purposeful sample of doctors who examine in the Final Medical examination at our institution was recruited. Results: Variability between scores given by examiner pairs (N=6) was less than the variability with individual examiners (N=12). 75% of examiners (N=9) scored below average for neuroticism and 75% also scored high or very high for extroversion. Two-thirds scored high or very high for conscientiousness. The higher an examiner’s personality score for extroversion, the lower the amount of change in his/her score when paired up with a co-examiner; reflecting possibly a more dominant role in the process of reaching a consensus score. Conclusions: The reliability of clinical assessments using paired examiners is comparable to assessments with single examiners. Personality factors, such as extroversion, may influence the magnitude of change in score an individual examiner agrees to when paired up with another examiner. Further studies on personality factors and examiner behaviour are needed to test associations and determine if personality testing has a role in reducing examiner variability.

scholarly journals Pheochromocytoma – An Unusual Presentation – A Case Report

1970 ◽  
Vol 28 (2) ◽  
pp. 113-116
Author(s):  
Indrajit Prasad ◽  
Zafar Ahmed Latif ◽  
Faruque Pathan ◽  
SM Ashrafuzzaman ◽  
Firoz Amin
Keyword(s):  
Blood Pressure ◽  
Case Report ◽  
Blood Sample ◽  
Blood Sugar ◽  
Severe Headache ◽  
Insulin Hypoglycemia ◽  
Intravenous Glucose ◽  
Profuse Sweating ◽  
To Come ◽  
Very High

This case report is of a 50yrs old man who got admitted inBIRDEM Hospital in a state of unconsciousness for 5 hours.He is a known case of hypertension and diabetes mellitusfor the last 12 years and was on insulin. Hypoglycemia wasdetected, treated with intravenous glucose and the patientregained consciousness. On further query he complainedof repeated episodes of nausea, palpitation and sweatingfor the last 12 years. The episodes were initially labeled ashypoglycemia but blood sugar was never found inhypoglycemic range. The patient was on multipleantihypertensive medications but blood pressure wasuncontrolled. All the investigations were normal including24hrs urinary VMA, serum adrenalin and noradrenalinexcept ultrasonography of whole abdomen which showed amass measuring 72x 76 mm in left suprarenal region. Onenight the patient again developed palpitation, chestdiscomfort, severe headache and profuse sweating. Bloodpressure was recorded 240/160 mmHg. Blood sample wasdrawn for adrenalin, noradrenalin, 24hrs urine collectionwas done for VMA and was found very high. The patientwas diagnosed as having left adrenal pheochromocytoma.After controlling blood pressure and other preoperativepreparations left adrenalectomy was done. Histopathologyrevealed phaeochromocytoma. Per and postoperativeperiods were quite eventful. Blood pressure was normalwithout any antihypertensive drug during discharge. Thepatient was discharged with the advice to come for followup after 1 month.DOI: 10.3329/jbcps.v28i2.5371J Bangladesh Coll Phys Surg 2010; 28: 113-116

A Civil Servant’s Adieu

2019 ◽  
pp. 193-236
Author(s):  
Arvind Elangovan
Keyword(s):  
Political History ◽  
Dominant Role ◽  
Fundamental Rights ◽  
The Political ◽  
Indian Constitution ◽  
Constituent Assembly ◽  
Postcolonial State ◽  
Political Interests ◽  
History Of ◽  
To Come

Contrary to Rau’s ideas, the framers of the Indian constitution, however, were deeply influenced by the political history that preceded the meeting of the Constituent Assembly. As a result, the framers privileged not only Fundamental Rights but also the postcolonial State and the latter’s right to intervene for the cause of social justice. Interestingly, the idea that mainly underscored this act of privileging was not so much to come together to create a state by submitting individual wills (as theorized by social contract theorists, for instance) but rather there was a deep mistrust between the different political interests that were at work in the Constituent Assembly. Thus, by the time of the drafting of the Indian constitution, political history played a dominant role, with norms giving way to a history of politics.

scholarly journals How Destructive Is Innovation?

Econometrica ◽  
2019 ◽  
Vol 87 (5) ◽  
pp. 1507-1541 ◽  
Author(s):  
Daniel Garcia-Macia ◽  
Chang-Tai Hsieh ◽  
Peter J. Klenow
Keyword(s):  
Dominant Role ◽  
Job Creation ◽  
Creative Destruction ◽  
Aggregate Productivity ◽  
Employment Share ◽  
New Varieties ◽  
To Come ◽  
Using Data ◽  
The U.S ◽  
Job Creation And Destruction

Entrants and incumbents can create new products and displace the products of competitors. Incumbents can also improve their existing products. How much of aggregate productivity growth occurs through each of these channels? Using data from the U.S. Longitudinal Business Database on all nonfarm private businesses from 1983 to 2013, we arrive at three main conclusions: First, most growth appears to come from incumbents. We infer this from the modest employment share of entering firms (defined as those less than 5 years old). Second, most growth seems to occur through improvements of existing varieties rather than creation of brand new varieties. Third, own‐product improvements by incumbents appear to be more important than creative destruction. We infer this because the distribution of job creation and destruction has thinner tails than implied by a model with a dominant role for creative destruction.

Measuring change

2015 ◽  
Author(s):  
David L. Streiner ◽  
Geoffrey R. Norman ◽  
John Cairney
Keyword(s):  
Experimental Studies ◽  
Curve Analysis ◽  
Growth Curve Analysis ◽  
Clinical Assessments ◽  
Measuring Change ◽  
Quasi Experimental ◽  
Measure Change ◽  
Relationship Of ◽  
The Relationship ◽  
Methodological Difficulties

Although the goal of many clinical assessments and research studies is to measure how much people change between two occasions, the measurement of change is fraught with conceptual and methodological difficulties. One of the difficulties is that there are (at least) two different reasons to measure change: to determine if intervention had any effect, and to identify the correlates of change. These two goals work against each other, because the former requires there to be little difference in the amount of change among people in the same group, while the latter depends on inter-individual differences. The chapter also discusses various biases that exist when people are asked directly how much they think they have changed. This chapter addresses the issues of the relationship of change to the reliability of the scale, difficulties of measuring change in experimental and quasi-experimental studies, and new approaches to measuring change, such as growth curve analysis.

scholarly journals Introduction to the Joint Commission Meeting on High Resolution Imaging from the Ground

1989 ◽  
Vol 8 ◽  
pp. 545-546
Author(s):  
John Davis
Keyword(s):  
High Resolution ◽  
Angular Resolution ◽  
High Angular Resolution ◽  
High Resolution Imaging ◽  
Wide Range ◽  
High Resolution Images ◽  
Resolution Imaging ◽  
Optical Wavelengths ◽  
To Come ◽  
Very High

As a result of advances in instrumentation and techniques, from radio through to optical wavelengths, we have before us the prospect of producing very high resolution images of a wide range of objects across this entire spectral range. This prospect, and the new knowledge and discoveries that may be anticipated from it, lie behind an upsurge in interest in high resolution imaging from the ground. Several new high angular resolution instruments for radio, infrared, and optical wavelengths are expected to come into operation before the 1991 IAU General Assembly.

scholarly journals Does Animal Personality Affect Movement in Habitat Corridors? Experiments with Common Voles (Microtus arvalis) Using Different Corridor Widths

Animals ◽  
2019 ◽  
Vol 9 (6) ◽  
pp. 291 ◽  
Author(s):  
Gabriele Joanna Kowalski ◽  
Volker Grimm ◽  
Antje Herde ◽  
Anja Guenther ◽  
Jana A. Eccard
Keyword(s):  
Tracking System ◽  
Movement Patterns ◽  
Animal Personality ◽  
Very High Frequency ◽  
Behavioral Traits ◽  
Site Characteristics ◽  
Habitat Corridors ◽  
Personality Score ◽  
Common Voles ◽  
Very High

Animal personality may affect an animal’s mobility in a given landscape, influencing its propensity to take risks in an unknown environment. We investigated the mobility of translocated common voles in two corridor systems 60 m in length and differing in width (1 m and 3 m). Voles were behaviorally phenotyped in repeated open field and barrier tests. Observed behavioral traits were highly repeatable and described by a continuous personality score. Subsequently, animals were tracked via an automated very high frequency (VHF) telemetry radio tracking system to monitor their movement patterns in the corridor system. Although personality did not explain movement patterns, corridor width determined the amount of time spent in the habitat corridor. Voles in the narrow corridor system entered the corridor faster and spent less time in the corridor than animals in the wide corridor. Thus, landscape features seem to affect movement patterns more strongly than personality. Meanwhile, site characteristics, such as corridor width, could prove to be highly important when designing corridors for conservation, with narrow corridors facilitating faster movement through landscapes than wider corridors.

Evaporative Cooling of Gas Turbine Engines

2013 ◽  
Vol 135 (8) ◽  
Author(s):  
Mustapha Chaker ◽  
Cyrus B. Meher-Homji
Keyword(s):  
Gas Turbine ◽  
Gas Turbines ◽  
Low Cost ◽  
Evaporative Cooling ◽  
Turbine Engines ◽  
Gas Turbine Engines ◽  
End User ◽  
Very High ◽  
Improve Reliability ◽  
Selection Of

There are numerous gas turbine applications in power generation and mechanical drive service where power drop during the periods of high ambient temperature has a very detrimental effect on the production of power or process throughput. Several geographical locations experience very high temperatures with low coincident relative humidities. In such cases media evaporative cooling can be effectively applied as a low cost power augmentation technique. Several misconceptions exist regarding their applicability to evaporative cooling, the most prevalent being that they can only be applied in extremely dry regions. This paper provides a detailed treatment of media evaporative cooling, discussing aspects that would be of value to an end user, including selection of climatic design points, constructional features of evaporative coolers, thermodynamic aspects of its effect on gas turbines, and approaches to improve reliability. It is hoped that this paper will be of value to plant designers, engineering companies, and operating companies that are considering the use of media evaporative cooling.

scholarly journals Development of Adobe Flash Media in Increasing Learning Interest

2021 ◽  
Vol 13 (2) ◽  
pp. 1239-1246
Author(s):  
Dhia Asy Syafa ◽  
Pratiwi Pujiastuti ◽  
Deri Anggraini
Keyword(s):  
Rating Scales ◽  
School Teacher ◽  
Student Interest ◽  
Initial Field ◽  
Study Program ◽  
Quantitative Research Methods ◽  
Adobe Flash ◽  
Operational Test ◽  
Quasi Experimental ◽  
Very High

This research aims to develop learning media products based on Adobe Flash in Indonesian Language Courses in the Elementary School Teacher Education Study Program. This research was conducted through four main stages: define, design, develop, and disseminate. This study uses a questionnaire as a data collection instrument, adapting quantitative research methods with a quasi-experimental approach (quasi-experimental) at the implementation stage in this study. The data to be obtained in the study were collected through interviews, questionnaires, and product rating scales. This scale collected data at the product validity stage, small group trials, and primary field trials. The results of the development of learning media products using a 4D development model with seven main components. Based on the results of the feasibility validation obtained in the Expert test and the initial field test, the feasibility of the media and material the value obtained is "very high" or worth testing. Based on these results, Adobe Flash media was tested with the operational test stage, and it is known that the results were obtained at an attractive value of 3.52 in this category, "Very High" or perfect changes in student interest in learning.

Sign in / Sign up

Export Citation Format

Share Document