The “appropriate” conditions for establishing interrater reliability of interview-based rating scales. A controversial issue

1994 ◽  
Vol 9 (3) ◽  
pp. 149-150
Author(s):  
A Hafkenscheid
Keyword(s):  
Interrater Reliability ◽  
Rating Scales ◽  
Rating Scale ◽  
Controversial Issue ◽  
Auditory Hallucinations ◽  
Brain Abnormalities ◽  
Psychopathological Symptoms ◽  
Schizophrenic Patients ◽  
Practical Implications ◽  
Structural Brain

For many of the conditions with which psychiatry is concerned, there is still no anatomical or physiological abnormality that is reliably found in those affected with the conditions and not in other people. Some evidence exists that, for instance, severe and chronical psychopathological symptoms such as persistent auditory hallucinations, may be linked to structural brain abnormalities in certain subgroups of schizophrenic patients. However, such associations are not well-established as yet and the research in this field does not have practical implications for psychiatric assessment so far.Because objective (physical) indices for measuring (the severity of) psychopathological states have hardly been available up to now, the rating scale is an essential instrument in clinical (psychopharmacological) research.

scholarly journals Using Differential Item Functioning to Test for Interrater Reliability in Constructed Response Items

2020 ◽  
Vol 80 (4) ◽  
pp. 808-820
Author(s):  
Cindy M. Walker ◽  
Sakine Göçer Şahin
Keyword(s):  
Differential Item Functioning ◽  
Interrater Reliability ◽  
Rating Scales ◽  
Rating Scale ◽  
Intraclass Correlation ◽  
Kappa Statistic ◽  
Promising Alternative ◽  
Constructed Response ◽  
Polytomous Item ◽  
Item Functioning

The purpose of this study was to investigate a new way of evaluating interrater reliability that can allow one to determine if two raters differ with respect to their rating on a polytomous rating scale or constructed response item. Specifically, differential item functioning (DIF) analyses were used to assess interrater reliability and compared with traditional interrater reliability measures. Three different procedures that can be used as measures of interrater reliability were compared: (1) intraclass correlation coefficient (ICC), (2) Cohen’s kappa statistic, and (3) DIF statistic obtained from Poly-SIBTEST. The results of this investigation indicated that DIF procedures appear to be a promising alternative to assess the interrater reliability of constructed response items, or other polytomous types of items, such as rating scales. Furthermore, using DIF to assess interrater reliability does not require a fully crossed design and allows one to determine if a rater is either more severe, or more lenient, in their scoring of each individual polytomous item on a test or rating scale.

Speech-Language Pathologists' Ratings of Speech Accuracy in Children With Speech Sound Disorders

2021 ◽  
pp. 1-12
Author(s):  
Linye Jing ◽  
Maria I. Grigos
Keyword(s):  
Interrater Reliability ◽  
Rating Scales ◽  
Rating Scale ◽  
Speech Sound ◽  
Future Research ◽  
Training Procedure ◽  
Speech Sound Disorders ◽  
Speech Language Pathologists ◽  
Point Rating Scale ◽  
Whole Word

Purpose: Forming accurate and consistent speech judgments can be challenging when working with children with speech sound disorders who produce a large number and varied types of error patterns. Rating scales offer a systematic approach to assessing the whole word rather than individual sounds. Thus, these scales can be an efficient way for speech-language pathologists (SLPs) to monitor treatment progress. This study evaluated the interrater reliability of an existing 3-point rating scale using a large group of SLPs as raters. Method: Utilizing an online platform, 30 SLPs completed a brief training and then rated single words produced by children with typical speech patterns and children with speech sound disorders. Words were closely balanced across the three rating categories of the scale. The interrater reliability of the SLPs ratings to a consensus judgment was examined. Results: The majority of SLPs (87%) reached substantial interrater reliability to a consensus judgment using the 3-point rating scale. Correct productions had the highest interrater reliability. Productions with extensive errors had higher agreement than those with minor errors. Certain error types, such as vowel distortions, were especially challenging for SLPs to judge. Conclusions: This study demonstrated substantial interrater reliability to a consensus judgment among a large majority of 30 SLPs using a 3-point rating. The clinical implications of the findings are discussed along with proposed modifications to the training procedure to guide future research.

Factor Analytic Study of Social Behavior in Children

1969 ◽  
Vol 25 (2) ◽  
pp. 399-406
Author(s):  
S. Thomas Friedman ◽  
Richard F. Purnell ◽  
Edward E. Gotts
Keyword(s):  
Interrater Reliability ◽  
Rating Scales ◽  
Rating Scale ◽  
Ego Strength ◽  
Personality Variables ◽  
Adult Participant ◽  
Factor Analytic Study ◽  
Living Together ◽  
Peer Orientation ◽  
Children And Young Adolescents

The purpose was to use adult participant observers to create a scale for assessing some salient personality variables of children and young adolescents living together in close quarters. The 91 children were summer campers of both sexes (8 to 15 yr.). Counselors of these children were the adult participant observers. At least two counselors rated each camper on a 49-item rating scale. Interrater reliability was determined and composite ratings of the campers were factor analyzed. Seven factors accounted for the behaviors on the rating scales. These factors were consistent with and comparable to the constructs that were introduced into the items on the rating scale, e.g., Peer Orientation, Ego Strength, Interaction Potential, Adult Orientation, Rebelliousness, and Rigidity.

An automated morphometric analysis of brain abnormalities in schizophrenic patients with auditory hallucinations

2000 ◽  
Vol 41 (1) ◽  
pp. 121-122
Author(s):  
S.L. Rossell ◽  
J. Shapleske ◽  
P.W.R. Woodruff ◽  
J. Suckling ◽  
A. Simmons ◽  
...  
Keyword(s):  
Morphometric Analysis ◽  
Auditory Hallucinations ◽  
Brain Abnormalities ◽  
Schizophrenic Patients

Characteristics of Schizophrenic Patients and the Outcome of Fluphenazine and of Electroconvulsive Treatments*

1987 ◽  
Vol 32 (6) ◽  
pp. 425-428 ◽  
Author(s):  
Johan Landmark ◽  
Llewellyn Joseph ◽  
Harold Merskey
Keyword(s):  
Auditory Hallucinations ◽  
Psychopathological Symptoms ◽  
Schizophrenic Patients ◽  
Previous Occasion

We examined the outcome with fluphenazine treatment and ECT in a group of 120 patients according to the incidence of psychopathological symptoms, the patients’ status on a variety of sociodemographic and anamnestic variables, and their diagnoses according to 13 systems for diagnosing schizophrenia. All had previously been considered to be schizophrenic patients at least once in hospital settings. The outcome with fluphenazine was better in patients with passivity feelings, auditory hallucinations and other hallucinations and delusions. The outcome with patients who had ECT, as judged from the hospital files, was better in those who were preoccupied with delusions or hallucinations and less successful in those who had been diagnosed as having schizophrenia on the first previous occasion when they had been discharged from the hospital.

scholarly journals Validation of a Spanish Version of the Lille Apathy Rating Scale for Parkinson’s Disease

2014 ◽  
Vol 2014 ◽  
pp. 1-7 ◽  
Author(s):  
Rocio García-Ramos ◽  
Clara Villanueva Iza ◽  
María José Catalán ◽  
Abilio Reig-Ferrer ◽  
Jorge Matías-Guíu
Keyword(s):  
Parkinson’S Disease ◽  
Parkinson's Disease ◽  
Interrater Reliability ◽  
Rating Scales ◽  
Rating Scale ◽  
Reliability And Validity ◽  
Spanish Version ◽  
Healthy Controls ◽  
Lars Score ◽  
Optimal Cutoff Point

Introduction. To date, no rating scales for detecting apathy in Parkinson’s disease (PD) patients have been validated in Spanish. For this reason, the aim of this study was to validate a Spanish version of Lille apathy rating scale (LARS) in a cohort of PD patients from Spain.Participants and Methods. 130 PD patients and 70 healthy controls were recruited to participate in the study. Apathy was measured using the Spanish version of LARS and the neuropsychiatric inventory (NPI). Reliability (internal consistency, test-retest, and interrater reliability) and validity (construct, content, and criterion validity) were measured.Results. Interrater reliability was 0.93. Cronbach’sαfor LARS was 0.81. The test-retest correlation coefficient was 0.97. The correlation between LARS and NPI scores was 0.61. The optimal cutoff point under the ROC curve was-14, whereas the value derived from healthy controls was-11. The prevalence of apathy in our population tested by LARS was 42%.Conclusions. The Spanish version of LARS is a reliable and useful tool for diagnosing apathy in PD patients. Total LARS score is influenced by the presence of depression and cognitive impairment. However, both disorders are independent identities with respect to apathy. The satisfactory reliability and validity of the scale make it an appropriate instrument for screening and diagnosing apathy in clinical practice or for research purposes.

scholarly journals Fetal Hypoxia and Structural Brain Abnormalities in Schizophrenic Patients, Their Siblings, and Controls

2002 ◽  
Vol 59 (1) ◽  
pp. 35 ◽  
Author(s):  
Tyrone D. Cannon ◽  
Theo G. M. van Erp ◽  
Isabelle M. Rosso ◽  
Matti Huttunen ◽  
Jouko Lönnqvist ◽  
...  
Keyword(s):  
Fetal Hypoxia ◽  
Brain Abnormalities ◽  
Schizophrenic Patients ◽  
Structural Brain

A Behavioural Rating Scale for Mental Patients

1955 ◽  
Vol 101 (424) ◽  
pp. 644-653 ◽  
Author(s):  
L. Shatin ◽  
E. X. Freed
Keyword(s):  
Social Behaviour ◽  
Rating Scales ◽  
Psychiatric Care ◽  
Rating Scale ◽  
Reliability And Validity ◽  
Psychiatric Interview ◽  
Psychiatric Classification ◽  
Music Therapist ◽  
Schizophrenic Patients ◽  
Rehabilitation Personnel

In connection with a demonstration programme of comprehensive psychiatric care for hospitalized schizophrenic patients, it was necessary to develop a rapid and effective method for rating patients' ward adjustment and social behaviour. The scale, entitled the Albany Behavioural Rating Scale (ABRS), and its validation, are described in this report. The nature of the problem required that the scale be readable, easily completed and scored, and suitable for use by nursing and rehabilitation personnel (OT, CT, Music Therapist, etc.). Further requirements included adequate scoring reliability and validity, as well as amenability to quantification.Various rating scales have been described in the psychiatric literature, but these did not meet our needs. Some were too cumbersome and time-consuming. Others required individual psychiatric interview. Frequently they demanded high literacy of the rater. Certain scales are indeed useful for special purposes, as for example the MSRPP (Lorr, 1953) which can be employed with confidence as an aid to psychiatric classification. Lucero and Meyer (1951) have discussed the requirements of an adequate rating scale.

scholarly journals Pengaruh Terapi Psikoreligious: Dzikir dalam Mengontrol Halusinasi Pendengaran Pada Pasien Skizofrenia yang Muslim di Rumah Sakit Jiwa Tampan Provinsi Riau

2020 ◽  
Vol 20 (3) ◽  
pp. 821
Author(s):  
Pratiwi Gasril ◽  
Suryani Suryani ◽  
Heppi Sasmita
Keyword(s):  
Rating Scale ◽  
American Psychological Association ◽  
Auditory Hallucinations ◽  
P Value ◽  
World Population ◽  
American Psychological ◽  
Before And After ◽  
Schizophrenic Patients ◽  
Patients Experience ◽  
Additional Therapy

Data from the American Psychological Association (APA) in 2010 and Riskesdas 2013 show that on the average world population has schizophrenia and 70% of schizophrenic patients experience hallucinations. One of the recommended therapies in an effort to control hallucinations is psychoreligious therapy: dhikr. The purpose of this study was to determine the effect of psycho-religious therapy: dhikr in controlling hallucinations in schizophrenia patients. The research method used is quantitative with a Quasy expriemental approach carried out on 20 respondents at the Tampan Mental Hospital, Riau Province. Researchers used the Auditory Hallucinations Rating Scale (AHRS) module and evaluation sheet before and after the intervention. The results showed that there was an effect of psychoreligious therapy: dhikr in controlling hallucinations in schizophrenic patients (p value = 0,000). The results of this study can be used as additional therapy in controlling hallucinations in patients with auditory hallucinations.

Sign in / Sign up

Export Citation Format

Share Document