scholarly journals A semi-structured interview for psychological autopsy in suicide cases

2003 ◽  
Vol 25 (4) ◽  
pp. 212-219 ◽  
Author(s):  
Blanca Guevara Werlang ◽  
Neury José Botega
Keyword(s):  
Interrater Reliability ◽  
Kappa Statistic ◽  
Structured Interview ◽  
Significant Degree ◽  
Kappa Statistics ◽  
Psychological Autopsy ◽  
One Step ◽  
Evaluation Module ◽  
Key Topics ◽  
Final Agreement

OBJECTIVE: To investigate the applicability and the interrater reliability of a Semi-Structured Interview for psychological autopsy in cases of suicide. METHOD: The Semi-Structured Interview for Psychological Autopsy (SSIPA) proposed in this paper consists of four modules which evaluate key-topics associated to suicide. In order to evaluate the instrument's applicability, a sample formed by 42 subjects related to 21 suicide cases was used. The interviews were tape-recorded first and then transcribed. The related material as well as the police inquiry data were presented to four judges. Evaluation of information has been performed with the help of a four-module formulary for decision making: precipitants and/or stressors, motivation, lethality, and intentionality. Data processing, whenever possible, has been accomplished using kappa statistics. When kappa statistic was not applicable, concordance percentage has been used. RESULTS: The SSIPA is applicable because it provides information containing a significant degree of agreement between evaluators, found in one hundred and twenty measurements of judgements made by four judges. There has been significant statistical agreement between the judges in three modules (precipitants and/or stressors, motivation, and intentionality) of the model for decision, except in one step of each module, which did not interfere in the final agreement on the present evaluation. In the lethality evaluation module, there has been a 100% agreement between judges. The judgement made by the raters on the four modules have allowed to reach a final agreement regarding the death mode as suicide. CONCLUSION: The results of this study show that it is possible to use a semi-structured instrument for psychological autopsy in cases of suicide, when the interviewees are relatives who accepted to provide information.

scholarly journals Using Differential Item Functioning to Test for Interrater Reliability in Constructed Response Items

2020 ◽  
Vol 80 (4) ◽  
pp. 808-820
Author(s):  
Cindy M. Walker ◽  
Sakine Göçer Şahin
Keyword(s):  
Differential Item Functioning ◽  
Interrater Reliability ◽  
Rating Scales ◽  
Rating Scale ◽  
Intraclass Correlation ◽  
Kappa Statistic ◽  
Promising Alternative ◽  
Constructed Response ◽  
Polytomous Item ◽  
Item Functioning

The purpose of this study was to investigate a new way of evaluating interrater reliability that can allow one to determine if two raters differ with respect to their rating on a polytomous rating scale or constructed response item. Specifically, differential item functioning (DIF) analyses were used to assess interrater reliability and compared with traditional interrater reliability measures. Three different procedures that can be used as measures of interrater reliability were compared: (1) intraclass correlation coefficient (ICC), (2) Cohen’s kappa statistic, and (3) DIF statistic obtained from Poly-SIBTEST. The results of this investigation indicated that DIF procedures appear to be a promising alternative to assess the interrater reliability of constructed response items, or other polytomous types of items, such as rating scales. Furthermore, using DIF to assess interrater reliability does not require a fully crossed design and allows one to determine if a rater is either more severe, or more lenient, in their scoring of each individual polytomous item on a test or rating scale.

scholarly journals Reliability Assessment of Scores From Video-Recorded TGMD-3 Performances

2017 ◽  
Vol 5 (1) ◽  
pp. 59-68 ◽  
Author(s):  
Pauli Olavi Rintala ◽  
Arja Kaarina Sääkslahti ◽  
Susanna Iivonen
Keyword(s):  
Motor Development ◽  
Interrater Reliability ◽  
Intraclass Correlation ◽  
Kappa Statistic ◽  
Intrarater Reliability ◽  
Gross Motor ◽  
Gross Motor Development ◽  
Percent Agreement ◽  
Two Samples ◽  
Ball Skills

This study examined the intrarater and interrater reliability of the Test of Gross Motor Development—3rd Edition (TGMD-3). Participants were 60 Finnish children aged between 3 and 9 years, divided into three separate samples of 20. Two samples of 20 were used to examine the intrarater reliability of two different assessors, and the third sample of 20 was used to establish interrater reliability. Children’s TGMD-3 performances were video-recorded and later assessed using an intraclass correlation coefficient, a kappa statistic, and a percent agreement calculation. The intrarater reliability of the locomotor subtest, ball skills subtest, and gross motor total score ranged from 0.69 to 0.77, and percent agreement ranged from 87 to 91%. The interrater reliability of the locomotor subtest, ball skills subtest, and gross motor total score ranged from 0.56 to 0.64. Percent agreement of 83% was observed for locomotor skills, ball skills, and total skills, respectively. Hop, horizontal jump, and two-hand strike assessments showed the most difference between the assessors. These results show acceptable reliability for the TGMD-3 to analyze children’s gross motor skills.

scholarly journals Reliability and validity of a questionnaire on vulnerability to sexually transmitted infections among adults with chronic mental illness: PESSOAS Project

2008 ◽  
Vol 30 (1) ◽  
pp. 55-59 ◽  
Author(s):  
Mark Drew Crosland Guimarães ◽  
Helian Nunes de Oliveira ◽  
Lorenza Nogueira Campos ◽  
Carolina Ali Santos ◽  
Carlos Eduardo Resende Gomes ◽  
...  
Keyword(s):  
Mental Illness ◽  
Construct Validity ◽  
Risk Behavior ◽  
Demographic Data ◽  
Structured Interview ◽  
Chronic Mental Illness ◽  
Kappa Statistics ◽  
Sexually Transmitted ◽  
Validity Assessment ◽  
Grade Of Membership

OBJECTIVE: To describe reliability/validity of a semi-structured questionnaire designed to assess risk behavior to sexually transmitted diseases among adults with chronic mental illness. METHOD: A cross-sectional pilot study was conducted in one psychiatric hospital and one mental health outpatient clinic. Clinical, behavioral and demographic data were collected from semi-structured interviews and medical charts. One-hundred and twenty patients were randomly selected from pre-defined lists in both centers while 89 (74%) were interviewed, indicating 26% nonparticipation rate. Protocol, participation rates, consent form and feasibility issues were assessed. The semi-structured interview was evaluated with regard to reliability (intra- and inter-rater) and construct validity by randomly repeating the interviews in a 1:1 ratio up to one-week interval. Reliability was estimated by percent agreement and Kappa statistics (95% confidence interval). Construct validity was assessed by Grade of Membership model. RESULTS: Kappa statistics ranged from 0.40 to 1.00 for most variables. Grade of Membership analysis generated three profiles. Profile one was represented by mostly women with no condom use in stable relationships; profile two revealed mostly men in stable relationship but with multiple risk behaviors; while profile three indicated a higher proportion of licit or illicit substance use. CONCLUSIONS: Reliability and construct validity assessment using Grade of Membership analysis indicated that the semi-structured interview was suitable for capturing risk behavior among patients with chronic mental illness.

scholarly journals Psychological autopsy: Overview of Indian evidence, best practice elements, and a semi-structured interview guide

2020 ◽  
Vol 62 (6) ◽  
pp. 631
Author(s):  
Vikas Menon ◽  
Natarajan Varadharajan ◽  
Sharmi Bascarane ◽  
Karthick Subramanian ◽  
MoushumiPurkayastha Mukherjee ◽  
...  
Keyword(s):  
Best Practice ◽  
Structured Interview ◽  
Psychological Autopsy ◽  
Practice Elements ◽  
Interview Guide

An Intercenter Comparison of Nasolabial Appearance Including a Center Using Nasoalveolar Molding

2018 ◽  
Vol 55 (5) ◽  
pp. 655-663 ◽  
Author(s):  
Supakit Peanchitlertkajorn ◽  
Ana Mercado ◽  
John Daskalogiannakis ◽  
Ronald Hathaway ◽  
Kathleen Russell ◽  
...  
Keyword(s):  
Interrater Reliability ◽  
Cleft Lip ◽  
Rating Scale ◽  
Cleft Lip And Palate ◽  
Nasal Reconstruction ◽  
Kappa Statistics ◽  
Symmetry Center ◽  
Specific Protocol ◽  
Nasoalveolar Molding ◽  
Presurgical Orthopedics

Objective: To compare nasolabial appearance outcomes of patients with complete unilateral cleft lip and palate (CUCLP) in preadolescence from 4 cleft centers including a center using nasoalveolar molding (NAM) and primary nasal reconstruction. Design: Retrospective cohort study. Setting: Four cleft centers in North America. Patients: 135 subjects with repaired CUCLP. Methods: Frontal and profile facial pictures were assessed using the Asher-McDade rating scale. Intra- and interrater reliability were tested using weighted Kappa statistics. Median scores by center were compared with Kruskal-Wallis statistics. Results: Intrarater reliability scores were moderate to good. Interrater reliability scores were moderate. Significant differences ( P < .05) among centers were found. For nasal form, center G (median = 2.83) had better scores than centers C and D (C median = 3.33, D median = 3.17). For nose symmetry, center G had better scores (median = 2.33) than all other centers (B median = 2.67, C median = 2.83, D median = 2.83). For vermillion border, center G had better scores (median = 2.58) than centers B and C (B median = 3.17, C median = 3.17). For nasolabial profile, center G (median score = 2.67) had better scores than center C (median = 3.00). For total nasolabial score, center G (median = 2.67) had better scores than all other centers (B median = 2.83, C median = 3, D median = 2.83). Conclusion: The protocol followed by center G, the only center that performed NAM and primary nasal reconstruction, produced better results in all categories when compared to center C, the only center that did not perform presurgical orthopedics or lip/nose revisions. When compared to centers that performed traditional presurgical orthopedics and surgical revisions (B and D), center G was not consistently better in all categories. As with other uncontrolled, retrospective intercenter studies, it is not possible to attribute the outcomes to a specific protocol component.

scholarly journals Development and reliability of a structured interview guide for the Montgomery-Åsberg Depression Rating Scale (SIGMA)

2008 ◽  
Vol 192 (1) ◽  
pp. 52-58 ◽  
Author(s):  
Janet B. W. Williams ◽  
Kenneth A. Kobak
Keyword(s):  
Clinical Trials ◽  
Treatment Efficacy ◽  
Interrater Reliability ◽  
Rating Scale ◽  
High Reliability ◽  
Intraclass Correlation ◽  
Structured Interview ◽  
Interview Guide ◽  
Test Retest Reliability ◽  
Improve Reliability

BackgroundThe Montgomery-Åsberg Depression Rating Scale (MADRS) is often used in clinical trials to select patients and to assess treatment efficacy. The scale was originally published without suggested questions for clinicians to use in gathering the information necessary to rate the items. Structured and semi-structured interview guides have been found to improve reliability with other scales.AimsTo describe the development and test-retest reliability of a structured interview guide for the MADRS (SIGMA).MethodA total of 162 test-retest interviews were conducted by 81 rater pairs. Each patient was interviewed twice, once by each rater conducting an independent interview.ResultsThe intraclass correlation for total score between raters using the SIGMA was r = 0.93, P < 0.0001. All ten items had good to excellent interrater reliability.ConclusionsUse of the SIGMA can result in high reliability of MADRS scores in evaluating patients with depression.

scholarly journals Kappa statistic for judgment agreement in Sociolinguistics / Estatística Kappa para concordância de julgamento em Sociolinguística

2019 ◽  
Vol 27 (4) ◽  
pp. 1591
Author(s):  
Raquel Meister Ko. Freitag
Keyword(s):  
Gender Bias ◽  
Explanatory Power ◽  
Kappa Statistic ◽  
Kappa Statistics ◽  
Rater Agreement ◽  
Linguistic Change ◽  
New Techniques ◽  
Reaction Test ◽  
Subjective Reaction

Abstract: Perception studies have required the development of new techniques, as well as new ways of analyzing data. This paper discusses the proposal of Kappa statistic for the measurement of agreement amongst judgments in perception tests. The analysis deals with data obtained from a subjective reaction test focusing on the variable pronunciation of /t, d/ as stops or affricates in Aracaju, Sergipe, Brazil, considering aesthetic, rhythmic, and dialectal factors. Kappa statistic shows aspects of the inter-rater agreement and reliability that can explain how the linguistic change is driven in the community. This type of analysis also allows to account for, in a perception study, the sex/gender bias observed in production. Results suggest that Kappa-statistics is a tool that can improve the explanatory power of perceptual studies in Sociolinguistics.Keywords: Sociolinguistic perception; statistic tools; inter-rater agreement; /t,d/ palatalization.Resumo: Estudos de percepção têm demandado o desenvolvimento de novas técnicas, assim como novas formas de analisar os dados obtidos. Este texto discute a proposta do teste Kappa para a aferição da força de convergência de julgamentos em testes de percepção. A análise é realizada com dados obtidos em um teste de reação subjetiva quanto à realização variável de /t,d/ em Aracaju, Brasil, considerando fatores estéticos, rítmicos e dialetais. A estatística Kappa mostra aspectos da concordância e da confiabilidade entre os avaliadores que podem ser usados para explicar como a mudança linguística se dá na comunidade. A análise também permite identificar em um estudo da percepção o viés de sexo/gênero observado nos estudos de produção. Os resultados mostram que a estatística Kappa é uma ferramenta que pode ampliar o poder explanatório dos estudos de percepção em Sociolinguística.Palavras-chave: percepção sociolinguística; ferramentas estatísticas; concordância de juízes; palatalização de /t,d/.

scholarly journals Appraisals of Anomalous Experiences Interview (AANEX): a multidimensional measure of psychological responses to anomalies associated with psychosis

2007 ◽  
Vol 191 (S51) ◽  
pp. s23-s30 ◽  
Author(s):  
C. M. C. Brett ◽  
E. P. Peters ◽  
L. C. Johns ◽  
P. Tabraham ◽  
L. R. Valmaggia ◽  
...  
Keyword(s):  
Emotional Response ◽  
Interrater Reliability ◽  
Clinical Care ◽  
Structured Interview ◽  
Psychotic Symptoms ◽  
Clinical Samples ◽  
Psychological Responses ◽  
Cross Sectional ◽  
Multidimensional Measure ◽  
Detailed Assessment

BackgroundCognitive models of psychosis suggest that whether anomalous experiences lead to clinically relevant psychotic symptoms depends on how they are appraised, the context in which they occur and the individual's emotional responseAimsTo develop and validate a semi-structured interview (the Appraisals of Anomalous Experiences Interview; AANEX) to assess (a) anomalous experiences and (b) appraisal, contextual and response variablesMethodFollowing initial piloting, construct validity was tested via cross-sectional comparison of data from clinical and non-clinical samples with anomalous experiences. Interrater reliability was also assessedResultsScores from AANEX measuring appraisals, responses and social support differentiated the clinical and nonclinical groups. Interrater reliability was satisfactory for 65 of the 71 items. Six items were subsequently amendedConclusionsThe AANEX is avalid multidimensional instrument that provides a detailed assessment of psychotic-like experiences and subjective variables relevant to the development of a need for clinical care

Review of the Bethesda System for Reporting Thyroid Cytopathology: A Local Study in Bohol Island, Philippines

2015 ◽  
Vol 59 (1) ◽  
pp. 77-82 ◽  
Author(s):  
Annette L. Salillas ◽  
Faye Candice S. Sun ◽  
Emelisa G. Almocera
Keyword(s):  
Kappa Statistic ◽  
Needle Aspiration ◽  
Cross Sectional Study ◽  
Kappa Statistics ◽  
Cross Sectional ◽  
Local Study ◽  
Risk Of Malignancy ◽  
Bethesda System ◽  
Thyroid Cytopathology ◽  
The Bethesda System

Objectives: The aim of this study was to evaluate the adaptability and reproducibility of the Bethesda System for Reporting Thyroid Cytopathology (BSRTC) in a local setting and to determine the risk of malignancy for each category. Materials and Methods: A retrospective cross-sectional study of 80 thyroid fine-needle aspiration cytology cases using the BSRTC with corresponding histopathology was done between September 2009 and December 2012. Agreement scores were calculated using kappa statistics. Results: Consensus among two readers was attained for 73 cases (91.25%). No disagreement was noted for the malignant cases. The strength of agreement was very good, with a kappa statistic of 0.90. The risk of malignancy observed histologically was as follows: benign 3%, atypia of undetermined significance (AUS) 50%, suspicious for follicular/Hürthle cell neoplasm 50%, suspicious for malignancy 78%, and malignant 100%. Conclusion: In this study, there is an outstanding reproducibility for the classification scheme. The application of the BSRTC as the standardized reporting is readily adaptable and therefore its application in larger medical centers is highly recommended. Our findings of a higher risk of malignancy seen in AUS (50%) and malignant (100%) categories in those who underwent surgical resection corroborated other published studies. Conveying this risk to clinical colleagues is important and will facilitate optimal patient care.

Sign in / Sign up

Export Citation Format

Share Document