scholarly journals OPCRIT+: an electronic system for psychiatric diagnosis and data collection in clinical and research settings

2011 ◽  
Vol 199 (2) ◽  
pp. 151-155 ◽  
Author(s):  
James Rucker ◽  
Stuart Newman ◽  
Joanna Gray ◽  
Cerisse Gunasinghe ◽  
Matthew Broadbent ◽  
...  
Keyword(s):  
Data Collection ◽  
Interrater Reliability ◽  
Weighted Kappa ◽  
Electronic System ◽  
Mental Health Research ◽  
Large Sample Size ◽  
Reliability Study ◽  
Diagnostic Reliability ◽  
Diagnostic Application ◽  
Research Populations

BackgroundThe increasingly large sample size requirements of modern adult mental health research suggests the need for a data collection and diagnostic application that can be used across a broad range of clinical and research populations.AimsTo develop a data collection and diagnostic application that can be used across a broad range of clinical and research settings.MethodWe expanded and redeveloped the OPCRIT system into a broadly applicable diagnostic and data-collection package and carried out an interrater reliability study of this new tool.ResultsOPCRIT+ performed well in an interrater reliability study with relatively inexperienced clinicians, giving a combined, weighted kappa of 0.70 for diagnostic reliability.ConclusionsOPCRIT+ showed good overall interrater reliability scores for diagnoses. It is now incorporated in the electronic patient record of the Maudsley and associated hospitals. OPCRIT+ can be downloaded free of charge at http://sgdp.iop.kcl.ac.uk/opcritplus.

A Reliability Study of Multiplanar Radiographs for the Evaluation of SNAC Wrist Arthritis

Hand ◽  
2020 ◽  
pp. 155894472093735
Author(s):  
Eliana B. Saltzman ◽  
Elizabeth P. Wahl ◽  
Amanda N. Fletcher ◽  
Nicholas Said ◽  
Suhail K. Mithani ◽  
...  
Keyword(s):  
Interrater Reliability ◽  
Interobserver Agreement ◽  
Weighted Kappa ◽  
Proximal Row Carpectomy ◽  
Substantial Agreement ◽  
Reliability Study ◽  
Single View ◽  
Articular Surfaces ◽  
Snac Wrist ◽  
Single Versus

Background: Scaphoid nonunion advanced collapse (SNAC) is a common form of wrist arthritis, the treatment of which depends on the arthritic stage. The Vender classification serves to describe SNAC arthritis based on a single posteroanterior (PA) radiograph. The purpose of this study was to evaluate the intraobserver and interobserver agreement of the Vender classification, comparing multi versus single radiographic views. Methods: A retrospective review of patients with SNAC arthritis who underwent a proximal row carpectomy or a 4-corner fusion was performed. The included patients had 3 radiographic views of the pathologic wrist. Fifteen patients were analyzed by 5 blinded reviewers. Wrists were graded using the Vender classification first on the PA view and then using multiview radiographs. The intraobserver and interobserver agreement was determined using weighted kappa analysis. χ2 tests were calculated comparing the evaluation between single- versus multiview radiographs and determining a higher Vender stage. Results: Multiview radiographs demonstrated a higher intraobserver κw compared with single-view radiographs (0.72 vs 0.66), both representing substantial agreement. The average interobserver agreement was moderate (κw of 0.48) for single view and slight (κw of 0.30) for multiview evaluation. Evaluating multiview radiographs was 6.37 times more likely to demonstrate Vender stage 3 arthritis compared with single view (odds ratio = 6.37 [confidence interval, 3.81-10.64], P < .0001). Conclusion: Reviewing multiview radiographs more commonly yielded Vender stage 3 osteoarthritis classification. The decreased interrater reliability in the multiview analysis is likely related to the increased number of articular surfaces evaluated. Using a single PA view may underestimate the severity of arthritis present.

Determinants of Interrater Reliability of Job Analysis: A Meta-analysis

2002 ◽  
Vol 18 (1) ◽  
pp. 52-62 ◽  
Author(s):  
Olga F. Voskuijl ◽  
Tjarda van Sliedregt
Keyword(s):  
Data Collection ◽  
Interrater Reliability ◽  
Meta Analysis ◽  
Job Analysis ◽  
Job Descriptions ◽  
Job Description ◽  
Research And Practice ◽  
Descriptive Information ◽  
Interrater Reliability Coefficients ◽  
Reliability Coefficients

Summary: This paper presents a meta-analysis of published job analysis interrater reliability data in order to predict the expected levels of interrater reliability within specific combinations of moderators, such as rater source, experience of the rater, and type of job descriptive information. The overall mean interrater reliability of 91 reliability coefficients reported in the literature was .59. The results of experienced professionals (job analysts) showed the highest reliability coefficients (.76). The method of data collection (job contact versus job description) only affected the results of experienced job analysts. For this group higher interrater reliability coefficients were obtained for analyses based on job contact (.87) than for those based on job descriptions (.71). For other rater categories (e.g., students, organization members) neither the method of data collection nor training had a significant effect on the interrater reliability. Analyses based on scales with defined levels resulted in significantly higher interrater reliability coefficients than analyses based on scales with undefined levels. Behavior and job worth dimensions were rated more reliable (.62 and .60, respectively) than attributes and tasks (.49 and .29, respectively). Furthermore, the results indicated that if nonprofessional raters are used (e.g., incumbents or students), at least two to four raters are required to obtain a reliability coefficient of .80. These findings have implications for research and practice.

Interrater reliability of a method to assess hypothalamic involvement in pediatric adamantinomatous craniopharyngioma

2020 ◽  
Vol 25 (1) ◽  
pp. 37-42 ◽  
Author(s):  
Ros Whelan ◽  
Eric Prince ◽  
David M. Mirsky ◽  
Robert Naftel ◽  
Aashim Bhatia ◽  
...  
Keyword(s):  
Quality Of Life ◽  
Brain Tumors ◽  
Interrater Reliability ◽  
Statistical Evaluation ◽  
Grading System ◽  
Reliability Study ◽  
Postoperative Mri ◽  
Mri Scans ◽  
Adamantinomatous Craniopharyngioma

OBJECTIVEPediatric adamantinomatous craniopharyngiomas (ACPs) are histologically benign brain tumors that confer significant neuroendocrine morbidity. Previous studies have demonstrated that injury to the hypothalamus is associated with worsened quality of life and a shorter lifespan. This insight helps many surgeons define the goals of surgery for patients with ACP. Puget and colleagues proposed a 3-tiered preoperative and postoperative grading system based on the degree of hypothalamic involvement identified on MRI. In a prospective cohort from their institution, the authors found that use of the system to guide operative goals was associated with decreased morbidity. To date, however, the Puget system has not been externally validated. Here, the authors present an interrater reliability study that assesses the generalizability of this system for surgeons planning initial operative intervention for children with craniopharyngiomas.METHODSA panel of 6 experts, consisting of pediatric neurosurgeons and pediatric neuroradiologists, graded 30 preoperative and postoperative MRI scans according to the Puget system. Interrater reliability was calculated using Fleiss’ κ and Krippendorff’s α statistics.RESULTSInterrater reliability in the preoperative context demonstrated moderate agreement (κ = 0.50, α = 0.51). Interrater reliability in the postoperative context was 0.27 for both methods of statistical evaluation.CONCLUSIONSInterrater reliability for the system as defined is moderate. Slight refinements of the Puget MRI grading system, such as collapsing the 3 grades into 2, may improve its reliability, making the system more generalizable.

Characteristics Explaining Performance in Downhill Mountain Biking

2015 ◽  
Vol 10 (2) ◽  
pp. 183-190 ◽  
Author(s):  
Joel B. Chidley ◽  
Alexandra L. MacGregor ◽  
Caoimhe Martin ◽  
Calum A. Arthur ◽  
Jamie H. Macdonald
Keyword(s):  
Aerobic Capacity ◽  
Interrater Reliability ◽  
Ventilatory Threshold ◽  
Anaerobic Power ◽  
Important Variable ◽  
Mountain Biking ◽  
Reliability Study ◽  
Self Confidence ◽  
Group 2 ◽  
Specific Contribution

Purpose:To identify physiological, psychological, and skill characteristics that explain performance in downhill (DH) mountainbike racing.Methods:Four studies were used to (1) identify factors potentially contributing to DH performance (using an expert focus group), (2) develop and validate a measure of rider skill (using video analysis and expert judge evaluation), (3) evaluate whether physiological, psychological, and skill variables contribute to performance at a DH competition, and (4) test the specific contribution of aerobic capacity to DH performance.Results:Study 1 identified aerobic capacity, handgrip endurance, anaerobic power, rider skill, and self-confidence as potentially important for DH. In study 2 the rider-skill measure displayed good interrater reliability. Study 3 found that rider skill and handgrip endurance were significantly related to DH ride time (β = –0.76 and –0.14, respectively; R2 = .73), with exploratory analyses suggesting that DH ride time may also be influenced by self-confidence and aerobic capacity. Study 4 confirmed aerobic capacity as an important variable influencing DH performance (for a DH ride, mean oxygen uptake was 49 ± 5 mL · kg−1 · min−1, and 90% of the ride was completed above the 1st ventilatory threshold).Conclusions:In order of importance, rider skill, handgrip endurance, self-confidence, and aerobic capacity were identified as variables influencing DH performance. Practically, this study provides a novel assessment of rider skill that could be used by coaches to monitor training and identify talent. Novel intervention targets to enhance DH performance were also identified, including self-confidence and aerobic capacity.

Self-Managed Surveillance for Breast Cancer–Related Upper Body Issues: A Feasibility and Reliability Study

2020 ◽  
Vol 100 (3) ◽  
pp. 468-476 ◽  
Author(s):  
Bolette S Rafn ◽  
Chiara A Singh ◽  
Julie Midtgaard ◽  
Pat G Camp ◽  
Margaret L McNeely ◽  
...  
Keyword(s):  
Breast Cancer ◽  
Interrater Reliability ◽  
Physical Therapist ◽  
Retention Rates ◽  
Upper Body ◽  
Intrarater Reliability ◽  
Prospective Surveillance ◽  
Reliability Study ◽  
Shoulder Flexion ◽  
Arm Circumference

Abstract Background Early identification of breast cancer–related upper body issues is important to enable timely physical therapist treatment. Objective This study evaluated the feasibility and reliability of women performing self-managed prospective surveillance for upper body issues in the early postoperative phase as part of a hospital-based physical therapy program. Design This was a prospective, single-site, single-group feasibility and reliability study. Methods Presurgery arm circumference measurements were completed at home and at the hospital by participants and by a physical therapist. Instruction in self-measurement was provided using a video guide. After surgery, all circumference measurements were repeated along with self-assessment and therapist assessment for shoulder flexion and abduction active range of motion. Feasibility was determined by recruitment/retention rates and participant-reported ease of performing self-measurements (1 [very difficult] to 10 [very easy]). Reliability was determined as intrarater reliability, interrater reliability, and agreement. Results Thirty-three women who were 53.4 (SD = 11.4) years old participated, with recruitment and retention rates of 79% and 94%, respectively. Participant-reported ease of measurement was 8.2 (SD = 2.2) before surgery and 8.0 (SD = 1.9) after surgery. The intrarater reliability and interrater reliability were excellent before surgery (intraclass correlation coefficient [ICC] ≥ 0.94; 95% confidence interval = 0.87–0.97) and after surgery (ICC ≥ 0.91; 95% confidence interval = 0.76–0.96). Agreement between self-assessed and therapist-assessed active shoulder flexion (κ = 0.79) and abduction (κ = 0.71) was good. Limitations Further testing is needed using a prospective design with a longer follow-up to determine whether self-managed prospective surveillance and timely treatment can hinder the development of chronic breast cancer–related upper body issues Conclusions Self-measured arm circumference and shoulder range of motion are reliable, and their inclusion in a hospital-based program of prospective surveillance for upper body issues seems feasible. This approach may improve early detection and treatment

scholarly journals i-MANN: A Web-Based System for Data Management of Mental Health Research in India

2020 ◽  
Vol 42 (6_suppl) ◽  
pp. S15-S22
Author(s):  
Jasmine Kaur ◽  
Vijay C Verma ◽  
Vinit Kumar ◽  
Ravinder Singh ◽  
Triptish Bhatia ◽  
...  
Keyword(s):  
Mental Health ◽  
Data Collection ◽  
Health Assessment ◽  
Mental Health Program ◽  
Mental Health Research ◽  
Modular Architecture ◽  
District Health ◽  
Web Based ◽  
National Network ◽  
The Government

Background: National Mental Health Program (NMHP) was launched by the government with an aim to improve mental health of the society through precise and focused interventions and policies. In order to provide reliable data and evidence for NMHP, there is a strong requirement of a comprehensive system for integrative collection, storage, and analysis of data generated by this program. Methods: Data collection tools, questionnaires, instruments, and scales provided by the National Coordinating Unit were digitized using the District Health Information Software 2 (DHIS2) framework (version 2.30). The rules for data validation and automated scoring were implemented as per the scales. The developed system ( i-MANN, ICMR-Mental Health Assessment National Network) is based on modular architecture with role-based access to data input forms and dashboards. Results: The data are stored on a centralized server at ICMR. i-MANN captures data on basic and advanced demographic details followed by category specific forms from 15 multicentric ICMR-funded projects. Data collection module is divided into 12 categories containing 93 scales/instruments with built-in validation rules, scoring patterns, and indicators. As of August 2020, the system contains 17,690 records. Conclusions: i-MANN is the first web-based, modular, robust, and extendable system for collection, integration, management, and analysis of data on mental health in India.

Sign in / Sign up

Export Citation Format

Share Document