Home for Life Design (HFLD) Home Assessment Psychometric Study: Inter-Rater Reliability of a Home-Safety Assessment Tool

2019 ◽  
Vol 73 (4_Supplement_1) ◽  
pp. 7311500056p1
Author(s):  
Debra Lindstrom ◽  
Carolyn Sithong ◽  
Katherine Sullivan
2006 ◽  
Vol 4 (2) ◽  
pp. 181-196 ◽  
Author(s):  
Grace S. Fisher ◽  
Kristen Coolbaugh ◽  
Christin Rhodes

After reviewing the literature on environmental safety and existing home safety evaluation tools, the researchers developed the Cougar Home Safety Assessment Version 1.0 (Cougar 1.0). This assessment is a 56-item tool for identifying environmental safety hazards in the homes of older persons. The first purpose of this study was to develop and field test the Cougar 1.0 to determine its inter-rater reliability and validity. The second purpose was to identify specific environmental safety hazards in the residences of older persons during the field test. Three graduate occupational therapy students administered the Cougar 1.0 in the homes of 14 older persons within one county of northeastern Pennsylvania. The instrument was found to have a moderate level of inter-rater reliability, as Cohen’s Kappa for the ratings of the 3 raters was .506. Percent agreement between the three raters was 90 percent. The field test found that the most frequently unsafe aspects of the homes were: a lack of grab bars near toilets; no emergency numbers posted near phones; the presence of non-grip throw rugs; lack of fire extinguishers; and lack of step stools. Participating residents and occupational therapy home safety specialists provided positive feedback regarding the content validity of the Cougar 1.0. This research suggests that the use of this instrument by occupational therapists may prevent client injuries in the home.


2020 ◽  
Vol 15 ◽  
Author(s):  
Dixon Thomas ◽  
Sherief Khalifa ◽  
Jayadevan Sreedharan ◽  
Rucha Bond

Background:: Clinical competence of pharmacy students is better evaluated at their practice sites. compared to the classroom. A clinical pharmacy competency evaluation rubric like that of the American College of Clinical Pharmacy (ACCP)is an effective assessment tool for clinical skills and can be used to show item reliability. The preceptors should be trained on how to use the rubrics as many inherent factors could influence inter-rater reliability. Objective:: To evaluate inter-rater reliability among preceptors on evaluating clinical competence of pharmacy students, before and after a group discussion intervention. Methods:: In this quasi experimental study in a United Arab Emirates teaching hospital, Seven clinical pharmacy preceptors rated clinical pharmacy competencies of ten recent PharmD graduates referring to their portfolios and preceptorship. Clinical pharmacy competencies were adopted from ACCP and mildly modified to be relevant for the local settings. Results:: Inter-rater reliability (Cronbach's Alpha) among preceptors was reasonable being practitioners at a single site for 2-4 years. At domain level, inter-rater reliability ranged from 0.79 - 0.93 before intervention and 0.94 - 0.99 after intervention. No inter-rater reliability was observed in relation to certain competency elements ranging from 0.31 – 0.61 before intervention, but improved to 0.79 – 0.97 after intervention. Intra-class correlation coefficient improved among all individual preceptors being reliable with each other after group discussion though some had no reliability with each other before group discussion. Conclusion:: Group discussion among preceptors at the training site was found to be effective in improving inter-rater reliability on all elements of the clinical pharmacy competency evaluation. Removing a preceptor from analysis did not affect inter-rater reliability after group discussion.


2008 ◽  
Vol 30 (8) ◽  
pp. 815-817 ◽  
Author(s):  
Renuka Tunuguntla ◽  
Osvaldo Rodriguez ◽  
Jorge G. Ruiz ◽  
Syeda S. Qadri ◽  
Michael J. Mintzer ◽  
...  

2015 ◽  
Vol 13 (5) ◽  
pp. 42-46 ◽  
Author(s):  
Patricia Evans ◽  
Brigitte Collins ◽  
Lorraine O'Brien ◽  
Elissa Bradshaw ◽  
Anna Swatton ◽  
...  

Burns ◽  
2016 ◽  
Vol 42 (2) ◽  
pp. 336-344 ◽  
Author(s):  
Matthew Fell ◽  
Jill Meirte ◽  
Mieke Anthonissen ◽  
Koen Maertens ◽  
Jonathon Pleat ◽  
...  

2020 ◽  
pp. 070674372096644
Author(s):  
Stéphane Raffard ◽  
Cindy Lebrun ◽  
Yasmine Laraki ◽  
Delphine Capdevielle

Background: Assessing an individual’s capacity to consent to treatment is a complex and challenging task for psychiatrists and health-care professionals. Diminished capacity to consent to pharmacological treatment is a common concern in individuals with schizophrenia. The MacArthur Competence Assessment Tool for Treatment (MacCAT-T) is the most common tool used in individuals with schizophrenia to evaluate the decision-making abilities for judgments about competence to consent to treatment. This instrument assesses patients’ competence to make treatment decisions by examining their capacities in 4 areas: understanding information relevant to their condition and the recommended treatment, reasoning about the potential risks and benefits of their choices, appreciating the nature of their situation and the consequences of their choices, and expressing a choice. Despite its importance, there is no French version of this scale. Furthermore, its factor structure has never been explored, although validated measures are strongly needed to further detect deficits in patients’ decision-making abilities. The goal of this study was thus to empirically validate a French version of the MacCAT-T in a French sample of individuals with schizophrenia. Method: In this cross-sectional study, we included 125 inpatients with a diagnosis of schizophrenia from the University Department of Adult Psychiatry in Montpellier. The MacCAT-T was administered to patients by a trained psychologist. Patients were also assessed for severity of symptoms, insight into illness, and depressive and anxiety symptoms. Inter-rater reliability and psychometric properties including internal consistency, construct validity, and discriminant and divergent validity were also investigated. Results: The MacCAT-T’s internal consistency was high (Cronbach α of 0.91). A high degree of inter-rater reliability was found for all the areas of the MacCAT-T (intraclass correlation coefficient range, 0.92 to 0.98). Exploratory factor analysis revealed a 2-factor model. The factor analysis explained 50.03% of the total score variation. Component 1 included all subparts of “understanding.” Component 2 included all subparts of “appreciation” and “reasoning” and was therefore labeled “reflexivity.” After Bonferroni corrections, decision-making capacity was positively associated with insight and the severity of psychotic symptoms but not with sociodemographic variables except for education. Conclusions: The MacCAT-T demonstrated a high degree of inter-rater reliability and strong psychometric properties. The French version of the MacCAT-T is a valid instrument to assess the decision-making capacity to consent to treatment in a French sample of individuals with schizophrenia.


Sign in / Sign up

Export Citation Format

Share Document