Inter-rater reliability and face validity of the Executive Function Performance Test (EFPT)

2015 ◽  
Vol 78 (9) ◽  
pp. 563-569
Author(s):  
Marie Cederfeldt ◽  
Gunnel Carlsson ◽  
Synneve Dahlin–Ivanoff ◽  
Gunilla Gosman–Hedstrom
Keyword(s):  
Executive Function ◽  
Performance Test ◽  
Face Validity ◽  
Rater Reliability

scholarly journals The I-DECIDED clinical decision-making tool for peripheral intravenous catheter assessment and safe removal: a clinimetric evaluation

BMJ Open ◽  
2020 ◽  
Vol 10 (1) ◽  
pp. e035239 ◽  
Author(s):  
Gillian Ray-Barruel ◽  
Marie Cooke ◽  
Vineet Chopra ◽  
Marion Mitchell ◽  
Claire M Rickard
Keyword(s):  
Decision Making ◽  
Vascular Access ◽  
Content Validity ◽  
Online Survey ◽  
Clinical Decision Making ◽  
Decision Time ◽  
Face Validity ◽  
Intravenous Catheter ◽  
Rater Reliability ◽  
Peripheral Intravenous Catheter

ObjectiveTo describe the clinimetric validation of the I-DECIDED tool for peripheral intravenous catheter assessment and decision-making.Design and settingI-DECIDED is an eight-step tool derived from international vascular access guidelines into a structured mnemonic for device assessment and decision-making. The clinimetric evaluation process was conducted in three distinct phases.MethodsInitial face validity was confirmed with a vascular access working group. Next, content validity testing was conducted via online survey with vascular access experts and clinicians from Australia, the UK, the USA and Canada. Finally, inter-rater reliability was conducted between 34 pairs of assessors for a total of 68 peripheral intravenous catheter (PIVC) assessments. Assessments were timed to ensure feasibility, and the second rater was blinded to the first’s findings. Content validity index (CVI), mean item-level CVI (I-CVI), internal consistency, mean proportion of agreement, observed and expected inter-rater agreements, and prevalence-adjusted bias-adjusted kappas (PABAK) were calculated. Ethics approvals were obtained from university and hospital ethics committees.ResultsThe I-DECIDED tool demonstrated strong content validity among international vascular access experts (n=7; mean I-CVI=0.91; mean proportion of agreement=0.91) and clinicians (n=11; mean I-CVI=0.93; mean proportion of agreement=0.94), and high inter-rater reliability in seven adult medical-surgical wards of three Australian hospitals. Overall, inter-rater reliability was 87.13%, with PABAK for each principle ranging from 0.5882 (‘patient education’) to 1.0000 (‘document the decision’). Time to complete assessments averaged 2 min, and nurse-reported acceptability was high.ConclusionThis is the first comprehensive, evidence-based, valid and reliable PIVC assessment and decision tool. We recommend studies to evaluate the outcome of implementing this tool in clinical practice.Trial registration number12617000067370

The Adult Attachment Projective Picture System: a pilot study of inter-rater reliability and face validity with adults with intellectual disabilities

2018 ◽  
Vol 12 (2) ◽  
pp. 57-66 ◽  
Author(s):  
Deanna Gallichan ◽  
Carol George
Keyword(s):  
Intellectual Disabilities ◽  
Adult Attachment ◽  
Clinical Utility ◽  
Reliability And Validity ◽  
Clinical History ◽  
Face Validity ◽  
Rater Reliability ◽  
Content Type ◽  
Adult Attachment Projective ◽  
Adults With Intellectual Disabilities

Purpose The purpose of this paper is to assess whether the Adult Attachment Projective (AAP) Picture System is a reliable and face valid measure of internal working models of attachment in adults with intellectual disabilities (ID). Design/methodology/approach The AAPs of 20 adults with ID were coded blind by two reliable judges and classified into one of four groups: secure, dismissing, preoccupied, or unresolved. Inter-rater reliability was calculated using κ. Six participants repeated the assessment for test-retest reliability. Two independent experts rated ten cases on the links between the AAP analysis and the clinical history. Findings There was significant agreement between AAP judges, κ=0.677, p<0.001. Five out of six participants showed stability in their classifications over time. The majority of expert ratings were “good” or “excellent”. There was a significant inter-class correlation between raters suggesting good agreement between them r=0.51 (p<0.05). The raters’ feedback suggested that the AAP had good clinical utility. Research limitations/implications The inter-rater reliability, stability, face validity, and clinical utility of the AAP in this population is promising. Further examination of these findings with a larger sample of individuals with ID is needed. Originality/value This is the first study attempting to investigate the reliability and validity of the AAP in this population.

scholarly journals Assessing the Validity and Reliability of the Persian Version of the Interpersonal Problem Solving Skills Assessment Tool in Schizophrenia

2021 ◽  
Vol 22 (1) ◽  
pp. 118-131
Author(s):  
Milad Abolhasani ◽  
◽  
Ashraf Karbalaee Nouri ◽  
Enayatollah Bakhshi ◽  
Milad Abolhasani ◽  
...  
Keyword(s):  
Content Validity ◽  
Face Validity ◽  
Validity And Reliability ◽  
Alpha Coefficient ◽  
Rater Reliability ◽  
Problem Solving Skills ◽  
Retest Reliability ◽  
Persian Version ◽  
Interpersonal Problem Solving ◽  
Test Retest Reliability

Objective: This study aimed to translate the Assessment of Interpersonal Problem-Solving Skills (AIPSS) into Persian and to evaluate the validity and reliability of the Persian version of AIPSS to use for adults with schizophrenia. Materials & Methods: In this methodological study, the translation process was performed according to the International Quality of Life Assessment (IQOLA) protocol. The face validity of the translated AIPSS was determined based on the opinions of experts and The Content Validity Index (CVI) and Content Validity Ratio (CVR) were also calculated for each item. The Persian version of the test was performed on 52 patients with schizophrenia disorders at Tehran’s Razi Mental Hospital; they were selected using a convenience sampling method. Cronbach’s alpha coefficient was used to evaluate internal consistency. Inter-rater reliability was determined by the Intraclass Correlation Coefficient (ICC). A retest was complete on 15 patients with 2 weeks interval and ICC was used to determine the test-retest reliability. Results: Face validity was confirmed by the experts’ opinions. The Content Validity Ratio (CVR) and the Content Validity Index (CVI) were equal to one for all scenes. Cronbach's alpha coefficient for all scales was ranged between 0.511 and 0.821. The ICC in all scales were more than 0.98 for inter-rater reliability. In calculating test-retest reliability, the ICC for all scales ranged 0.733-0.893. Conclusion: Results show that the Persian version of AIPSS has acceptable face validity, content validity, internal consistency, inter-rater reliability test-retest reliability. Therefore, this instrument can be used in clinical fields and research studies to assess the social skills of Iranian patients with schizophrenia.

Executive Function Performance Test--Internet-Based Tasks

2018 ◽  
Author(s):  
Debbie Rand ◽  
Keren Lee Ben-Haim ◽  
Rachel Malka ◽  
Sigal Portnoy
Keyword(s):  
Executive Function ◽  
Performance Test
Sign in / Sign up

Export Citation Format

Share Document