Determining the content validity, inter-rater reliability and usability of the Novita Switch Record Form

2016 ◽  
Vol 28 (1,2) ◽  
pp. 1-11 ◽  
Author(s):  
Grace Hoppenbrouwers ◽  
Hugh Stewart ◽  
Jocelyn Kernot
Keyword(s):  
Content Validity ◽  
Rater Reliability

scholarly journals The I-DECIDED clinical decision-making tool for peripheral intravenous catheter assessment and safe removal: a clinimetric evaluation

BMJ Open ◽  
2020 ◽  
Vol 10 (1) ◽  
pp. e035239 ◽  
Author(s):  
Gillian Ray-Barruel ◽  
Marie Cooke ◽  
Vineet Chopra ◽  
Marion Mitchell ◽  
Claire M Rickard
Keyword(s):  
Decision Making ◽  
Vascular Access ◽  
Content Validity ◽  
Online Survey ◽  
Clinical Decision Making ◽  
Decision Time ◽  
Face Validity ◽  
Intravenous Catheter ◽  
Rater Reliability ◽  
Peripheral Intravenous Catheter

ObjectiveTo describe the clinimetric validation of the I-DECIDED tool for peripheral intravenous catheter assessment and decision-making.Design and settingI-DECIDED is an eight-step tool derived from international vascular access guidelines into a structured mnemonic for device assessment and decision-making. The clinimetric evaluation process was conducted in three distinct phases.MethodsInitial face validity was confirmed with a vascular access working group. Next, content validity testing was conducted via online survey with vascular access experts and clinicians from Australia, the UK, the USA and Canada. Finally, inter-rater reliability was conducted between 34 pairs of assessors for a total of 68 peripheral intravenous catheter (PIVC) assessments. Assessments were timed to ensure feasibility, and the second rater was blinded to the first’s findings. Content validity index (CVI), mean item-level CVI (I-CVI), internal consistency, mean proportion of agreement, observed and expected inter-rater agreements, and prevalence-adjusted bias-adjusted kappas (PABAK) were calculated. Ethics approvals were obtained from university and hospital ethics committees.ResultsThe I-DECIDED tool demonstrated strong content validity among international vascular access experts (n=7; mean I-CVI=0.91; mean proportion of agreement=0.91) and clinicians (n=11; mean I-CVI=0.93; mean proportion of agreement=0.94), and high inter-rater reliability in seven adult medical-surgical wards of three Australian hospitals. Overall, inter-rater reliability was 87.13%, with PABAK for each principle ranging from 0.5882 (‘patient education’) to 1.0000 (‘document the decision’). Time to complete assessments averaged 2 min, and nurse-reported acceptability was high.ConclusionThis is the first comprehensive, evidence-based, valid and reliable PIVC assessment and decision tool. We recommend studies to evaluate the outcome of implementing this tool in clinical practice.Trial registration number12617000067370

scholarly journals Psychometric evaluation of the Work Readiness Questionnaire in schizophrenia

CNS Spectrums ◽  
2014 ◽  
Vol 21 (2) ◽  
pp. 199-206 ◽  
Author(s):  
Steven G. Potkin ◽  
Dragana Bugarski-Kirola ◽  
Chris J. Edgar ◽  
Sherif Soliman ◽  
Stephanie Le Scouiller ◽  
...  
Keyword(s):  
Content Validity ◽  
Negative Symptoms ◽  
Assessment Tool ◽  
Symptom Control ◽  
Cultural Influences ◽  
Therapeutic Interventions ◽  
Work Readiness ◽  
Rater Reliability ◽  
Predictive Values ◽  
Supported Work

Objective/IntroductionUnemployment can negatively impact quality of life among patients with schizophrenia. Employment status depends on ability, opportunity, education, and cultural influences. A clinician-rated scale of work readiness, independent of current work status, can be a valuable assessment tool. A series of studies were conducted to create and validate a Work Readiness Questionnaire (WoRQ) for clinicians to assess patient ability to engage in socially useful activity, independent of work availability.MethodsContent validity, test–retest and inter-rater reliability, and construct validity were evaluated in three separate studies.ResultsContent validity was supported. Cronbach’s α was 0.91, in the excellent range. Clinicians endorsed WoRQ concepts, including treatment adherence, physical appearance, social competence, and symptom control. The final readiness decision showed good test–retest reliability and moderate inter-rater reliability. Work readiness was associated with higher function and lower levels of negative symptoms. Low positive and high negative predictive values confirmed the concept validity.DiscussionThe WoRQ has suitable psychometric properties for use in a clinical trial for patients with a broad range of symptom severity. The scale may be applicable to assess therapeutic interventions. It is not intended to assess eligibility for supported work interventions.ConclusionsThe WoRQ is suitable for use in schizophrenia clinical trials to assess patient work functional potential.

scholarly journals Validitas dan Reliabilitas Ujian SOCA (Students Oral Case Analysis): Studi di Salah Satu Fakultas Kedokteran di Indonesia

2016 ◽  
Vol 5 (3) ◽  
pp. 148
Author(s):  
Rizka Aries Putranti ◽  
Ova Emilia ◽  
Efrayim Suryadi
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Content Validity ◽  
Cognitive Complexity ◽  
Case Analysis ◽  
Medical Faculty ◽  
Validity And Reliability ◽  
Rater Reliability ◽  
Significant Difference ◽  
Kappa Value

Background: Medical faculty has to make sure that the students meet the minimal competence needed using apropriate exam. While the exam itself should facilitate students to learn. Oral examination has known for its ability to facilitate students learn but low in validity and reliability. Medical faculty of Lampung University (FK Unila) apply the student oral case analysis (SOCA) exam as one of block assessment component, as with MCQ, tutorial, and laboratory exam. This study aimed to evaluate validity and reliability of SOCA examination at FK UnilaMethod: Video of 65 students doing SOCA examination and 28 question rubrics had taken when odd semester exam year 2014-2015 has been carying out at FK Unila. Video and question rubrics were assessed by 5 panelis and analysed using Lawshe's content validity ratio (CVR) to determinate its content validity. Students performance on the video were re-assessed by another assessor to see inter-rater reliability, than analysed using kappa Cohen. Two expert in medical education assessed the cognitive comlpexity of the question rubrics. Data of SOCA's student's mark from year II, III, and IV were analysed for construct valdity and internal consistency.Results: 93,7% of the overall question in 65 video were valid (CVR>99%) and 71,8% question number in 28 question rubrics also valid according to 5 panelis. SOCA cognitive complexity were at level of analyse, know how and 4a. Inter-rater reliability analysis showed 0,549 (moderate agreement) kappa value. Mann Whitney analysis for construct validity showed no significant difference of all year. Cronbach alpha analysis showed internal consistency at the point 0,575.Conclusion: FK Unila's SOCA of odd semester examination year 2014-2015 has sufficient content validity, sufficient cognitive complexity and sufficent inter-rater reliability but lack in construct validity and internal consistency. Keywords: SOCA, validity, reliability

scholarly journals Assessing the Validity and Reliability of the Persian Version of the Interpersonal Problem Solving Skills Assessment Tool in Schizophrenia

2021 ◽  
Vol 22 (1) ◽  
pp. 118-131
Author(s):  
Milad Abolhasani ◽  
◽  
Ashraf Karbalaee Nouri ◽  
Enayatollah Bakhshi ◽  
Milad Abolhasani ◽  
...  
Keyword(s):  
Content Validity ◽  
Face Validity ◽  
Validity And Reliability ◽  
Alpha Coefficient ◽  
Rater Reliability ◽  
Problem Solving Skills ◽  
Retest Reliability ◽  
Persian Version ◽  
Interpersonal Problem Solving ◽  
Test Retest Reliability

Objective: This study aimed to translate the Assessment of Interpersonal Problem-Solving Skills (AIPSS) into Persian and to evaluate the validity and reliability of the Persian version of AIPSS to use for adults with schizophrenia. Materials & Methods: In this methodological study, the translation process was performed according to the International Quality of Life Assessment (IQOLA) protocol. The face validity of the translated AIPSS was determined based on the opinions of experts and The Content Validity Index (CVI) and Content Validity Ratio (CVR) were also calculated for each item. The Persian version of the test was performed on 52 patients with schizophrenia disorders at Tehran’s Razi Mental Hospital; they were selected using a convenience sampling method. Cronbach’s alpha coefficient was used to evaluate internal consistency. Inter-rater reliability was determined by the Intraclass Correlation Coefficient (ICC). A retest was complete on 15 patients with 2 weeks interval and ICC was used to determine the test-retest reliability. Results: Face validity was confirmed by the experts’ opinions. The Content Validity Ratio (CVR) and the Content Validity Index (CVI) were equal to one for all scenes. Cronbach's alpha coefficient for all scales was ranged between 0.511 and 0.821. The ICC in all scales were more than 0.98 for inter-rater reliability. In calculating test-retest reliability, the ICC for all scales ranged 0.733-0.893. Conclusion: Results show that the Persian version of AIPSS has acceptable face validity, content validity, internal consistency, inter-rater reliability test-retest reliability. Therefore, this instrument can be used in clinical fields and research studies to assess the social skills of Iranian patients with schizophrenia.

scholarly journals Validity and Reliability Assessment Tool of Nursing Students Professional Behavior

Jurnal NERS ◽  
2015 ◽  
Vol 10 (2) ◽  
pp. 208
Author(s):  
Fatikhu Yatuni Asmara
Keyword(s):  
Nursing Students ◽  
Construct Validity ◽  
Content Validity ◽  
Assessment Tool ◽  
Reliability Assessment ◽  
Reliability Test ◽  
Validity And Reliability ◽  
Professional Behaviour ◽  
Rater Reliability ◽  
Validity Test

Introduction: Shieffield Peer Review Assessment (SPRAT) is an instrument to assess medical student’s performance using Multi Source Feedback (MSF) method. The previous study stated that MSF with SPRAT is an effective tool assessing professional behaviour (PB) of nursing students both in clinical setting and community setting. However it needs more items to be added. Based on that explanation, it needs conducting validity and reliability test to make sure that the tool is valid and reliable. Method: There were two types of validity test used, content validity test and construct validity test as well as reliability test, namely inter-rater reliability test and item covariance test. Participants were four clinical instructors and 116 nursing students. Result: Content validity test showed that two items must be added as part of assessment item, namely diciplines and faithness. Furthermore construct validity test showed that five items were not valid since they had pearson correlation score <0.3. However the items were included as consideration of nursing students’s PB. Inter-rater reliability test and item covariance reliability test showed that the tool was reliable with score 0.460 and 0.912 respectively. Discussion: The assessment tool can be applied to assess PB of nursing students since it valid and reliable. It needs to investigate the effectiveness of the tool in difference of PB of nursing students.Keywords: validity, reliability, assessment tool of PB (professional behaviour)

A Screening Tool for Patients With Lumbar Instability: A Content Validity and Rater Reliability of Thai Version

2020 ◽  
Vol 43 (5) ◽  
pp. 515-520
Author(s):  
Thiwaphon Chatprem ◽  
Rungthip Puntumetakul ◽  
Wantanee Yodchaisarn ◽  
Wantana Siritaratiwat ◽  
Rose Boucaut ◽  
...  
Keyword(s):  
Content Validity ◽  
Screening Tool ◽  
Rater Reliability ◽  
Lumbar Instability

scholarly journals Development and reliability of the Korean version of the Feeding Abilities Assessment

2019 ◽  
Vol 32 (1) ◽  
pp. 69-74
Author(s):  
Seul Gi Koo ◽  
Hae Yean Park ◽  
Jongbae Kim ◽  
Areum Han
Keyword(s):  
Correlation Coefficient ◽  
Internal Consistency ◽  
Content Validity ◽  
Assessment Tool ◽  
High Reliability ◽  
Intraclass Correlation ◽  
Rater Reliability ◽  
Retest Reliability ◽  
Korean Version ◽  
Test Retest Reliability

Objective The purpose of this study is to introduce a standardised assessment tool by verifying the reliability of the translated Korean version of the Feeding Abilities Assessment (K-FAA), which was developed to suit Korean culture. Methods The research subjects were 65 patients with dementia living in nursing homes. The K-FAA was completed by verifying the suitability of translation and reverse translation. The validity of the K-FAA was established through content validity, while its reliability was analysed based on internal consistency reliability for the items, test–retest reliability and inter-rater reliability. Results The content validity index determined, based on the assessment of professors, occupational therapists, and nurses, was more than .70. Cronbach’s α was more than .929, showing good internal consistency. A test–retest reliability of .884 was derived using Pearson’s correlation coefficient (p < .01), and an inter-rater reliability of .800 was derived using the kappa coefficients; intraclass correlation coefficient was .897, which also indicated good reliability. Conclusion The K-FAA was modified to fit the Korean domestic situation, and this assessment had high reliability. Therefore, K-FAA can evaluate the feeding ability of patients with dementia. Future studies should focus on providing evidence-based data to maintain or supplement the feeding ability of patients with dementia in Korea.

Sign in / Sign up

Export Citation Format

Share Document