Development of the Preceptor Self-Assessment Tool and Use of the Content Validity Index

2020 ◽  
Vol 51 (10) ◽  
pp. 469-476
Author(s):  
Kristine M. L'Ecuyer ◽  
Divya S. Subramaniam ◽  
Chuntana Reangsing
Author(s):  
Piyapong Sirinapakul ◽  
Naesinee Chaiear ◽  
Phanumas Krisorn

The Modified Self-Assessment (MSA) and Present Self-Assessment (PSA) forms are questionnaires used to prioritize the risk of infection of health workers exposed to tuberculosis (TB) in Srinagarind Hospital in Thailand. As MSA was developed from PSA, the validity and reliability of MSA need to be assessed. The research aim is to examine the content validity of MSA and to assess the respective reliability of MSA and PSA vis-à-vis expert opinion. Seven experts determined the content validity index (CVI) of MSA. MSA and PSA were used to prioritize the TB contact of 108 subjects, and we compared the result with the risk assessed by the experts. The respective Kappa agreements between MSA and PSA and the experts were used to assess reliability. The result of the content validity index revealed that MSA had I-CVI > 0.83 for all questions and an S-CVI/Ave above 0.90 for all factors. The Kappa agreement of contact priority between MSA and the experts was 0.80; it was 0.58 between PSA and the experts. MSA can, thus, be used to prioritize contact with tuberculosis in Srinagarind Hospital. MSA is a valid risk communication tool for aerosol-generating procedures. Further study should be conducted in other hospitals, and the number of participants should be increased in order to come to a concrete result.


BMJ Open ◽  
2021 ◽  
Vol 11 (4) ◽  
pp. e045550
Author(s):  
Zhigang Zhang ◽  
Guoqiang Wang ◽  
Yuchen Wu ◽  
Jin Guo ◽  
Nannan Ding ◽  
...  

PurposeTo translate and adapt the Chelsea Critical Care Physical Assessment Tool (CPAx) into Chinese version (‘CPAx-Chi’), test the reliability and validity of CPAx-Chi, and verify the cut-off point for the diagnosis of intensive care unit-acquired weakness (ICU-AW).Study designCross-sectional observational study.MethodsForward and back translation, cross-cultural adaptation and pretesting of CPAx into CPAx-Chi were based on the Brislin model. Participants were recruited from the general ICU of five third-grade class-A hospitals in western China. Two hundred critically ill adult patients (median age: 53 years; 64% men) with duration of ICU stay ≥48 hours and Glasgow Coma Scale ≥11 were included in this study. Two researchers simultaneously and independently assessed eligible patients using the Medical Research Council Muscle Score (MRC-Score) and CPAx-Chi.ResultsThe content validity index of items was 0.889. The content validity index of scale was 0.955. Taking the MRC-Score scale as standard, the criterion validity of CPAx-Chi was r=0.758 (p<0.001) for researcher A, and r=0.65 (p<0.001) for researcher B. Cronbach’s α was 0.939. The inter-rater reliability was 0.902 (p<0.001). The area under the receiver operating characteristic curves of CPAx-Chi for diagnosing ICU-AW based on MRC-Score ≤48 were 0.899 (95% CI 0.862 to 1.025) and 0.874 (95% CI 0.824 to 0.925) for researcher B. The best cut-off point for CPAx-Chi for the diagnosis of ICU-AW was 31.5. The sensitivity was 87% and specificity was 77% for researcher A, whereas it was 0.621, 31.5, 75% and 87% for researcher B, respectively. The consistency was high when taking CPAx-Chi ≤31 and MRC-Score ≤48 as the cut-off points for the diagnosis of ICU-AW. Cohen’s kappa=0.845 (p=0.02) in researcher A and 0.839 (p=0.04) for researcher B.ConclusionsCPAx-Chi demonstrated content validity, criterion-related validity and reliability. CPAx-Chi showed the best accuracy in assessment of patients at risk of ICU-AW with good sensitivity and specificity at a recommended cut-off of 31.


2018 ◽  
Vol 26 (2) ◽  
pp. 398-410 ◽  
Author(s):  
Andrea Egger-Rainer

Background and Purpose:The Epilepsy Monitoring Unit Comfort Questionnaire (EMUCQ) is a self-assessment instrument to measure perceived patient comfort during hospitalization in an EMU. This study aimed at initially determining the content validity by rating the content validity index (CVI).Methods:Nine experts judged the 60-item EMUCQ-1 by filling out a content validation form. The CVI was computed on item (I-CVI) and at an average scale (S-CVI/Ave) level.Results:As many as 26 items remained unchanged and 12 items were reworded to prepare the 38-item EMUCQ-2 (I-CVI scores ≥ .78). Fourteen items were omitted and an additional eight items were put aside for further evaluation. The S-CVI/Ave reached .90.Conclusion:The first results indicate the EMUCQ-2 to be valid in terms of content. Further assessment by members of the target population is advisable.


2016 ◽  
Vol 14 (2) ◽  
pp. 158-177 ◽  
Author(s):  
Rhaine Borges Santos Pedreira ◽  
Saulo Vasconcelos Rocha ◽  
Clarice Alves dos Santos ◽  
Lélia Renata Carneiro Vasconcelos ◽  
Martha Cerqueira Reis

ABSTRACT Objective Assess the content validity of the Elderly Health Assessment Tool with low education. Methods The data collection instrument/questionnaire was prepared and submitted to an expert panel comprising four healthcare professionals experienced in research on epidemiology of aging. The experts were allowed to suggest item inclusion/exclusion and were asked to rate the ability of individual items in questionnaire blocks to encompass target dimensions as “not valid”, “somewhat valid” or “valid”, using an interval scale. Percent agreement and the Content Validity Index were used as measurements of inter-rater agreement; the minimum acceptable inter-rater agreement was set at 80%. Results The mean instrument percent agreement rate was 86%, ranging from 63 to 99%, and from 50 to 100% between and within blocks respectively. The Mean Content Validity Index score was 93.47%, ranging from 50 to 100% between individual items. Conclusion The instrument showed acceptable psychometric properties for application in geriatric populations with low levels of education. It enabled identifying diseases and assisted in choice of strategies related to health of the elderly.


2020 ◽  
Vol 11 (4) ◽  
pp. 62
Author(s):  
Oliva Bazirete ◽  
Manassé Nzayirambaho ◽  
Aline Umubyeyi ◽  
Marie Chantal Uwimana ◽  
Evans Marilyn

Background: Postpartum hemorrhage remains the main cause of maternal mortality in Low and Middle Income Countries. There is a need to advocate for extra vigilance to recognize women at a greater risk and implement early intervention for Postpartum hemorrhage prevention. The purpose of the present study is to develop a content validated risk assessment tool for the prediction and prevention of Postpartum hemorrhage among childbearing women.Methods: This study is drawn from a larger mixed method sequential exploratory study. Factors influencing the prevention of Postpartum hemorrhage were identified from a scoping review and qualitative descriptive studies previously conducted. To establish content validity Index of the instrument, content experts assessed each item of the tool for comprehensiveness, relevance, and face validity. The tool was pilot tested to assess its clinical utility by fifteen (15) health care providers purposively selected from one district hospital based on a minimum of one-year experience in maternity. Ethical considerations were observed.Results: The Risk Assessment Tool went through three rounds of assessment for its content validity. The final round of quantification of the content validity demonstrates that 4 items out of 46 had an Item Content Validity Index (I-CVI) of 0.85 while 42 had the maximum I-CVI of 1. The overall Scale Content Validity Index/ Average (S-CVI/Ave) was 0.98, and the universal approach of Scale Content Validity Index/Universal Agreement (S-CVI/UA) was 0.91. The assessment of clinical utility of Risk Assessment Tool for the Prediction and Prevention of Postpartum hemorrhage among Childbearing women (RATP) demonstrates that its format allows easy recording of findings and using the tool can be an added value for prevention of PPH.Conclusions: The risk assessment tool for the prediction and prevention of Postpartum hemorrhage is intended to be used by health care providers in Rwanda to identify mothers at risk of developing PPH and implement timely prevention strategies. The clinical use of the tool can be vital in the development of accurate preventive approaches by key policy makers in Rwanda in particular and in other developing countries.


Author(s):  
Maria Carmen Martinez ◽  
Viviane Ernesto Iwamoto ◽  
Maria do Rosário Dias de Oliveira Latorre ◽  
Adriana Moreira Noronha ◽  
Ana Paula de Sousa Oliveira ◽  
...  

ABSTRACT Objective: to perform the transcultural adaptation and content validity analysis of the Johns Hopkins Fall Risk Assessment Tool to assess both fall risk and fall-related injury risk for hospitalized elderly in Brazil. Method: the transcultural adaptation consisted of translating the scale to Portuguese (Brazil), back-translating it into its language of origin, establishing a consensus version, and having an expert committee verify its transcultural equivalence. Content assessment was conducted by a committee of judges, ending with the calculation of the items and scales' content validity index. Nurses tested the tool. Results: the scale's translated version went through two evaluation rounds by the judges, based on which, the items with unsatisfactory performance were changed. The content validity index for the items was ≥80.0% and the global index 97.1%. The experimental application showed the scale is user-friendly. Conclusion: the scale presents valid content for the assessment of fall risk and risk of fall-related injuries and is easy to use, with the potential to contribute to the proper identification of risks and the establishment of care actions.


2021 ◽  
pp. 1522-1528
Author(s):  
Abdul-Rahman Jazieh ◽  
Hoda Jradi ◽  
Omar B. Da'ar ◽  
Mohammad Alkaiyat ◽  
Yousuf Zafar ◽  
...  

PURPOSE The social impact of cancer on patients and their family is well known. Yet, unlike with physical and financial toxicities, no validated tools are available to measure this impact. This study aimed at developing, validating, and implementing a novel social toxicity assessment tool for patients with cancer diagnosis (STAT-C). METHODS Questions were generated through multiple steps including focus groups of patients, their families, and oncology care professionals. These steps along with relevant literature resulted in the development of an initial 20-item questionnaire. Content validity and relevance of the tool were assessed using Content Validity Index for individual items and Content Validity Index for the entire scale. Following expert examination, the constructed STAT-C tool consisted of 14 items grouped into three domains—social relations, social activities, and economic impact. Based on the total possible score for the survey in 150 patients for all the items, three levels of a socioeconomic toxicity were determined—severe social toxicity, mild social toxicity, and no social toxicity. RESULTS The 14 items were marked as relevant, and the Content Validity Index for individual items ranged between 0.80 and 1.00. An overall average Content Validity Index for the entire scale of 0.87 showed high content validity of the constructed tool. Exploratory factor analysis revealed retention of 13 items of the constructed STAT-C Tool, which loaded across three factors that mapped groupings into measures of social relations, social activities, and economic impact domains. CONCLUSION Our study revealed that STAT-C is a valid, reliable tool, and well captures and measures unique and pertinent social toxicity constructs for Arabic-speaking patients. The tool should enable oncology professionals to deliver better patient-centered care as a component of a comprehensive approach.


2020 ◽  
Vol 19 (3) ◽  
pp. 269-274 ◽  
Author(s):  
İsmail Toygar ◽  
Sadık Hançerlioğlu ◽  
Selden Gül ◽  
Tülün Utku ◽  
Ilgın Yıldırım Şimşir ◽  
...  

The purpose of this study was to evaluate the validity and reliability of the Turkish version of the Diabetic Foot Scale–Short Form (DFS-SF). The study was cross-sectional and conducted between January and October 2019 in a diabetic foot council of a university hospital. A total of 194 diabetic foot patients participated in the study. A Patient Identification Form and DFS-SF were used for data collection. Forward and backward translations were used in language validity. Expert opinions were obtained to determine the Content Validity Index. To determine construct validity, exploratory factor analysis and confirmatory factor analysis were used. Cronbach’s α internal consistency coefficient, item-scale correlation, and test-retest reliability were used to evaluate reliability. It was found that Content Validity Index was 0.97 (0.86-1.00), the factor loading of scale varied from 0.378 to 0.982, Cronbach’s α value varied from 0.81 to 0.94, and item-total correlations were between 0.30 and 0.75. The Turkish version of the DFS-SF was found valid and reliable to measure the quality of life of diabetic foot patients.


Author(s):  
Elke Mattern ◽  
Gertrud M. Ayerle

ZUSAMMENFASSUNG Einleitung Der „Delivery Expectancy Questionnaire“ von Claas Wijma et al. (W-DEQ_A), der in der Schwangerschaft international am häufigsten zur Bestimmung von großer Angst vor der Geburt eingesetzt wird, lag bisher nicht in der deutschen Sprache vor. Angst vor der Geburt wird in europäischen Ländern, Canada, Australien und den USA mit einer Prävalenz von 6,3% bis 14,8% angegeben. Insbesondere bei Frauen mit Angst vor der Geburt sind die Risiken für eine Präeklampsie, intrauterine Wachstumsretardierung und Kaiserschnitte erhöht. Methode Eine von Claas Wijma autorisierte englische Fassung des W-DEQ_A wurde entsprechend der Richtlinie von Ohrbach et al. (INfORM) sprachlich übersetzt und kulturell adaptiert. Die Inhaltsvalidität wurde statistisch durch die Scale-Content Validity Index/Average Methode (S-CVI/Ave) bestimmt. Ergebnisse Die einer unabhängigen Begutachtung unterzogenen übersetzten Textteile des W-DEQ_A belegten die sprachliche und kulturelle Validität. Eine einleitende Frage und drei Items mussten erneut übersetzt werden. Darüber hinaus war eine Änderung der Formulierung bei drei weiteren Items notwendig, um eine kulturelle Äquivalenz zu erreichen. Die errechnete Inhaltsvalidität ergab einen „exzellenten“ S-CVI/Ave von 0,91. Schlussfolgerung Als Fragebogen zur Selbsteinschätzung mit dem Titel „Gedanken und Gefühle schwangerer Frauen im Hinblick auf die bevorstehende Geburt“ liegt der W-DEQ_A nun in Deutsch vor. In Form einer digitalen Gesundheits-App könnte der Fragebogen verschrieben und das Ergebnis direkt in die elektronische Patientenakte übernommen werden.


Sign in / Sign up

Export Citation Format

Share Document