scholarly journals Validity and Reliability of Self-Assessment Tool for Risk Prioritization Following Exposure to Tuberculosis in a Hospital Setting

Author(s):  
Piyapong Sirinapakul ◽  
Naesinee Chaiear ◽  
Phanumas Krisorn

The Modified Self-Assessment (MSA) and Present Self-Assessment (PSA) forms are questionnaires used to prioritize the risk of infection of health workers exposed to tuberculosis (TB) in Srinagarind Hospital in Thailand. As MSA was developed from PSA, the validity and reliability of MSA need to be assessed. The research aim is to examine the content validity of MSA and to assess the respective reliability of MSA and PSA vis-à-vis expert opinion. Seven experts determined the content validity index (CVI) of MSA. MSA and PSA were used to prioritize the TB contact of 108 subjects, and we compared the result with the risk assessed by the experts. The respective Kappa agreements between MSA and PSA and the experts were used to assess reliability. The result of the content validity index revealed that MSA had I-CVI > 0.83 for all questions and an S-CVI/Ave above 0.90 for all factors. The Kappa agreement of contact priority between MSA and the experts was 0.80; it was 0.58 between PSA and the experts. MSA can, thus, be used to prioritize contact with tuberculosis in Srinagarind Hospital. MSA is a valid risk communication tool for aerosol-generating procedures. Further study should be conducted in other hospitals, and the number of participants should be increased in order to come to a concrete result.

2020 ◽  
Vol 19 (3) ◽  
pp. 269-274 ◽  
Author(s):  
İsmail Toygar ◽  
Sadık Hançerlioğlu ◽  
Selden Gül ◽  
Tülün Utku ◽  
Ilgın Yıldırım Şimşir ◽  
...  

The purpose of this study was to evaluate the validity and reliability of the Turkish version of the Diabetic Foot Scale–Short Form (DFS-SF). The study was cross-sectional and conducted between January and October 2019 in a diabetic foot council of a university hospital. A total of 194 diabetic foot patients participated in the study. A Patient Identification Form and DFS-SF were used for data collection. Forward and backward translations were used in language validity. Expert opinions were obtained to determine the Content Validity Index. To determine construct validity, exploratory factor analysis and confirmatory factor analysis were used. Cronbach’s α internal consistency coefficient, item-scale correlation, and test-retest reliability were used to evaluate reliability. It was found that Content Validity Index was 0.97 (0.86-1.00), the factor loading of scale varied from 0.378 to 0.982, Cronbach’s α value varied from 0.81 to 0.94, and item-total correlations were between 0.30 and 0.75. The Turkish version of the DFS-SF was found valid and reliable to measure the quality of life of diabetic foot patients.


BMJ Open ◽  
2021 ◽  
Vol 11 (4) ◽  
pp. e045550
Author(s):  
Zhigang Zhang ◽  
Guoqiang Wang ◽  
Yuchen Wu ◽  
Jin Guo ◽  
Nannan Ding ◽  
...  

PurposeTo translate and adapt the Chelsea Critical Care Physical Assessment Tool (CPAx) into Chinese version (‘CPAx-Chi’), test the reliability and validity of CPAx-Chi, and verify the cut-off point for the diagnosis of intensive care unit-acquired weakness (ICU-AW).Study designCross-sectional observational study.MethodsForward and back translation, cross-cultural adaptation and pretesting of CPAx into CPAx-Chi were based on the Brislin model. Participants were recruited from the general ICU of five third-grade class-A hospitals in western China. Two hundred critically ill adult patients (median age: 53 years; 64% men) with duration of ICU stay ≥48 hours and Glasgow Coma Scale ≥11 were included in this study. Two researchers simultaneously and independently assessed eligible patients using the Medical Research Council Muscle Score (MRC-Score) and CPAx-Chi.ResultsThe content validity index of items was 0.889. The content validity index of scale was 0.955. Taking the MRC-Score scale as standard, the criterion validity of CPAx-Chi was r=0.758 (p<0.001) for researcher A, and r=0.65 (p<0.001) for researcher B. Cronbach’s α was 0.939. The inter-rater reliability was 0.902 (p<0.001). The area under the receiver operating characteristic curves of CPAx-Chi for diagnosing ICU-AW based on MRC-Score ≤48 were 0.899 (95% CI 0.862 to 1.025) and 0.874 (95% CI 0.824 to 0.925) for researcher B. The best cut-off point for CPAx-Chi for the diagnosis of ICU-AW was 31.5. The sensitivity was 87% and specificity was 77% for researcher A, whereas it was 0.621, 31.5, 75% and 87% for researcher B, respectively. The consistency was high when taking CPAx-Chi ≤31 and MRC-Score ≤48 as the cut-off points for the diagnosis of ICU-AW. Cohen’s kappa=0.845 (p=0.02) in researcher A and 0.839 (p=0.04) for researcher B.ConclusionsCPAx-Chi demonstrated content validity, criterion-related validity and reliability. CPAx-Chi showed the best accuracy in assessment of patients at risk of ICU-AW with good sensitivity and specificity at a recommended cut-off of 31.


2021 ◽  
Vol 30 ◽  
Author(s):  
Michelini Fátima da Silva ◽  
Patrícia Kuerten Rocha ◽  
Maria Elena Echevarria-Guanilo ◽  
Kátia Cilene Godinho Bertoncello ◽  
Sabrina de Souza ◽  
...  

ABSTRACT Objective: to build and semantically validate a safe communication tool to systematize care transition in pediatric clinical and emergency units. Method: a methodological study, based on the Classic Theory of Psychometric Tests and on the Instrument Development Model, proposed by Pasquali, which included seven professionals, five nurses and two physicians, experts in pediatrics and/or patient safety, who followed specific criteria for inclusion. Data collection was carried out between November and December 2016 and took place with the application of a form made available to the experts via the Google Drive/Microsoft® tool in two validation rounds, conducted by the Delphi Technique, being organized into two domains with 19 items. Data analysis was performed by calculating the Content Validity Index. Results: in order to validate the content, it was necessary to reach a Content Validity Index ≥ 0.80; thus, in the first round, five items underwent changes and were adjusted according to the experts' recommendations. These were validated in the second round, maintaining two domains and nineteen items. Conclusion: the construction and content validation of the instrument can enhance and qualify the clinical practice and contribute to minimize failures in pediatric patient safety associated with effective communication.


Author(s):  
Natalia Esquivel Garzón ◽  
Luz Patricia Díaz Heredia

Objective. To determine the validity and reliability of the Treatment Adherence Questionnaire for Patients with Hypertension (TAQPH), Spanish version, designed by Chunhua Ma et al.Methods. This study was carried out in the city of Ibagué (Colombia)  and the test validation determined validity (face, content, and construct) and reliability. Face and content validity were conducted through expert judgment, using Fleiss’ Kappa Coefficient statistical tests and modified Lawshe’s content validity index. The construct validity and the reliability test had the participation of 220 people with diagnosis of primary hypertension. Reliability was calculated through Cronbach’s alpha statistical test.Results. In the face validity, the instrument reported a Fleiss’ Kappa index was 0.68 in comprehension, 0.76 in clarity, and 0.64 in accuracy, interpreted as a substantial agreement. The content validity index was satisfactory with 0.91; el exploratory factor analysis reported six factors with a total variance explained of 54%. Cronbach’s alpha for the total scale was 0.74.Conclusion. The Spanish version of the TAQPH is a valid and reliable scale to evaluate adherence to treatment in patients with primary hypertension.Descriptors: essential hypertension; treatment adherence and compliance; surveys and questionnaires; psychometrics; validation studies.How to cite this article: Esquivel N, Díaz LP. Validity and Reliability of the Treatment Adherence Questionnaire for Patients with Hypertension. Invest. Educ. Enferm. 2019; 37(3):e09.


2018 ◽  
Vol 26 (2) ◽  
pp. 398-410 ◽  
Author(s):  
Andrea Egger-Rainer

Background and Purpose:The Epilepsy Monitoring Unit Comfort Questionnaire (EMUCQ) is a self-assessment instrument to measure perceived patient comfort during hospitalization in an EMU. This study aimed at initially determining the content validity by rating the content validity index (CVI).Methods:Nine experts judged the 60-item EMUCQ-1 by filling out a content validation form. The CVI was computed on item (I-CVI) and at an average scale (S-CVI/Ave) level.Results:As many as 26 items remained unchanged and 12 items were reworded to prepare the 38-item EMUCQ-2 (I-CVI scores ≥ .78). Fourteen items were omitted and an additional eight items were put aside for further evaluation. The S-CVI/Ave reached .90.Conclusion:The first results indicate the EMUCQ-2 to be valid in terms of content. Further assessment by members of the target population is advisable.


2016 ◽  
Vol 14 (2) ◽  
pp. 158-177 ◽  
Author(s):  
Rhaine Borges Santos Pedreira ◽  
Saulo Vasconcelos Rocha ◽  
Clarice Alves dos Santos ◽  
Lélia Renata Carneiro Vasconcelos ◽  
Martha Cerqueira Reis

ABSTRACT Objective Assess the content validity of the Elderly Health Assessment Tool with low education. Methods The data collection instrument/questionnaire was prepared and submitted to an expert panel comprising four healthcare professionals experienced in research on epidemiology of aging. The experts were allowed to suggest item inclusion/exclusion and were asked to rate the ability of individual items in questionnaire blocks to encompass target dimensions as “not valid”, “somewhat valid” or “valid”, using an interval scale. Percent agreement and the Content Validity Index were used as measurements of inter-rater agreement; the minimum acceptable inter-rater agreement was set at 80%. Results The mean instrument percent agreement rate was 86%, ranging from 63 to 99%, and from 50 to 100% between and within blocks respectively. The Mean Content Validity Index score was 93.47%, ranging from 50 to 100% between individual items. Conclusion The instrument showed acceptable psychometric properties for application in geriatric populations with low levels of education. It enabled identifying diseases and assisted in choice of strategies related to health of the elderly.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
La-mei Liu ◽  
Ment-ting Liu ◽  
Meng-jie Sun ◽  
Jia-nan Wang ◽  
Bei-lei Lin ◽  
...  

Abstract Background The Partners at Care Transitions Measure (PACT-M) is a measure that assesses the quality and safety of care during the transition from hospital to home from the patient’s perspective. The aim of this study was to examine the psychometric properties of the Chinese version of the PACT-M in Mainland China. Methods This was a cross-sectional study. A convenience sample of patients was recruited from three tertiary hospitals affiliated with Zhengzhou University, China. A total of 402 participants were interviewed before discharge, and 306 participants were interviewed one month after discharge from hospital to home using the Chinese version of the PACT-M. The statistical methods used in this study include the critical ratio value, item total correlation, test-retest, Cronbach’s alpha, confirmatory factor analysis and exploratory factor analysis. Results The Chinese version of the PACT-M consists of PACT-M1 and PACT-M2, both of which have two dimensions, the number of items in both parts are consistent with the original English language version. The Cronbach’s alpha values of the PACT-M1 and PACT-M2 were 0.802 and 0.741, and the test-retest reliability values were 0.885 and 0.837. The item content validity index and scale content validity index values of the PACT-M1 and PACT-M2 were all 1.0. Conclusion The Chinese version of the PACT-M shows acceptable validity and reliability and can be used to assess the quality and safety of transitional care from hospital to home from the patient’s perspective in mainland China.


2020 ◽  
Vol 11 (4) ◽  
pp. 62
Author(s):  
Oliva Bazirete ◽  
Manassé Nzayirambaho ◽  
Aline Umubyeyi ◽  
Marie Chantal Uwimana ◽  
Evans Marilyn

Background: Postpartum hemorrhage remains the main cause of maternal mortality in Low and Middle Income Countries. There is a need to advocate for extra vigilance to recognize women at a greater risk and implement early intervention for Postpartum hemorrhage prevention. The purpose of the present study is to develop a content validated risk assessment tool for the prediction and prevention of Postpartum hemorrhage among childbearing women.Methods: This study is drawn from a larger mixed method sequential exploratory study. Factors influencing the prevention of Postpartum hemorrhage were identified from a scoping review and qualitative descriptive studies previously conducted. To establish content validity Index of the instrument, content experts assessed each item of the tool for comprehensiveness, relevance, and face validity. The tool was pilot tested to assess its clinical utility by fifteen (15) health care providers purposively selected from one district hospital based on a minimum of one-year experience in maternity. Ethical considerations were observed.Results: The Risk Assessment Tool went through three rounds of assessment for its content validity. The final round of quantification of the content validity demonstrates that 4 items out of 46 had an Item Content Validity Index (I-CVI) of 0.85 while 42 had the maximum I-CVI of 1. The overall Scale Content Validity Index/ Average (S-CVI/Ave) was 0.98, and the universal approach of Scale Content Validity Index/Universal Agreement (S-CVI/UA) was 0.91. The assessment of clinical utility of Risk Assessment Tool for the Prediction and Prevention of Postpartum hemorrhage among Childbearing women (RATP) demonstrates that its format allows easy recording of findings and using the tool can be an added value for prevention of PPH.Conclusions: The risk assessment tool for the prediction and prevention of Postpartum hemorrhage is intended to be used by health care providers in Rwanda to identify mothers at risk of developing PPH and implement timely prevention strategies. The clinical use of the tool can be vital in the development of accurate preventive approaches by key policy makers in Rwanda in particular and in other developing countries.


Author(s):  
Pavlos Bobos ◽  
Joy C. MacDermid ◽  
Eleni C. Boutsikari ◽  
Emily A. Lalone ◽  
Louis Ferreira ◽  
...  

Abstract Background The Australian/Canadian Osteoarthritis Hand Index (AUSCAN), the Patient-Rated Wrist/Hand Evaluation (PRWHE) and the Thumb Disability Exam (TDX) are patient-reported outcome measures (PROM) designed to assess pain and hand function in patients with hand arthritis, hand pain and disability, or thumb pathology respectively. This study evaluated the content validity of AUSCAN, PRWHE and TDX in people with hand arthritis. Methods This study enrolled participants with hand arthritis to rate the items of all 3 PROM in terms of relevance and clarity. The Content Validity Index (CVI) was computed for each item in each scale (I-CVI) as well as for the overall scale (S-CVI). Kappa was used to determine the inter-rater agreement among the raters. Results Overall, 64 individuals with hand arthritis (27% with OA, 67% with rheumatoid arthritis and 6% with psoriatic arthritis) participated in the study. The I-CVI for all items and all scales were very high (I-CVI > 0.76) and the modified Kappa agreement among the raters demonstrated excellent agreement (k > 0.76). The S-CVI for all PROMs was very high for relevance (AUSCAN = 0.92, 95% CI 0.90 to 0.94; PRWHE = 0.85, 95% CI 0.82 to 0.88 and TDX = 0.87, 95% CI 0.85 to 0.89) and for clarity (AUSCAN = 0.99, 95% CI 0.98 to 1.00; PRWHE = 0.95, 95% CI 0.93 to 0.97 and TDX = 0.91, 95% CI 0.89 to 0.94), respectively. Conclusions This study demonstrated very high content validity indices for the AUSCAN, PRWHE and TDX; with strong consensus across raters. This augments prior studies demonstrating appropriate statistical measurement properties, to provide confidence that all three measures assess important patient concepts of pain and disability.


Sign in / Sign up

Export Citation Format

Share Document