scholarly journals Development and validation of a pilot activity load index (PALI) based on NASA-TLX template

Author(s):  
R Abdi ◽  
A Mazloumi ◽  
GH Halvani ◽  
AS Namazi ◽  
K Azam

Introduction: Workload can be defined as the hypothetical construct that represents the cost incurred by a human operator to achieve a particular level of performance. Several methods have been used to assess the workload. One of the most common methods of assessing mental workload is NASA-TLX method. The present study was conducted to develop and validate of a pilot activity load index (PALI) based on NASA-TLX template. Materials and Methods: This study was a cross-sectional and descriptive-analytical that was carried out among airline pilots of Civil Aviation Organization. At first, “Pilot Activity Load Index” or PALI subscales were developed based on NASA-TLX template. Validity of the subscales was evaluated by Content Validity Ratio (CVR) and Content Validity Index (CVI).Using Lawshe’s table. Finally, to determine the internal consistency of the subscales, 30 pilots completed the final version of the PALI in typical flight phases. The data obtained were then analyzed by SPSS using Cronbach's alpha to measure the reliability of the subscales and considering an acceptance level of 0.7. Results: The first results led to the emergence of an initial list with 17 subscales. Eleven subscales were irrelevant, redundant and impractical to use in operational environment, due to CVR less than 0.75 and were omitted from the subscales list. Finally, six PALI subscales were approved related to pilot tasks (CVI=0.79). The Verified subscales had a Cronbach's alpha value of 0.89 and were therefore considered a reliable tool. Conclusion:  The results of this study showed that PALI questionnaire which validity and reliability has been approved can be used for assessment of workload in pilots.

PLoS ONE ◽  
2021 ◽  
Vol 16 (4) ◽  
pp. e0249660
Author(s):  
Mohd Noor Norhayati ◽  
Zanaridah Mat Nawi

Background Evidence-based medicine (EBM) is a widely accepted scientific advancement in clinical settings that helps achieve better, safer, and more cost-effective healthcare. However, presently, validated instruments to evaluate healthcare professionals’ attitude and practices toward implementing EBM are not widely available. Therefore, the present study aimed to determine the validity and reliability of a newly developed knowledge, attitude, and practice (KAP) questionnaire on EBM for use among healthcare professionals. Methods The Noor Evidence-Based Medicine Questionnaire was tested among physicians in a government hospital between July and August 2018. Exploratory factor analysis and internal consistency reliability-based Cronbach’s alpha statistic were conducted. Results The questionnaire was distributed among 94 physicians, and 90 responded (response rate of 95.7%). The initial number of items in the KAP domains of the Noor Evidence-Based Medicine Questionnaire were 15, 17, and 13, respectively; however, two items in the practice domain with communalities <0.25 and factor loadings <0.4 were removed. The factor structure accounted for 52.33%, 66.29%, and 55.39% of data variance in the KAP domains, respectively. Cronbach’s alpha values were 0.81, 0.81, and 0.84 for KAP domains, respectively, indicating high reliability. Conclusions This questionnaire can be used to evaluate the knowledge, attitudes, and behaviour of healthcare professionals toward EBM. Future testing of this questionnaire among other medical personnel groups will help expand the scope of this tool.


2018 ◽  
Vol 6 (8) ◽  
pp. 1512-1516 ◽  
Author(s):  
Nahid Ardian ◽  
Seyed Alireza Afshani ◽  
Mohammad Ali Morowatisharifabad ◽  
Seyed Saeid Mazloomi Mahmoodabad ◽  
Ali Akbar Vaezi ◽  
...  

BACKGROUND: Given the increased rate of divorce, it is important to analyse the characteristics of divorce applicants. The theory of planned behaviour (TPB) can provide a suitable framework to predict, explain, and/or change the behaviours. In Iran, no instrument can be found, based on health education models, to investigate divorce petition filing as a behaviour.AIM: This study was conducted to design a questionnaire on withdrawal of divorce petition based on the TPB and estimate its validity and reliability.MATERIAL AND METHODS: A qualitative study was conducted in 27 participants involved in the divorce process using directed content analysis. The face and content validity of 58 items, drawn from the qualitative study, were evaluated by 10 experts. The reliability was estimated using Cronbach’s alpha coefficient. The SPSS version 16 was used to analyse data.RESULTS: Estimates of the face and content validity (quantitative and qualitative), revealed that of the 58 items, 48 were valid based on four of the constructs of the TPB. Cronbach’s alpha coefficient was also derived greater than 0.6.CONCLUSION: The designed questionnaire, whose validity and reliability was confirmed in this study, can be used in similar studies. However, the social and cultural differences and their related effects should be considered.


Author(s):  
Natalia Esquivel Garzón ◽  
Luz Patricia Díaz Heredia

Objective. To determine the validity and reliability of the Treatment Adherence Questionnaire for Patients with Hypertension (TAQPH), Spanish version, designed by Chunhua Ma et al.Methods. This study was carried out in the city of Ibagué (Colombia)  and the test validation determined validity (face, content, and construct) and reliability. Face and content validity were conducted through expert judgment, using Fleiss’ Kappa Coefficient statistical tests and modified Lawshe’s content validity index. The construct validity and the reliability test had the participation of 220 people with diagnosis of primary hypertension. Reliability was calculated through Cronbach’s alpha statistical test.Results. In the face validity, the instrument reported a Fleiss’ Kappa index was 0.68 in comprehension, 0.76 in clarity, and 0.64 in accuracy, interpreted as a substantial agreement. The content validity index was satisfactory with 0.91; el exploratory factor analysis reported six factors with a total variance explained of 54%. Cronbach’s alpha for the total scale was 0.74.Conclusion. The Spanish version of the TAQPH is a valid and reliable scale to evaluate adherence to treatment in patients with primary hypertension.Descriptors: essential hypertension; treatment adherence and compliance; surveys and questionnaires; psychometrics; validation studies.How to cite this article: Esquivel N, Díaz LP. Validity and Reliability of the Treatment Adherence Questionnaire for Patients with Hypertension. Invest. Educ. Enferm. 2019; 37(3):e09.


Author(s):  
Abasat Mirzaei ◽  
Zeinab Abbasi ◽  
Sima Safarzadeh

Background:One of the goals of nursing is to provide safe patient care and medical errors are one of the most important threats in this field.Therefore, the purpose of this study is to assess the status of error reporting culture and determine its relationship with demographic characteristics.Methods:This descriptive,analytical and cross-sectional study was carried out among 239 nurses of amiralmomenin and bouali hospitals. First,face validity and then content validity were performed by 15 nursing experts and the questionnaire was distributed and collected. The normal distribution of data was confirmed by Kolmogorov-Smirnov test. The reliability and construct validity were performed with Cronbach’s Alpha test and exploratory factor analysis by PCM.The status of reporting culture was determined by computing descriptive statistics and its relation with demographic variables with Pearson correlation test and logistic regression test with SPSS software version 16.Results:The content validity with CVR &CVI of 0.820 and 0.920 were confirmed. The reporting culture was favorable with a mean and standard deviation of 2.674 and 0.475.The reliability with Cronbach's alpha of 0.747 and the construct validity with a KMO of 0.727 and Significance of the Bartlett test were confirmed and 3 subscales were extracted. The relationship between age and work experience with the reporting culture with a correlation of 0.009 and 0.013 with a significant < 0.05 were rejected But with the variable of gender(=female) with a chance of 2.536 and the significant of 0.006 was confirmed.Conclusion:Developing a safety culture in hospitals by implementing various health programs improves the reporting culture,but the mental climate is undesirable and requires major steps to reduce worries and negative outcomes after reporting.The presence of female nurses in comparison with men improves the error reporting culture.Perhaps the main reason is patriarchy in Iranian culture.


Author(s):  
Aloísio Cardoso-Júnior ◽  
Rosa Malena Delbone de Faria

Abstract: Introduction: Motivation contributes greatly to learning, being a predictor of student performance. Thus, instruments that assess motivation after exposure to different teaching strategies and materials can contribute to the analysis and decision on its effectiveness. In this sense, the Instructional Materials Motivation Survey (IMMS) instrument measures students’ motivation after instructional activities. Objective: This study aimed to evaluate the evidence of validity of the IMMS, previously translated and cross-culturally adapted to Brazilian Portuguese. Method: Cross-sectional study used to evaluate the psychometric properties of the IMMS questionnaire, applied to 211 students from the first, third and fourth semesters of the medical course at José do Rosário Vellano University (Unifenas - Campus Belo Horizonte). The principal component analysis (PCA) with Varimax rotation and Cronbach’s alpha coefficient were used to assess the validity and reliability of the instrument. Results: The PCA reduced the instrument’s items from 36 to 25 items, distributed in four dimensions. The saturation of the items in the dimensions ranged from 0.529 to 0.790 and the total explained variance was 63.12%. The reliability of the modified IMMS (IMMS-BRV), measured by Cronbach’s alpha, ranged from 0.76 (Attention dimension) to 0.93 (Interest dimension). Conclusion: The IMMS application in the remote education scenario, through asynchronous video lectures of human anatomy, resulted in an alternative instrument (IMMS-BRV), with fewer items (more parsimonious) and good internal consistency, demonstrating preliminary evidence of its validity and reliability adequacy.


2020 ◽  
Author(s):  
Samaneh Youseflu ◽  
Shane W. Kraus ◽  
Fatemeh Razavinia ◽  
Majid Yousefi Afrashteh ◽  
soudabeh niroomand

Abstract Background: The assessment of sex addiction among different populations requires a valid and reliable tool. Since the Bergen–Yale Sex Addiction Scale (BYSAS) was not available in Iran, this study aimed to evaluate the validity and reliability of the Persian version of BYSAS. Method: After translation/back-translation procedure, a total of 756 Iranian men and women completed the BYSAS. The structural validity of this tool was evaluated by exploratory and confirmatory factor analysis. An expert panel review also examined content validity of the items. Psychometric properties of the scale including validity, reliability (internal consistency [Cronbach’s alpha]) and test-retest) and factor structure were assessed. Results: Content Validity Index (CVI) and Content Validity Ratio (CVR) scores for BYSAS were 0.75 and 0.62, respectively. Data analysis demonstrated satisfactory internal consistency (Cronbach’s alpha ranging from 0.88 to 0.89). Discussion: Study findings suggest that the BYSAS is a valid and reliable instrument for assessing sex addiction among Persian speaking adults. Replication of research findings is needed to expand the BYSAS for clinical and non-clinical Iranian populations.


2019 ◽  
pp. 18-28
Author(s):  
María de los Ángeles Flores-Aguilar

The objective is to validate the content of the information collection instrument, through expert judgement and pilot testing. Methodology: Non-experimental, correlational research with a cross-sectional design. The first sample of the expert judgment was composed of 8 experts, the second of 27 employees was used for the pilot test. Unit of measurement: Employees from four Technological Universities of Puebla, studying empowerment, leadership, work routine, collaborative work and innovation. The methodology of the analysis included the Kendall Concordance Coefficient (W), to decide the level of correlation between the experts and we used Cronbach’s Alpha for the statistical analysis of the pilot test to measure the reliability of the measurement scale. The results of the expert judgement showed changes that would improve the clarity of the instrument. The wording would be expressed in third person, the use of technical language would be avoided, with the aim of generalizing understanding in the wording. The identification data would be defined according to the organizational structure of the media unit. Kendall's coefficient and Cronbach's Alpha showed acceptable agreement. Discussion. It is important to control the application of these tests with strict adherence to the methodology, minimizing human bias. It is concluded that the content validity represents an elemental tool to evidence the dominance and representativeness of the constructs. If the results are not reached, it is possible to repeat the process until acceptable values are reached. It is proposed to improve the instrument as a result of the experts' judgment and check the concordance between experts.


2021 ◽  
Vol 6 (3) ◽  
pp. 19
Author(s):  
Aric Vranada ◽  
Chiou-Fen Lin ◽  
Chia-Jung Hsieh ◽  
Tsae-Jyy Wang

Background: Nursing shortages are a significant problem experienced by medical institutions worldwide as well as Indonesia. Understanding nurses’ work environment is a proper strategy for enhancing the retention and overcoming shortages of nurses. The Quality Nursing Work Environment (QNWE) is a well-known tool that has been commonly used to evaluate the working atmosphere of nurses. However, the availability and validated version of the instrument for hospital nurses in Indonesia is not confirmed.Purpose: This study aims to confirm the psychometric evaluation of the Indonesian version of QNWE instruments in hospital settings.Methods: A cross-sectional study design and psychometric analyses were administered. The 65-item, eight-domain questionnaire was translated, adapted, and face-validated using content validity index (CVI) analysis. The construct validity and internal consistency of the translated version were tested using confirmatory factor analysis (CFA) and Cronbach's Alpha to 334 hospital nurses. The intraclass correlation coefficient (ICC) was employed to determine test-retest and interrater reliability analysis to 33 nurses and 10 ratters in the pilot testing.Results: The CVI of the QNWE-I scale ranged from 0.86 to 1.00. The CFA determined an adequate model fit of the instrument. As to overall reliability, test-retest reliability of 0.90, ICC analysis of 0.82, and Cronbach's alpha of 0.96; was confirmed.Conclusions: The psychometric evaluation of the QNWE-I showed excellent acceptability, validity, and reliability. Therefore, the QNWE-I can serve as a comprehensive instrument for assessing the quality of nurses' work environments in Indonesia.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Mehri Ansariniaki ◽  
Minoor Lamyian ◽  
Fazlollah Ahmadi ◽  
Abbas Rahimi Foroushani ◽  
Carolann L. Curry ◽  
...  

Abstract Background Postpartum maternal functioning has the potential to affect the quality of interaction between mother and child. A proper assessment of maternal functioning requires a comprehensive and accurate tool. The objective of this study was to prepare a Persian version of the Barkin Index of Maternal Functioning (BIMF) and evaluate its psychometric properties in order to determine its applicability in Iranian mothers. Methods The BIMF was translated into Persian and then culturally adapted for Iranian women. After evaluating face and content validity, to perform factor analysis, a cross-sectional study was conducted using the Persian version of BIMF. The data was collected from two unique groups of 250 mothers (in all 500 mothers) who had infants 2 to 12-months old and who were selected using a two-stage cluster sampling method. Factor analysis, Pearson’s correlation, intra-class correlation coefficients (ICC), composite reliability (CR) and Cronbach’s alpha were employed in order to evaluate structural validity and reliability. Results Exploratory factor analysis resulted in a five-factor structure consisting of 20 items. Subsequently, confirmatory factor analysis (X 2/ df = 1.61, RMSEA = 0.050, GFI = 0.91, CFI = 0.91) confirmed that the Persian version had satisfactory goodness of fit. Reliability and internal consistency were confirmed with a CR of 0.77, an ICC of 0.87 and a Cronbach’s alpha of 0.81. Conclusions The findings indicated that the Persian version of the BIMF is a valid and reliable instrument for assessing maternal functioning among Iranian mothers.


2021 ◽  
Vol 27 (1) ◽  
pp. 146045822097546
Author(s):  
Maria Cellina Wijaya ◽  
Yudhistira Pradnyan Kloping

Nowadays, it is common for people to look for health care information on the internet. The eHealth Literacy Scale (eHEALS) is commonly used to measure eHealth literacy. As of the publication of this study, the Indonesian version for eHEALS has not been published even though eHealth literacy is necessary, especially in the current COVID-19 pandemic. We aimed to evaluate the validity and reliability of the Indonesian version of eHEALS (I-eHEALS). A total of 100 respondents in East Java were involved in this cross-sectional study. Pearson-product moment correlation method and construct validity were used to validate the results. The reliability was determined based on the Cronbach’s alpha internal consistency measurement and intraclass correlation coefficient (ICC). The Pearson correlation analysis results are significantly higher ( r > 0.254, p < 0.01) compared to the critical value table. Single factors accounting for 57.66% variance in the scales exhibit a unidimensional latent structure. The internal consistency between items is excellent as shown by the Cronbach’s alpha coefficient (0.91). The ICC analysis shows an acceptable result (0.552, p < 0.01). The I-eHEALS is valid and reliable to be used for evaluating the eHealth literacy of the Indonesian population.


Sign in / Sign up

Export Citation Format

Share Document