scholarly journals Development and Content Validation of the Adaptation Process in Academia Questionnaire for Occupational Therapy Educators

2020 ◽  
Vol 54 (2) ◽  
Author(s):  
Maria Concepcion C. Cabatan ◽  
Lenin C. Grajo ◽  
Erlyn A. Sana

Objective. The process of adaptation in academia can best be understood and measured using valid and reliable tools. To understand how occupational therapy educators adapt to academic roles and how they use adaptation to build academic careers, the Adaptation Process in Academia Questionnaire (APA-Q) was developed. The APA-Q is a 199-item tool with four sections: academic experiences (104 items); contexts (16 items); adapting responses (13 items); and adaptation outcomes (66 items). This study described the development and the process of determining the content validity of the APA-Q.Method. We conducted an extensive review of literature and the available faculty instruments in developing the APA-Q items. Six content experts were recruited to rate the 199-item and scale relevance of the instrument. Qualitative feedback were provided from open-ended questions. Item and scale content validity indices (I-CVI/S-CVI) were calculated. CVI and qualitative assessment informed questionnaire revisions. Results. Content experts rated 161 of the items (81%) to be highly relevant. The I-CVI of 30 items was acceptable (0.83). Eight items were rated irrelevant (0.5-0.66). S-CVI was excellent (0.97). In terms of constructs, experts agreed on the relevance of items (>0.80): academic experiences (99 or 95%); contexts (16 or 100%); adapting responses (12 or 92%); and adaptation outcomes (63 or 95%). Qualitative assessment indicated a lack of clarity in some items and instructions, redundancy in some of the items, the use of jargon, and missing items. Based on I-CVI and qualitative assessment, 12 items were deleted, 13 items were revised, and 10 items were added. Conclusion. Context experts deemed the APA-Q to be relevant. Further establishment of its construct validity and reliability is warranted.

2018 ◽  
Vol 11 (9) ◽  
pp. 51
Author(s):  
Sanober Salman Shaikh

This article aims to develop framework of integrative leadership, therefore sub objectives were set to achieve the key objective of this study. The sub- objectives of this study were to form definition, initial constructs, and items and examining the content validity of newly developed integrative leadership measure. Thorough understanding and conceptualization of the various leadership styles and their scales was achieved by the review of literature. The integrative leadership definition and its framework were built through integration of six leadership types (transformational, authentic, ethical servant, spiritual and transactional). By means of synthesizing literature on six leadership styles and asseesment of content validity, initial 13 constructs, more than 100 sub- construct and 72 items of integrative leadership were obtained. In future, researchers should focus on examining construct validity and reliability of integrative leadership.


BMC Nursing ◽  
2021 ◽  
Vol 20 (1) ◽  
Author(s):  
JuHee Lee ◽  
Chang Gi Park ◽  
Sung Hae Kim ◽  
Juyeon Bae

Abstract Background Clinical reasoning is a vital competency for healthcare providers. In 2014, a clinical reasoning assessment rubric (CRAR) composed of analysis, heuristics, inference, information processing, logic, cognition and meta-cognition subdomains was developed for osteopathy students. Methods This study was conducted to verify the validity and reliability of the CRAR in nursing education. A total of 202 case vignette assessments completed by 68 students were used for exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). The Cronbach’s α coefficient of the CRAR was calculated. Results The content validity indices ranged from 0.57 to 1.0. The EFA resulted in three factors: assessment in nursing, nursing diagnosis and planning, and cognition/meta-cognition in nursing. The CFA supported a 3-factor model. The Cronbach’s α coefficient of the CRAR was 0.94. This study confirmed the content validity, construct validity, and reliability of the CRAR. Therefore, the CRAR is a useful rubric for assessing clinical reasoning in nursing students. Conclusions The CRAR is a standardized rubric for assessing clinical reasoning in nurses. This scale will be useful for the development of educational programs for improving clinical reasoning in nursing education.


2020 ◽  
Vol 19 (3) ◽  
pp. 269-274 ◽  
Author(s):  
İsmail Toygar ◽  
Sadık Hançerlioğlu ◽  
Selden Gül ◽  
Tülün Utku ◽  
Ilgın Yıldırım Şimşir ◽  
...  

The purpose of this study was to evaluate the validity and reliability of the Turkish version of the Diabetic Foot Scale–Short Form (DFS-SF). The study was cross-sectional and conducted between January and October 2019 in a diabetic foot council of a university hospital. A total of 194 diabetic foot patients participated in the study. A Patient Identification Form and DFS-SF were used for data collection. Forward and backward translations were used in language validity. Expert opinions were obtained to determine the Content Validity Index. To determine construct validity, exploratory factor analysis and confirmatory factor analysis were used. Cronbach’s α internal consistency coefficient, item-scale correlation, and test-retest reliability were used to evaluate reliability. It was found that Content Validity Index was 0.97 (0.86-1.00), the factor loading of scale varied from 0.378 to 0.982, Cronbach’s α value varied from 0.81 to 0.94, and item-total correlations were between 0.30 and 0.75. The Turkish version of the DFS-SF was found valid and reliable to measure the quality of life of diabetic foot patients.


2021 ◽  
pp. 026010602098235 ◽  
Author(s):  
Panchali Moitra ◽  
Preeti Verma ◽  
Jagmeet Madan

Background: Development of culturally appropriate and psychometrically sound instruments that measure knowledge and health behaviors of children will help to inform appropriate interventions. Aim: To develop and test the validity and reliability of a questionnaire measuring knowledge, attitudes, and practices to healthy eating and activity patterns in school children in India. Methods: Review of literature, focus-group discussions, and theoretical constructs of the Health Belief Model guided the development of an item pool. Face and content validity were assessed by children and a panel of experts and the item content validity, item difficulty, and discrimination indices were calculated. Construct validity was determined using the principal axis method of exploratory factor analysis among a cross-sectional sample of children ( n=252). Internal consistency (Cronbach α values >0.7) and test-retest reliability (intraclass correlation coefficient values >0.75) were estimated. Results: Item content validity index for clarity and relevance were satisfactory (>0.80) and internal consistency for knowledge (Kuder-Richardson 20 = 0.832), attitude (Cronbach’s α = 0.912), and practice items (Cronbach’s α = 0.769) were good. Four factors (children’s eating habits, family dietary practices, and consumption of healthy and unhealthy foods) and two factors (moderate to vigorous activities and sedentary activities) explained 67.7% and 48.2% of the total variance in practice items. Intraclass correlation coefficient estimates ranged from good to excellent (0.72–0.99). Conclusions: The results of the validity and reliability of the 84-item knowledge, attitudes, and practices to healthy eating and activity patterns in schoolchildren questionnaire were promising. The detailed description of the methodology employed may prove useful to researchers conducting similar studies in children.


2021 ◽  
Vol 5 (1) ◽  
Author(s):  
János Valery Gyuricza ◽  
Karl Bang Christensen ◽  
Ana Flávia Pires Lucas d’Oliveira ◽  
John Brodersen

Abstract Background A previous qualitative assessment of the psychosocial consequences of labelling hypertension describes the diagnosis of hypertension as a labelling event with potential unintended negative long-term psychosocial consequences (labelling effects). Until now, the benefits of diagnosing hypertension have been far more reported than the harms. To obtain the net result of the preventive interventions for cardiovascular disease, such as diagnosing and treating mild hypertension, assessing benefits and harms in the most comprehensive way possible is necessary, including the psychosocial consequences of labelling. When measuring psychosocial consequences of labelling hypertension, a questionnaire with high content validity and adequate psychometric properties is needed. Objectives The aim of this study was to describe the psychometric parameters of face and content-validated pool of items. Other objectives were also to screen the item pool by using Rasch model analysis and confirmatory factor analysis (CFA) for identifying such items with sufficient fit to the hypothesised models. Methods We surveyed the pool of items as a draft questionnaire to Brazilians recruited via social networks, sending e-mails, WhatsApp® messages and posting on Facebook®. The inclusion criteria were to be older than 18 years old, to be healthy and to have only hypertension. We used Rasch model analysis to screen the item pool, discarding items that did not fit the hypothesised domain. We searched for local dependence and differential item functioning. We used CFA to confirm the derived measurement models and complementarily assessed reliability using Cronbach’s coefficient alpha. Results The validation sample consisted of 798 respondents. All 798 respondents completed Part I, whereas 285 (35.7%)—those with hypertension—completed Part II. A condition-specific questionnaire with high content validity and adequate psychometric properties was developed for people labelled with hypertension. This measure is called ‘Consequences of Labelling Hypertension Questionnaire’ and covers the psychosocial consequences of labelling hypertension in two parts, encompassing a total of 71 items in 15 subscales and 11 single items. Conclusion We developed a tool that can be used in future research involving hypertension, especially in scenarios of screening, prevention, population strategies and in intervention studies. Future use and testing of the questionnaire may still be required.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Seyed Abolhassan Naghibi ◽  
Maryam Khazaee-Pool ◽  
Mahmood Moosazadeh

Abstract Background The rate at which mothers experience a cesarean section in the absence of medical signs is growing worldwide. Women’s beliefs and intentions play an essential role in the request or choice of a delivery method. At present, there is no comprehensive, validated scale for assessing pregnant women’s beliefs about cesarean section in the Iranian population. This study was performed to develop and assess the validity and reliability of the intention-based cesarean section scale using the theory of reasoned action (TRA) constructs as a theoretical framework for measuring intention toward the selection of a delivery method. Methods In this cross-sectional validation study, 480 pregnant women were recruited from Sari, in northern Iran, through a multistage random sampling approach. Content validity was examined using the content validity index (CVI) and content validity ratio (CVR). Furthermore, both exploratory factor analyses (EFA) and confirmatory factor analyses (CFA) were applied to assess the construct validity of the developed scale. Reliability was measured by internal consistency and the intraclass correlation coefficient (ICC). Quality criteria for floor and ceiling effects were derived from existing guidelines and consensus within our research group. Results The results obtained from the factor analysis showed that the data were fit to the model (χ2 = 2298.389, P < 0.001). The TRA comprised 24 items assessing five domains, which described 62.46% of the common variance. The CFA showed a model with suitable fitness for the data. Cronbach’s alpha coefficient for the domains of the scale ranged from 0.609 to 0.843, and the ICC value ranged from 0.71 to 0.84, which is within the satisfactory range. The IR-TBICS scale had no floor or ceiling effect on the total score or any of the dimensions. Conclusions The belief-based cesarean section scale appears to be a reliable instrument. It is considered suitable and can be applied in other research in Iran.


2015 ◽  
Vol 23 (3) ◽  
pp. 485-498
Author(s):  
Martha R. Sleutel ◽  
Celestina Barbosa-Leiker ◽  
Marian Wilson

Background and Purpose: Evidence-based practice (EBP) is essential to optimal health care outcomes. Interventions to improve use of evidence depend on accurate assessments from reliable, valid, and user-friendly tools. This study reports psychometric analyses from a modified version of a widely used EBP questionnaire, the information literacy for nursing practice (ILNP). Methods: After content validity assessments by nurse researchers, a convenience sam ple of 2,439 nurses completed the revised 23-item questionnaire. We examined internal consistency and used factor analyses to assess the factor structure. Results: A modified 4-factor model demonstrated adequate fit to the data. Cronbach’s alpha was .80–.92 for the subscales. Conclusions: The shortened ILNP (renamed Healthcare EBP Assessment Tool or HEAT) demonstrated adequate content validity, construct validity, and reliability.


2021 ◽  
Vol 15 (12) ◽  
pp. 3505-3508
Author(s):  
Noor Ul Ain Fatima ◽  
Qurat-Ul- Ain ◽  
Fareeha Kausar ◽  
Mian Ali Raza ◽  
Misbah Waris ◽  
...  

Objective: To translate and validate the ABC-Scale in Urdu language to predict risk of fall in older population. Study design: Cross-cultural Translation and validation Place and Duration: Study was conducted in older adult community of Sialkot from March 2020 to December 2020. Methodology: Translation of ABC in Urdu was conducted by using Beaton et al guidelines. Two bilingual translators translated the original version into Urdu language step wise, correction process was followed. Then two backward translations were done by language expert. After all this process, the translated version was reviewed by the professionals and the final version was applied on 15 individuals. Its reliability and validity was tested on 60 older adults. Results: For test re test reliability, intra class correlation coefficient ICC was measured with a value of 0.984 Which shows good test re-test reliability. The internal consistency and reliability of ABC was calculated by Cronbach’s alpha for total score with a value of 0.985. Content validity was good with values of CVI ranging from 0.767 to 0.955. To test the discriminative validity, independent t test was used to show the difference between the healthy and unhealthy adults. Factor analysis of UABC showed total variance 81.277 and cumulative variance was also 81.277. To calculate construct validity of U-ABC Pearson’s correlation coefficient was used and measured as 0.558. Conclusion: It was concluded that Urdu version of UABC is a valid assessment tool for older adults with fear of fall. It has good content validity, construct validity and reliability. Keywords: activities specific balance scale, validation, Urdu translation, reliability, tool translation


2021 ◽  
Vol 2 (01) ◽  
pp. 21-42
Author(s):  
Muhammad Afifullah Nizary ◽  
Ahmad Nur Kholik Nur Kholik

This article attempts to examine how to analyze the validity of the assessment instrument. In fact, not all teachers are able to make the correct instruments. Many teachers only take instruments from other schools to be used as a tool in measuring their students, even though the same instrument is not necessarily a measuring instrument with different objects. This habit needs to be improved. The teacher should be able to make their own instruments, because the teacher knows best about the differences in the abilities of each student. When the teacher uses instruments from other schools, where there are parts that the teacher has not conveyed in class, the students themselves are the losers. In making an assessment instrument the teacher must pay attention to two characteristics. Namely validity and reliability. Validity itself is divided into content validity, construct validity, and eksternal validity. Each validity has its own characteristics. Keywords: evaluation and teacher, the validity of the assessment instrument, the validity of the content


Sign in / Sign up

Export Citation Format

Share Document