scholarly journals Design and Validation of an Instrument to Evaluate the Learning Acquired by Nursing Students from a Brief Tobacco Intervention (BTI-St©)

Author(s):  
Antonio Jesús Ramos-Morcillo ◽  
César Leal-Costa ◽  
Ana Teresa García-Moral ◽  
Rafael del-Pino-Casado ◽  
María Ruzafa-Martínez

The aim of this study was to design and validate an instrument, based on the WHO 5As+5Rs model, to test the acquisition by nursing students of a brief tobacco intervention (BTI) learning. A validation design of an instrument following the criterion referenced tests model using videos of simulated BTIs in the primary care setting was carried out. The study included 11 experts in smoking prevention/care and 260 second-year nursing students. The study was in two stages: (1) selection and recording of clinical simulations (settings), and (2) test construction. Content was validated by applying the Delphi consensus technique and calculating the Content Validity Ratio (CVR) and Content Validity Index (CVI). A pilot test was conducted for item analysis. Reliability was evaluated as internal consistency (Kuder-Richardson [KR-20]) and test-retest temporal stability (intraclass correlation coefficient [ICC]). Three simulation settings were recorded. An instrument (BTI-St®) was developed with 23 items for dichotomous (yes/no) response. CVR was >70% for all items, KR-20 of 0.81–0.88, and ICC between 0.68 and0.73 (p < 0.0001). The BTI-St® is a robust and reliable instrument that is easily and rapidly applied. It follows the WHO 5As+5Rs model and offers objective criterion-referenced evaluation of BTI learning in nursing students.

2020 ◽  
pp. 019394592096250
Author(s):  
Teresa Galiana-Camacho ◽  
María Dolores Ruiz-Fernandez ◽  
Iria Dobarrio-Sanz ◽  
José Granero-Molina ◽  
Cayetano Fernandez-Sola ◽  
...  

Low self-efficacy is a barrier to effective nurse prescribing. Therefore, nurses’ self-efficacy should be assessed using validated tools. We aimed to develop and psychometrically test the Nurse Prescribing Self-Efficacy Scale (NP-SES). We conducted an observational cross-sectional study with 290 nurses between January and June 2019. We studied the NP-SES’ reliability (i.e., internal consistency and temporal stability), validity (i.e., content, criterion, and construct) and legibility. The NP-SES showed good internal consistency (Cronbach’s alpha=0.958) and temporal stability (intraclass correlation coefficient=0.783). The NP-SES also showed good content validity (scale’s content validity index=0.98) and criterion validity ( r=0.75; p<0.001). Construct validity analysis revealed the NP-SES’ three-dimensional structure and showed its ability to detect significant differences between nurses with different levels of experience. Our psychometric analysis suggests that the NP-SES is a reliable and valid instrument that could be used to assess nurses’ self-efficacy in nurse prescribing.


2021 ◽  
Vol 67 (3) ◽  
pp. 30-35
Author(s):  
Zhila Fereidouni ◽  
Mohammad Behnammoghadam ◽  
Farnoosh Rashvand ◽  
Hossein Rafiei

BACKGROUND: Medical device-related pressure ulcers/injuries (MDRPU/Is) are a serious concern in health care. PURPOSE: To develop and assess the psychometric testing of a questionnaire to measure nursing students’ attitudes about the care and prevention of MDRPU/Is. METHODS: Based on a review of the literature, a 26-item questionnaire was developed; face validity was assessed by ten (10) nursing students. The modified Lawshe’s model was used, and both the content validity index (CVI) and content validity ratio were calculated. Items with a CVI more than 0.63 were retained. The minimum optimal CVI for the new instrument was 79%. Qualitative assessments were performed by 10 experienced faculty members. One-hundred-and-eighty seven (187) nursing students participated in the construct validity testing of the 11-item questionnaire. The Kaiser-Meyer-Olkin test of sampling adequacy and Bartlett’s test of sphericity were performed. Following analysis of the main components and the varimax rotation, the factor analysis was determined. Internal consistency (Cronbach’s alpha) and test-retest were determined using Pearson’s correlation and intraclass correlation coefficient to evaluate reliability. RESULTS:  During the face validity phase of the initial 26 items, 7 items had impact scores less than 1.5. After calculating the CVI and content validity ratio for all items, 8 items did not achieve the desirable score. After performing exploratory factor analysis on the remaining 11 items, the Kaiser-Meyer-Olkin test value was 0.789, and Bartlett’s test of sphericity was 0.0001, which was statistically significant. Internal consistency of items (Cronbach’s alpha of 0.77) showed that all items had a high correlation. The reliability of test-retest was significant using an intraclass correlation coefficient of 0.75 and Pearson’s correlation coefficient of 0.86 at P < .005. CONCLUSION: In this sample of nursing students, the Attitude Towards Medical-device Related Pressure Ulcers/Injuries Questionnaire was valid and reliable. Studies including licensed clinicians are needed to confirm these results. 


2021 ◽  
pp. 026010602098235 ◽  
Author(s):  
Panchali Moitra ◽  
Preeti Verma ◽  
Jagmeet Madan

Background: Development of culturally appropriate and psychometrically sound instruments that measure knowledge and health behaviors of children will help to inform appropriate interventions. Aim: To develop and test the validity and reliability of a questionnaire measuring knowledge, attitudes, and practices to healthy eating and activity patterns in school children in India. Methods: Review of literature, focus-group discussions, and theoretical constructs of the Health Belief Model guided the development of an item pool. Face and content validity were assessed by children and a panel of experts and the item content validity, item difficulty, and discrimination indices were calculated. Construct validity was determined using the principal axis method of exploratory factor analysis among a cross-sectional sample of children ( n=252). Internal consistency (Cronbach α values >0.7) and test-retest reliability (intraclass correlation coefficient values >0.75) were estimated. Results: Item content validity index for clarity and relevance were satisfactory (>0.80) and internal consistency for knowledge (Kuder-Richardson 20 = 0.832), attitude (Cronbach’s α = 0.912), and practice items (Cronbach’s α = 0.769) were good. Four factors (children’s eating habits, family dietary practices, and consumption of healthy and unhealthy foods) and two factors (moderate to vigorous activities and sedentary activities) explained 67.7% and 48.2% of the total variance in practice items. Intraclass correlation coefficient estimates ranged from good to excellent (0.72–0.99). Conclusions: The results of the validity and reliability of the 84-item knowledge, attitudes, and practices to healthy eating and activity patterns in schoolchildren questionnaire were promising. The detailed description of the methodology employed may prove useful to researchers conducting similar studies in children.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Seyed Abolhassan Naghibi ◽  
Maryam Khazaee-Pool ◽  
Mahmood Moosazadeh

Abstract Background The rate at which mothers experience a cesarean section in the absence of medical signs is growing worldwide. Women’s beliefs and intentions play an essential role in the request or choice of a delivery method. At present, there is no comprehensive, validated scale for assessing pregnant women’s beliefs about cesarean section in the Iranian population. This study was performed to develop and assess the validity and reliability of the intention-based cesarean section scale using the theory of reasoned action (TRA) constructs as a theoretical framework for measuring intention toward the selection of a delivery method. Methods In this cross-sectional validation study, 480 pregnant women were recruited from Sari, in northern Iran, through a multistage random sampling approach. Content validity was examined using the content validity index (CVI) and content validity ratio (CVR). Furthermore, both exploratory factor analyses (EFA) and confirmatory factor analyses (CFA) were applied to assess the construct validity of the developed scale. Reliability was measured by internal consistency and the intraclass correlation coefficient (ICC). Quality criteria for floor and ceiling effects were derived from existing guidelines and consensus within our research group. Results The results obtained from the factor analysis showed that the data were fit to the model (χ2 = 2298.389, P < 0.001). The TRA comprised 24 items assessing five domains, which described 62.46% of the common variance. The CFA showed a model with suitable fitness for the data. Cronbach’s alpha coefficient for the domains of the scale ranged from 0.609 to 0.843, and the ICC value ranged from 0.71 to 0.84, which is within the satisfactory range. The IR-TBICS scale had no floor or ceiling effect on the total score or any of the dimensions. Conclusions The belief-based cesarean section scale appears to be a reliable instrument. It is considered suitable and can be applied in other research in Iran.


2014 ◽  
Vol 22 (3) ◽  
pp. 287-306 ◽  
Author(s):  
Tine Vynckier ◽  
Chris Gastmans ◽  
Nancy Cannaerts ◽  
Bernadette Dierckx de Casterlé

Background: The effectiveness of ethics education continues to be disputed. No studies exist on how nursing students perceive the effectiveness of nursing ethics education in Flanders, Belgium. Objectives: To develop a valid and reliable instrument, named the ‘Students’ Perceived Effectiveness of Ethics Education Scale’ (SPEEES), to measure students’ perceptions of the effectiveness of ethics education, and to conduct a pilot study in Flemish nursing students to investigate the perceived efficacy of nursing ethics education in Flanders. Research design: Content validity, comprehensibility and usability of the SPEEES were assessed. Reliability was assessed by means of a quantitative descriptive non-experimental pilot study. Participants and research context: 86 third-year baccalaureate nursing students of two purposefully selected university colleges answered the SPEEES. Ethical considerations: Formal approval was given by the ethics committee. Informed consent was obtained and anonymity was ensured for both colleges and their participating students. Findings: The scale content validity index/Ave scores for the subscales were 1.00, 1.00 and 0.86. The comprehensibility and user-friendliness were favourable. Cronbach’s alpha was 0.94 for general effectiveness, 0.89 for teaching methods and 0.85 for ethical content. Students perceived ‘case study’, ‘lecture’ and ‘instructional dialogue’ to be effective teaching methods and ‘general ethical concepts’ to contain effective content. ‘Reflecting critically on their own values’ was mentioned as the only ethical competence that, was promoted by the ethics courses. The study revealed rather large differences between both schools in students’ perceptions of the contribution of ethics education to other ethical competences. Discussion and conclusion: The study revealed that according to the students, ethics courses failed to meet some basic objectives of ethics education. Although the SPEEES proved to be a valid and reliable measure, the pilot study suggests that there is still space for improvement and a need for larger scale research. Additional insights will enable educators to improve current nursing ethics education.


2015 ◽  
Vol 21 (2) ◽  
pp. 125-136 ◽  
Author(s):  
José Roberto Andrade do Nascimento Junior ◽  
João Ricardo Nickenig Vissoci ◽  
David Lavallee ◽  
Lenamar Fiorese Vieira

The purpose of this paper was to adapt and validate the Sport-Multidimensional Perfectionism Scale-2 (SMPS-2) for the Brazilian population using a three-step approach. For content validity, four participants translated the SMPS-2 to Portuguese and six experts adapted the content. Construct validity sample was tested with 395 athletes from a set of individual and team sports. Temporal validity was evaluated with an independent sample of 80 athletes with two data collections. Data analysis was conducted through Content Validity Coefficient (CVC), Cronbach's alpha, Composite Reliability (CR) and Exploratory (EFA) and Confirmatory (CFA) analyses. Results showed that the Portuguese version contained clear and relevant questions (CVC > .80) and good internal consistency (α > .70/CR > .70); EFA model revealed a four factor solution with 24 items as more satisfying while CFA confirmed the SMPS-2 model with 24 items was adequate. Multi-group analysis showed partial gender invariance. Temporal stability was achieved in all 24 items of the scale (ICC > .75). We concluded that the SMPS-2 is a valid measure for the assessment of perfectionism of the Brazilian sport context.


2020 ◽  
Author(s):  
Moira Dean ◽  
Johann Issartel ◽  
Tony Benson ◽  
Amanda McCloat ◽  
Elaine Mooney ◽  
...  

Abstract Background Learning cooking skills during childhood and adolescence is associated with positive dietary outcomes in adulthood as well as being tracked from adolescence to adulthood. In addition studies have found that perceived competence to be a greater motivator to perform a behaviour than actual competence. However, a lack of validated tools that effectively measure behavioural and dietary changes and other related measures in children is a limitation. Therefore, this research aimed to develop and validate age-appropriate perceived cooking competence measures for younger and older primary school aged children. Methods Two measures of perceived Cooking Competence (CooC11 and CooC7) for older (8–12 years) and younger (6–7 years) children were developed from a critical evaluation of publically available recommendations and expert consultation. The cooking skills within the measures were illustrated by a graphic designer in consultation with a chef and reviewed in an iterative manner by the research team. The measures were piloted for clarity, ease of use and initial face validity. Multiple studies were used for both CooC11 and CooC7 to establish psychometric properties of the measures, temporal stability, internal consistency reliability, construct validity, as well as responsiveness to change for CooC11. Analysis included Exploratory Factor Analysis, Confirmatory Factor Analysis, Intraclass Correlation Coefficients, Pearson’s Correlations, ANOVAs and Cronbach’s Alphas. Results Both measures had high levels of face validity and received positive user feedback. Two factors were shown in both measures with the measures showing excellent temporal stability (ICC > 0.9) and good internal consistency (Cronbach’s Alphas > 0.7). Both measures showed initial discriminant validity, with significant differences (P < 0.001) between those who reported assisting their parents with dinner preparation and those who did not. Additionally, CooC11 was significantly correlated with an adult cooking measure and had a significant responsiveness to change (P < 0.01). Conclusions The CooC11 and CooC7 are the first validated age-appropriate measures for assessing children’s perceived Cooking Competence for ages 8–12 and 6–7 years respectively. They can be used to evaluate the efficacy of children’s cooking intervention studies or school nutrition education programmes.


PLoS ONE ◽  
2020 ◽  
Vol 15 (12) ◽  
pp. e0243162
Author(s):  
Barry Wright ◽  
Helen Phillips ◽  
Ann Le Couteur ◽  
Jennifer Sweetman ◽  
Rachel Hodkinson ◽  
...  

A Delphi consensus methodology was used to adapt a screening tool, the Social Responsiveness Scale– 2 (SRS-2), for use with deaf children including those whose preferred communication method is sign language. Using this approach; 27 international experts (The Delphi International Expert Panel), on the topic of autism spectrum disorder (ASD) in deaf people, contributed to the review of item content. A criterion for agreement was set at 80% of experts on each item (with 75% acceptable in the final fourth round). The agreed modifications are discussed. The modified SRS-2 research adaptation for deaf people (referred to here as the “SRS-2 Deaf adaptation”) was then translated into British Sign Language using a robust translation methodology and validated in England in a sample of 198 deaf children, 76 with Autism Spectrum Disorders (ASD) and 122 without ASD. The SRS-2 Deaf adaptation was compared blind to a NICE (National Institute for Health and Care Excellence) guideline standard clinical assessment. The area under the Receiver Operating (ROC) curve was 0.811 (95% CI: 0.753, 0.869), with an optimal cut-off value of 73, which gave a sensitivity of 82% and a specificity of 67%. The Cronbach Alpha coefficient was 0.968 suggesting high internal consistency. The Intraclass Correlation Coefficient was 0.897, supporting test-retest reliability. This performance is equivalent to similar instruments used for screening ASD in the hearing population.


2010 ◽  
Vol 100 (9) ◽  
pp. 1714-1718 ◽  
Author(s):  
Ken Resnicow ◽  
Nanhua Zhang ◽  
Roger D. Vaughan ◽  
Sasiragha Priscilla Reddy ◽  
Shamagonam James ◽  
...  

2021 ◽  
Author(s):  
Sadaf Alipour ◽  
Hadi Rashidi ◽  
Khadije Maajani ◽  
Marzieh Orouji ◽  
Yas Eskandari

Abstract Background Health status and perception can be assessed by general or disease-specific questionnaires, the latter are more sensitive. Considering the importance of breast health in women’s lives and the lack of any pertinent questionnaire, we performed this study to develop a valid and reliable short BH questionnaire (BHQ); and then use it for the assessment of participants. Methods We first designed and developed the instrument, followed by measurement of inter-rater agreement IRA, content validity including content validity index (I-CVI) and scale content validity index (S-CVI), and reliability (through internal consistency and test-retest). We then included eligible women with normal breasts and benign breast disorders who attended our breast clinic. Results The IRA index (78.6%) showed optimal relevance and clarity of the questionnaire. The content validity was acceptable; with an S-CVI of 87.35 and 84.42 for clarity and relevance, respectively. One question was eliminated (I-CVI < 70%). The internal reliability was high (Cronbach’s alpha = 0.93). For external consistency, three questions were eliminated (intraclass correlation coefficient < 0.7), the rest of the questions showed good and excellent reliability. In the next step, BH in the 350 eligible participants showed an overall score of 55.86 ± 11.57. Among different variables, age was the only one that showed a significant direct relationship with BH. A history of breast surgery for benign lesions and a family history of breast cancer did not affect BH. Conclusion This study introduces a valid reliable 11-item BHQ. We propose its use in various conditions throughout breast cancer screening, diagnosis, and treatment; and in the assessment of BH in various physiologic and reproductive situations.


Sign in / Sign up

Export Citation Format

Share Document