The Development and Testing of the MISSCARE Survey OR

2021 ◽  
pp. JNM-D-19-00039
Author(s):  
Beatrice Kalisch ◽  
Margaret McLaughlin ◽  
Valerie Marsh ◽  
Lan Nguyen ◽  
Akkeneel Talsma

BackgroundAn acceptable, reliable, and valid survey instrument to measure missed nursing care in perioperative settings has not been developed.PurposeTo develop and conduct psychometric testing of the MISSCARE Survey OR.MethodsData were collected nationwide from 1,693 operating room (OR) nurses who completed the MISSCARE Survey OR. The survey contained two sections: Part A, “Elements of perioperative nursing care” (32 questions) and Part B, “Reasons for missing nursing care” (17 questions).ResultsThe MISSCARE Survey OR demonstrated acceptability, as few respondents missed questions in Part A (0.1%–1.1%) and Part B (0.8%–1.3%). Exploratory factor analysis revealed five subscales in Part A (Legal, Preparation, Safety, Communication, and Closing) and four in Part B (Urgency, Staffing, Materials, and Teamwork). In Part A, the five-factor solution explained 44% of the variance. In Part B, the four-factor solution explained 53% of the variance. Alpha coefficients for subscales in Part A ranged from 0.71 to 0.84 and 0.74 to 0.90 for Part B. Validity was measured using content validity, criterion validity, and construct validity. A panel of OR nurse experts established content validity. Criterion validity compared hospitals with fewer than six ORs to hospitals with hospitals with more than six ORs where it was hypothesized aprior that nurses in hospitals with fewer ORs would have missed less care (X = −.123, standard error [SE] = .041, p = .003). Construct validity was tested through exploratory and confirmatory factor analyses (CFA). Correlation coefficients for Part A ranged from 0.34 to 0.73 and 0.60 to 0.73 for Part B. Overall model fit was acceptable: goodness-of-fit index (GFI) and CFA were greater than 0.90, standardized root mean square residual (SMRM) was less than 0.06, and root mean square error of approximation (RMSEA) less than 0.08.ConclusionThe MISSCARE Survey OR promises to be a reliable, valid indicator of the extent of and reasons for missed nursing care.

2016 ◽  
Vol 20 (2) ◽  
pp. 221-233 ◽  
Author(s):  
Nurhening Yuniarti ◽  
Soenarto Soenarto

Penelitian ini bertujuan untuk mendapatkan bukti validitas konstrak dari instrumen yang digunakan untuk kegiatan evaluasi outcome dari lembaga pendidikan guru vokasional. Instrumen ini terdiri atas 3 jenis instrumen. Teknik analisis data yang digunakan adalah confirmatory factor analysis (CFA). Kriteria yang digunakan untuk melihat kecocokan model adalah: p-value, normed Chi-square (X2/df), RMSEA (Root Mean Square Error of Approximation), RMR (Root Mean-square Residual), GFI (Goodness-of-Fit Index), NFI (Normed Fit Index), Non-Normed Fit Index (NNFI), dan CFI (Comparative Fit Index). Bukti validitas instrumen dapat dilihat pada besarnya faktor loading dan t-value.  Jika loading factor lebih besar dari 0,3 dengan t-valuelebih besar dari 1,96 maka butir pernyataan dapat dikategorikan valid. Berdasarkan hasil analisis diperoleh hasil: (1) pada instrumen I terdapat 26 butir yang dinyatakan valid; (2) pada instrumen II terdapat 23 butir yang dinyatakan valid; dan (3) pada instrumen III terdapat 18 butir yang dinyatakan valid.Kata kunci: validitas konstrak, evaluasi, lembaga pendidikan guru vokasional CONSTRUCT VALIDITY OF OUTCOME EVALUATION INSTRUMENT IN VOCATIONAL TEACHER EDUCATION INSTITUTIONAbstractThis research aims to get the construct validity evidence of the outcome evaluation instrument of vocational teacher education institution. The instrument consists of 3 kinds of instruments. The analysis technique that is used to test the construct validity is confirmatory factor analysis (CFA). The criteria used to determine the goodness of fit were: p-value, normed Chi-square (X2/df), RMSEA (Root Mean Square Error of Approximation), RMR (Root Mean-square Residual), GFI (Goodness-of-Fit Index), NFI (Normed Fit Index), Non-Normed Fit Index (NNFI), and CFI (Comparative Fit Index). The evidence of the construct validity was based on the standardized loading factor and t-value. If the loading factor > 0.3 with t-value > 1.96, the item is valid. Based on the analysis, the research results are: (1) 26 item of the instrument I are categorized valid; (2) 23 items of instrument II are categorized valid; and (3) 18 items of instrument III are categorized valid.Keywords: construct validity, evaluation, vocational teacher education institution


2021 ◽  
Vol 26 ◽  
pp. 1-8
Author(s):  
Thiago Ferreira de Sousa ◽  
Sueyla Ferreira da Silva dos Santos ◽  
Silvio Aparecido Fonseca ◽  
Gerleison Ribeiro Barros ◽  
Mauro Virgílio Gomes de Barros ◽  
...  

Os objetivos do estudo foram estimar o nível de confiabilidade e validade fatorial da escala “Perfil do Estilo de Vida Individual” em tempos de distanciamento social, por meio da análise fatorial confirmatória (AFC). Para tanto, a escala “Perfil do Estilo de Vida Individual” em tempos de distanciamento social foi empregada em um estudo realizado com amostras de estudantes e servidores de instituições de ensino superior de diferentes regiões brasileiras. A amostra final correspondeu a 4.694 adultos que responderam o formulário on-line. Para a avaliação de constructo foi realizada a análise de consistência interna via Alfa de Cronbach’s (a) e correlação de Spearman. Empregou-se a AFC para testar a estrutura fatorial hipotética da escala. A consistência interna geral foi de a de 0,778 e houve correlações significativas, porém, inferiores a ± 0,799 para os itens dos mesmos constructos e ± 0,499 entre os itens de constructos diferentes. Na AFC, após ajustes na estrutura do modelo, ocorreu a adequação para todos os indicadores (Goodness-of-fit Index: 0,976; Comparative Fit Index: 0,937; Normalized Fit Indices: 0,932; Tucker-Lewis Indices: 0,914; Root Mean Square Error of Approximation: 0,047; Root Mean-Square Residual: 0,031; Standardized Root Mean-Square Residual: 0,0337), com a exceção para os valores de p do Qui-quadrado e razão entre Qui-quadrado e graus de liberdade. Conclui-se que a escala “Perfil do Estilo de Vida Individual” em tempos de distanciamento social, mostrou consistência interna e estrutura fatorial satisfatórias para orientar a avaliação do estilo de vida (individual ou de grupos) e as intervenções para promover estilos de vida saudáveis.


2020 ◽  
Author(s):  
he tang ◽  
min zhang ◽  
yujin liu

Abstract Objective: to make the translation, cross-cultural adaption and content and face validation of Questionnaire of sleep health for use in Chinese elder, as well as measuring psychometric properties of the questionnaire. Methods: A methodological study carried out in six steps: translation of the instrument, consensus of the translations, back-translation, analysis by an expert committee, pre-testing and then evaluation of psychometric properties. Psychometric properties, including item analysis (the extreme group comparison and item-total correlations), content validity (item-level content validity index (I-CVI) and scale-level content validity index (S-CVI)), construct validity confirmatory factor analysis (CFA) and internal consistency (Cronbach’s α and test–retest reliability) were measured.Results: The instrument was translated, transculturally adapted and its final version consisted of 12 items. The Q-USM has excellent internal consistency (Cronbach’s α=0.76). The test–retest reliability coefficient was 0.97.The I-CVI ranged from 0.80 to 1.00, and the S-CVI was 0.98. CFA showed that the three-factor model explained 56.54% of the total variance, with a good model fit (likelihood ratio χ2/df=3.75, incremental fit index=0.86, comparative fit index=0.86, goodness-of-fit index=0.89, adjusted goodness-of-fit index=0.84, standardized root mean square error of approximation=0.09 and root mean square residual=0.02).Conclusion: The Q-USM was translated and adapted to Chinese elder, and the psychometric properties of the Chinese version of the questionnaire presented satisfactory. It’s providing assessment instruments for community elderly health. As the questionnaire is applied for the first time in China, it needs to be continuously improved.


SLEEP ◽  
2021 ◽  
Vol 44 (Supplement_2) ◽  
pp. A201-A202
Author(s):  
Kristina Puzino ◽  
Susan Calhoun ◽  
Allison Harvey ◽  
Julio Fernandez-Mendoza

Abstract Introduction The Sleep Inertia Questionnaire (SIQ) was developed and validated in patients with mood disorders to evaluate difficulties with becoming fully awake after nighttime sleep or daytime naps in a multidimensional manner. However, few data are available regarding its psychometric properties in clinical samples with sleep disorders. Methods 211 patients (43.0±16.4 years old, 68% female, 17% minority) evaluated at the Behavioral Sleep Medicine (BSM) program of Penn State Health Sleep Research & Treatment Center completed the SIQ. All patients were diagnosed using ICSD-3 criteria, with 111 receiving a diagnosis of chronic insomnia disorder (CID), 48 of a central disorder of hypersomnolence (CDH), and 52 of other sleep disorders (OSD). Structural equation modelling was used to conduct confirmatory factor analysis (CFA) of the SIQ. Results CFA supported four SIQ dimensions of “physiological”, “cognitive”, “emotional” and “response to” (RSI) sleep inertia with adequate goodness-of-fit (TLI=0.90, CFI=0.91, GFI=0.85, RMSEA=0.08). Internal consistency was high (α=0.94), including that of its dimensions (physiological α=0.89, cognitive α=0.94, emotional α=0.67, RSI α=0.78). Dimension inter-correlations were moderate to high (r=0.42–0.93, p<0.01), indicating good construct validity. Convergent validity showed moderate correlations with Epworth sleepiness scale (ESS) scores (r=0.38) and large correlations with Flinders fatigue scale (FFS) scores (r=0.65). Criterion validity showed significantly (p<0.01) higher scores in subjects with CDH (69.0±16.6) as compared to those with CID (54.4±18.3) or OSD (58.5±20.0). A SIQ cut-off score ≥57.5 provided a sensitivity/specificity of 0.77/0.65, while a cut-off score ≥61.5 provided a sensitivity/specificity of 0.71/0.70 to identify CDH vs. ESS<10 (AUC=0.76). Conclusion The SIQ shows satisfactory indices of reliability and construct validity in a clinically-diverse sleep disorders sample. Its criterion validity is supported by its divergent association with hypersomnia vs. insomnia disorders, as well as its adequate sensitivity/specificity to identify patients with CDH. The SIQ can help clinicians easily assess the complex dimensionality of sleep inertia and target behavioral sleep treatments. Future studies should confirm the best SIQ cut-off score by including good sleeping controls, while clinical studies should determine its minimal clinically important difference after pharmacological or behavioral treatments. Support (if any):


2021 ◽  
Vol 11 (6) ◽  
pp. 583
Author(s):  
Riitta Suhonen ◽  
Katja Lahtinen ◽  
Minna Stolt ◽  
Miko Pasanen ◽  
Terhi Lemetti

Patient-centredness in care is a core healthcare value and an effective healthcare delivery design requiring specific nurse competences. The aim of this study was to assess (1) the reliability, validity, and sensitivity of the Finnish version of the Patient-centred Care Competency (PCC) scale and (2) Finnish nurses’ self-assessed level of patient-centred care competency. The PCC was translated to Finnish (PCC-Fin) before data collection and analyses: descriptive statistics; Cronbach’s alpha coefficients; item analysis; exploratory and confirmatory factor analyses; inter-scale correlational analysis; and sensitivity. Cronbach’s alpha coefficients were acceptable, high for the total scale, and satisfactory for the four sub-scales. Item analysis supported the internal homogeneity of the items-to-total and inter-items within the sub-scales. Explorative factor analysis suggested a three-factor solution, but the confirmatory factor analysis confirmed the four-factor structure (Tucker–Lewis index (TLI) 0.92, goodness-of-fit index (GFI) 0.99, root mean square error of approximation (RMSEA) 0.065, standardized root mean square residual (SRMR) 0.045) with 61.2% explained variance. Analysis of the secondary data detected no differences in nurses’ self-evaluations of contextual competence, so the inter-scale correlations were high. The PCC-Fin was found to be a reliable and valid instrument for the measurement of nurses’ patient-centred care competence. Rasch model analysis would provide some further information about the item level functioning within the instrument.


2020 ◽  
Vol 32 (10) ◽  
pp. 701-707
Author(s):  
Mehtap Akgün ◽  
Selma Turan Kavradim ◽  
İlkay Boz ◽  
Zeynep Özer

Abstract Objectives To develop and examine the psychometric properties of the Caring Behaviors Assessment Tool Nursing Version-Short Form (CBAN-SF) based on the Theory of Human Caring to assess the nurses’ perceptions about caring behaviors. Design This study is based on the Consensus-based Standards for the Selection of Health Measurement Instruments checklist. Setting The study was conducted at the medical-surgical services of Akdeniz University Hospital between October 2019 and January 2020. Participants This study was conducted with 216 nurses working in the surgery and internal clinics. Main Outcome Measures Psychometric properties of the Turkish version of the CBAN-SF with 27 items. Results It was found that the Content Validity Index (CVI) for the items of the draft scale was between 0.972 and 1.00 and the instrument’s CVI had an average score of 0.994. The CBAN-SF had good fit indexes (chi-square goodness of fit / degrees of freedom = 2.914, root mean square error of approximation = 0.075, comparative fit index = 0.984, non-normed fit index = 0.983, normed fit index = 0.972 and standardized root mean square residuals = 0.054) in structural validity. For internal consistency, the Cronbach’s alpha, Spearman–Brown and the Guttman split-half coefficients were all 0.974. The Cronbach’s alpha coefficient for the seven subfactors of the scale ranged between 0.793 and 0.904 and had acceptable internal consistency. The item-total score correlation of the scale was 0.648–0.829, and the factor loadings were 0.455–0.769. Conclusion The structural validity, internal consistency and content validity of the CBAN-SF supported to be a reliable and valid tool for assessment of caring behaviors by nurses.


2018 ◽  
Vol 17 (03) ◽  
pp. 314-321
Author(s):  
José Manuel Hernández-Padilla ◽  
Matías Correa-Casado ◽  
José Granero-Molina ◽  
Alda Elena Cortés-Rodríguez ◽  
Tamara María Matarín-Jiménez ◽  
...  

AbstractObjectiveTo translate, culturally adapt, and psychometrically evaluate the Spanish version of the “Scale for End-of Life Caregiving Appraisal” (SEOLCAS).MethodObservational cross-sectional study. Convenience sample of 201 informal end-of-life caregivers recruited in a southern Spanish hospital. The reliability of the questionnaire was assessed through its internal consistency (Cronbach's α) and temporal stability (Pearson's correlation coefficient [r] between test-retest). The content validity index of the items and the scale was calculated. Criterion validity was explored through performing a linear regression analysis to evaluate the SEOLCAS’ predictive validity. Exploratory factor analysis was used to examine its construct validity.ResultsThe SEOLCAS’ reliability was very high (Cronbach's α = 0.92). Its content validity was excellent (all items’ content validity index = 0.8–1; scale's validity index = 0.88). Evidence of the SEOLCAS’ criterion validity showed that the participants’ scores on the SEOLCAS explained approximately 79.3% of the between-subject variation of their results on the Zarit Burden Interview. Exploratory factor analysis provided evidence of the SEOLCAS’ construct validity. This analysis revealed that two factors (“internal contingencies” and “external contingencies”) explained 53.77% of the total variance found and reflected the stoic Hispanic attitude toward adversity.Significance of resultsThe Spanish version of the SEOLCAS has shown to be an easily applicable, valid, reliable, and culturally appropriate tool to measure the impact of end-of-life care provision on Hispanic informal caregivers. This tool offers healthcare professionals the opportunity to easily explore Hispanic informal end-of-life caregivers’ experiences and discover the type of support they may need (instrumental or emotional) even when there are communicational and organizational constraints.


Symmetry ◽  
2021 ◽  
Vol 14 (1) ◽  
pp. 23
Author(s):  
Yuping Li ◽  
Brady K. Quinn ◽  
Johan Gielis ◽  
Yirong Li ◽  
Peijian Shi

Many natural radial symmetrical shapes (e.g., sea stars) follow the Gielis equation (GE) or its twin equation (TGE). A supertriangle (three triangles arranged around a central polygon) represents such a shape, but no study has tested whether natural shapes can be represented as/are supertriangles or whether the GE or TGE can describe their shape. We collected 100 pieces of Koelreuteria paniculata fruit, which have a supertriangular shape, extracted the boundary coordinates for their vertical projections, and then fitted them with the GE and TGE. The adjusted root mean square errors (RMSEadj) of the two equations were always less than 0.08, and >70% were less than 0.05. For 57/100 fruit projections, the GE had a lower RMSEadj than the TGE, although overall differences in the goodness of fit were non-significant. However, the TGE produces more symmetrical shapes than the GE as the two parameters controlling the extent of symmetry in it are approximately equal. This work demonstrates that natural supertriangles exist, validates the use of the GE and TGE to model their shapes, and suggests that different complex radially symmetrical shapes can be generated by the same equation, implying that different types of biological symmetry may result from the same biophysical mechanisms.


2018 ◽  
Vol 12 (1) ◽  
pp. 352-365 ◽  
Author(s):  
Karn Chalermwongphan ◽  
Prapatpong Upala

Aim: This research aimed to present the process of estimating bicycle traffic demand in order to design bike routes that meet the daily transportation needs of the people in Nakhon Sawan Municipality. Methods: The primary and secondary traffic data were collected to develop a virtual traffic simulation model with the use of the AIMSUN simulation software. The model validation method was carried out to adjust the origin and destination survey data (O/D matrix) by running dynamic O/D adjustment. The 99 replication scenarios were statistically examined and assessed using the goodness-of-fit test. The 9 measures, which were examined, included: 1) Root Mean Square Error (RMSE), 2) Root Mean Square Percentage Error (RMSPE%), 3) Mean Absolute Deviation (MAD), 4) Mean Bias Error (MBE), 5) Mean Percentage Error (MPE%), 6) Mean Absolute Percentage Error (MAPE%), 7) Coefficient of Determination (R2), 8) GEH Statistic (GEH), and 9) Thiel’s U Statistic (Theil’s U). Results: The resulting statistical values were used to determine the acceptable ranges according to the acceptable indicators of each factor. Conclusion: It was found that there were only 8 scenarios that met the evaluation criteria. The selection and ranking process was consequently carried out using the multi-factor scoring method, which could eliminate errors that might arise from applying only one goodness-of-fit test measure.


Sign in / Sign up

Export Citation Format

Share Document