Evidence based on test content, response process and internal structure: Validity testing of the eHealth Literacy Questionnaire (eHLQ) in Australian community health settings Part 2 (Preprint)

2021 ◽  
Author(s):  
Christina Cheng ◽  
Gerald R Elsworth ◽  
Richard H Osborne

BACKGROUND Digital technologies have changed how we manage our health and eHealth literacy is needed to engage with health technologies. Any eHealth strategy would be ineffective if the eHealth literacy needs of users are not addressed. Hence, a robust measure of eHealth literacy is essential for understanding these needs. Based on the eHealth Literacy Framework (eHLF) which identified 7 dimensions of eHealth literacy, the eHealth Literacy Questionnaire (eHLQ) was developed. The tool has demonstrated robust psychometric properties in the Danish setting, but validity testing should be an ongoing and accumulative process. OBJECTIVE This study aimed to evaluate validity evidence based on test content, response process and internal structure of the eHLQ in the Australian community health setting. METHODS A mixed-method approach was used with cognitive interviewing conducted to examine evidence on test content and response process while a cross-sectional survey was undertaken for evidence on internal structure. Data were collected at 3 diverse community health sites in Victoria, Australia. Psychometric testing included both classical test theory and item response theory (IRT) approaches. Methods included Bayesian structural equation modelling (BSEM) for confirmatory factor analysis, internal consistency and test-retest for reliability and Bayesian multiple indicators multiple causes (MIMIC) model for testing of differential item functioning (DIF). RESULTS Cognitive interviewing identified only one confusing term and this was clarified. All items were easy to read and understood as intended. A total of 525 completed questionnaires were included for psychometric analysis. All scales were homogenous with composite scale reliability ranging from .73 to .90. Intraclass Correlation Coefficient for test-retest for the 7 scales ranged from 0.72 to 0.95. A 7-factor BSEM using small variance priors for cross-loadings and residual covariances was fitted to the data and the model of interest produced a satisfactory fit (posterior productive P value=.49, 95% CI for the difference between observed and replicated Chi-square values=-101.40-108.83, prior-posterior productive P value =.92). All items loaded on the relevant factor, with loadings ranging from 0.36 to 0.94. No significant cross-loading was found. There was no evidence of DIF for administration format, site area and health setting. However, discriminant validity was not well-established for Scales 1, 3, 5, 6 and 7. IRT analysis found all items provided precise information at different trait levels except for one item. All items demonstrated different sensitivity to different trait levels and represented a range of difficulty levels. CONCLUSIONS The evidence suggests that the eHLQ is a tool with robust psychometric properties while further investigation of the discriminant validity among some of the scales is recommended. It is ready to be used to identify eHealth literacy strengths and challenges and assist the development of digital health interventions to ensure people with limited digital access and skills are not left behind.

2019 ◽  
Vol 2 (1) ◽  
pp. 51
Author(s):  
Lucky Nindi R. Marfu’i ◽  
Veno D. Krisnanda

This study aims to examine the validity of tests of critical thinking skills in adolescents. Validity tested based on; 1) test content, 2) response process, and 3) internal structure. The constructs of Critical Thinking Skills are 23 questions with the correct answer wrong with the answer answers in the form of reasons supporting the correct wrong answers. The subjects in this study amounted to 304 students from six faculties, namely FPMIPA, FIP, FPOK, FPIPS, FPBS, and FPTK at the Indonesian University of Education. The results of the study showed that of the 36 questions there were only 23 questions that could be maintained because 13 questions that had fallen had poor validity and measurement of adolescent critical thinking skills. Based on the results of the validity test of proof of the contents of the language expert, critical thinking experts, and experts in analytical ability mathematically evaluate that this test is feasible to use and the constructed answer key is in accordance with the questions presented. Based on evidences of the internal structure, it is explained that the KMO value of the results of factor analysis shows the number 0.570 with 2 components formed, namely analysis and evaluation capabilities. Suggestions for further research, TKBK has not been tested in its external validity in depth so that there needs to be evidence based on the relationship to other variables and based on the consequences of the test.


2021 ◽  
Vol 18 (1) ◽  
Author(s):  
Asrat Hailu Dagne ◽  
Mekonnen Haile Beshah ◽  
Bekalu Getnet Kassa ◽  
Eyaya Habtie Dagnaw

Abstract Background Implementation of evidence-based practice is crucial to enhance quality health care, professional development, and cost-effective health service. However, many factors influence the implementation of evidence-based practice. Therefore, this study aimed to assess the implementation of evidence-based practice and associated factors among nurses and midwives. Methods Institutional-based cross-sectional study design was conducted to assess the implementation of evidence-based practice and associated factors from February 15 to March 15, 2019, among 790 nurses and midwives. Data were entered into EpiData version 3.1 then exported to SPSS version 20 for statistical analysis. Categorical variables were presented as frequency tables. Continuous variables were presented as descriptive measures, expressed as mean and standard deviation. Cronbach’s alpha was used to measure reliability, mean, standard deviation, and inter-items correlation of the factors. Independent variables with a probability value (P-value) of less than 0.2 in the Chi-square analysis were entered in the multivariable logistic regression model. Statistically significant associated factors were identified at probability value (P-value) less than 0.05 and adjusted odds ratio with a 95% confidence interval. Results The mean age of participants was 28.35 (SD ± 4.5) years. This study revealed that 34.7% (95% CI 31.5–38%) of participants implemented evidence-based practice moderately or desirably. Age of participants (AOR = 5.98, CI 1.34–26.7), barriers of implementation of evidence-based practice (AOR = 4.8, CI 2.2–10.6), the attitude of participants (AOR = 5.02, CI 1.2–21.5), nursing/midwifery work index (AOR = 3.9, CI 1.4–10.87), self-efficacy of implementation of evidence-based practice skills (AOR = 12.5, CI 5.7–27.5) and knowledge of participants (AOR = 3.06, CI 1.6–5.77) were statistically significant associated factors of implementation of evidence-based practice Concussion Implementation of evidence-based practice of nurses and midwives was poor. Age of participants, barriers of implementation of evidence-based practice, the attitude of participants, self-efficacy of implementation of evidence-based practice skills, nursing/midwifery work index, and knowledge of participants were found to be predictors of implementation of evidence-based practice. Insufficient time and difficulty in judging the quality of research papers and reports were the most common barriers to the implementation of evidence-based practice.


2021 ◽  
pp. 019874292110123
Author(s):  
Matthew C. Lambert ◽  
Douglas Cullinan ◽  
Michael H. Epstein ◽  
Jodie Martin

This study examined the internal structure of the Scales for Assessing Emotional Disturbance-3 Rating Scale (RS), a teacher-completed RS developed to measure emotional disturbance (ED). As defined in U.S. law and regulations, ED involves five characteristics or patterns of behavioral and emotional maladaptation. RS data obtained on a sample of students with ED were used to examine validity evidence based on the internal structure of the assessment. Of particular interest was the extent to which multivariate factors derived from the RS data conform to the five characteristics of ED stated in the definition. Results indicate that the RS data fit a 5-factor model reasonably well. A subsequent bifactor analysis identified a considerable proportion of common variance across factors, suggesting the presence of a strong general ED factor, two distinct group factors (Inability to Learn and Inappropriate Behavior), and three weak group factors. The findings provided evidence of the validity of the SAED-3 RS based on internal structure and pointed to support for use of the RS in contributing to the process of determining whether a student qualifies for the ED education disability. Implications for improved research on the nature of ED and how students with ED can be better served are discussed.


2021 ◽  
Vol 6 (1) ◽  
pp. e000464
Author(s):  
Tommaso Rossi ◽  
Mario R Romano ◽  
Danilo Iannetta ◽  
Vito Romano ◽  
Luca Gualdi ◽  
...  

ObjectiveTo report the results of a global survey on cataract practice patterns related to preoperative, intraoperative and postoperative care, surgical setting and personnel allocation.Methods and analysisAn online 28 questions survey was sent to 240 ophthalmologists asking to describe prevailing trends in their institutions across 38 countries and 5 continents. Questions inquired country, institution, surgical volume and setting, anaesthesia, preoperative and intraoperative examination and postsurgical care. Statistical analysis used crosstabs lambda statistics for non-parametric nominal variables. P value less than 0.05 was considered statistically significant.Results209/240 (87%) ophthalmologists responded: 38% representing public hospitals, 36% private practices and 26% academic sites; overall surgical volume was between 241 700 and 410 500 cataracts per year. There was a significant correlation between type of institution and surgical volume. Complete results available in online (https://freeonlinesurveys.com/r/W6BcLLxy).ConclusionCataract surgery related patterns of perioperative care showed significant difference among respondents, regardless to type of institution, surgical volume and country. Many evidence-based procedures are unevenly practiced around the world and some widespread and expensive habits lack solid scientific evidence while consuming enormous amount of resources both monetary and human. There is a need to reach consensus and share evidence-based practice patterns.


2021 ◽  
Vol 52 (4) ◽  
pp. 168-175
Author(s):  
Emily Belita ◽  
Ruth Schofield ◽  
Genevieve Currie ◽  
Marie Dietrich Leurer ◽  
Aliyah Dosani ◽  
...  

2018 ◽  
Vol 5 (2) ◽  
pp. 121-129
Author(s):  
Siti Khoiroh

Background : Hypertension is a condition of high blood pressure in the arteries that lasted continuously for the long term. Hypertension can be overcome in two ways: pharmacology and non-pharmacology. Pharmacology treatment usually use medicine while one of the ways for non-pharmacology treatment is to consumes apple juice.Research Objective : The aim of this research is to know the effect of apple juice on blood pressure decrease in elderly people with hypertension at Muara Kaman Community Health Center.Methods : The design of this research used quasi experimental design (quasi experiment) with pretest posttest control group design. The sample of the research was hypertensive respondents at Muara Kaman Community Health Center as many as 30 respondents were divided into 2 groups, 15 intervention groups and 15 control groups. The sampling technique used purposive sampling. The research instruments were stethoscope and sphygmomanometer, data analysis using t test dependent and t test independent.Results : There were a significant influence between pretest and posttest of apple juice in the intervention group (P value = 0,000; P <0.005). The mean difference in systolic blood pressure in the intervention group and the control group also had significant differences (P value = 0.002; P <0.05), where as the mean difference in diastolic blood pressure in the intervention group and the control group also had significant differences (P value = 0,039; P <0,05).The Conclusions : The results of this research showed that consumes apple juice gives an effect on the blood pressure of hypertensive patients by consumes regularly.The Suggestions : Nurses and the public can use apple juice as one of the ways to handling to hypertension sufferers besides antihypertensive drugs.


2021 ◽  
Vol 38 (1) ◽  
Author(s):  
Kiran Fatima Fatima Mehboob Ali BANA

Objectives: To identify the improvement in knowledge, presentation skills, critical skills and self-directed learning process during Journal Club platform amidst dental house officers of 2018, 2019 and 2020 after completing one year house job training at Bahria dental College Karachi. Methods: This cross-sectional study was conducted from Dec- 2018 till Dec-2020. The six items were asked about perception of change for evidence-based process of (knowledge, cognitive, affective and participant domains) after completion of house job training by each cohort. The responses were noted on three point likert scale as agree, neutral and disagree. Total 150 questionnaires were distributed in three cohorts. The SPSS version 23 was used. P-value <0.05 was considered as statistically significant. Results: Total n=145 house officers had completed the proforma with response rate of 96.65%. The mean age was 24.45 ± SD 0.63 among three groups. There were n=20(14%) males and n=125(86%) females. There was improvement found for knowledge acquisition about relevant literature search among all three groups. Regarding knowledge acquisition of bio-statistics; majority of subjects n=26 (52%) in 2020 group had reported no change and in 2019 cohort n=23(48%) were agreed. Majority n=21(44%) of house officers had reported no change when asked as JC helped in critical thinking in year 2019. Conclusion: Knowledge acquisition about relevant literature search, presentation and confidence skills were improved but no significant changes were found in knowledge of biostatistics and critical thinking skills. JC is a convincing platform to learn evidence-based process amid dental house officers. doi: https://doi.org/10.12669/pjms.38.1.4562 How to cite this:Bana KFMA. Journal Club is a way forward to adopt Evidence Based Practice among dental House Officers. Pak J Med Sci. 2022;38(1):---------. doi: https://doi.org/10.12669/pjms.38.1.4562 This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/3.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.


2015 ◽  
Vol 7 (1) ◽  
pp. 14-28
Author(s):  
ZUZANNA WALACH-BISTA

Background: This article presents the procedure of the elaboration and verification of the first Polish Sense of Team Efficacy Questionnaire (Kwestionariusz Poczucia Druzynowej Skutecznosci – KPDS). Material/Methods: Two research stages involved a total of 373 professional athletes. Based on the collected data, the internal structure and psychometric properties of the instrument were established. Results: As a result of the conducted statistical analyses, a questionnaire was obtained. Analyses confirmed the stability of the internal structure of the questionnaire. The instrument also obtained satisfactory coefficients of reliability (using Cronbach’s alpha internal reliability coefficient) and construct validity. In order to establish the convergent and discriminant validity of the KPDS, the analysis of the multitrait-multimethod matrix was applied, using the Group Environment Questionnaire (GEQ). Predictive validity was established using the result obtained in a match played directly after the conducted study. Conclusions: The obtained results confirmed the relevance of creating the KPDS. The questionnaire was made up of 21 items representing 4 subscales: fitness, preparation, effort and endurance. Calculation of a general score for the KPDS also proved to be possible.


Sign in / Sign up

Export Citation Format

Share Document