scholarly journals Is It Biased? Empirical Analysis of Various Phenomena That Affect Survey Results

2021 ◽  
Vol 51 (2) ◽  
pp. 231-256
Author(s):  
Luka Mandić ◽  
Ksenija Klasnić
Keyword(s):  
Measurement Invariance ◽  
Survey Design ◽  
Measuring Instruments ◽  
Confirmatory Bias ◽  
Mean Values ◽  
Careless Responding ◽  
Item Wording ◽  
Method Effects ◽  
Survey Results ◽  
And Gender

It is often assumed that survey results reflect only the quality of the sample and the underlying measuring instruments used in the survey. However, various phenomena can affect the results, but these influences are often neglected when conducting surveys. This study aimed to test the influences of various method effects on survey results. We tested the influences of the following method effects: item wording, confirmatory bias, careless responding, and acquiescence bias. Using a split-ballot survey design with online questionnaires, we collected data from 791 participants. We tested if these method effects had an influence on mean values, item correlations, construct correlations, model fits, and construct measurement invariance. The instruments used to test these influences were from the domain of personality and gender inequality, and their items were adapted based on the method effect tested. All tested method effects, except careless responding, had a statistically significant effect on at least one component of the analysis. Item wording and confirmatory bias affected mean values, model fit, and measurement invariance. Controlling for acquiescence bias improved the fit of the model. This paper confirms that the tested method effects should be carefully considered when using surveys in research, and suggests some guidelines on how to do so.

Mindfulness or Mindlessness?

2011 ◽  
Vol 27 (1) ◽  
pp. 59-64 ◽  
Author(s):  
Volkmar Höfling ◽  
Helfried Moosbrugger ◽  
Karin Schermelleh-Engel ◽  
Thomas Heidenreich
Keyword(s):  
Construct Validity ◽  
Model Fit ◽  
Factor Analyses ◽  
Confirmatory Factor Analyses ◽  
Mindful Attention ◽  
Confirmatory Factor ◽  
Item Wording ◽  
Method Effects

The 15 items of the Mindful Attention and Awareness Scale (MAAS; Brown & Ryan, 2003 ) are negatively worded and assumed to assess mindfulness. However, there are indications of differences between the original MAAS and a version with the positively rephrased MAAS items (“mirror items”). The present study examines whether the mindfulness facet “mindful attention and awareness” (MAA) can be measured with both positively and negatively worded items if we take method effects due to item wording into account. To this end, the 15 negatively worded items of the MAAS and additionally 13 positively rephrased items were assessed (N = 602). Confirmatory factor analyses (CFA) models with and without regard to method effects were carried out and evaluated by means of model fit. As a result, the positively and negatively worded items should be seen as different methods that influence the construct validity of mindfulness. Furthermore, a modified version of the MAAS (MAAS-Short) with five negatively worded items (taken from the MAAS) and five positively worded items (“mirror items”) was introduced as an alternative to assess MAA. The MAAS-Short appears superior to the original MAAS. The results and the limitations of the present study are discussed.

Measurement Invariance Analysis of the Parental Stress Index

2019 ◽  
Vol 35 (6) ◽  
pp. 771-778 ◽  
Author(s):  
Bernhard Piskernik ◽  
Barbara Supper ◽  
Lieselotte Ahnert
Keyword(s):  
Measurement Invariance ◽  
Parental Stress ◽  
Stress Index ◽  
Factor Analyses ◽  
Confirmatory Factor Analyses ◽  
Mean Values ◽  
Confirmatory Factor ◽  
Structural Invariance ◽  
Parent Domain ◽  
Structural Levels

Abstract. While parenting research continues to compare similarities and differences in mothers’ and fathers’ behaviors based on mean values on the respective dimensions, measurement invariance as a prerequisite for these comparisons has seldom been assured. The present study thus subjected the well-known Parenting Stress Index (PSI), widely used in models of family functioning, to a rigorous measurement invariance analysis based on ( N = 214) Austrian couples with children younger than 3 years of age. We evaluated configural, metric, scalar, and uniqueness invariance on item and subscale levels, and tested for structural invariance of means and variances of the PSI parent and child domain by second-order confirmatory factor analyses. As a result, only measurement differences on the scalar levels affected the factor scores, though negligibly. On the structural levels, no differences were found on the PSI child domain across parents, but on the PSI parent domain, mothers reported more stress.

Longitudinal and Gender Measurement Invariance of the Gratitude Questionnaire in Chinese Adolescents

2021 ◽  
pp. 003329412110360
Author(s):  
Qingsong Tan ◽  
Jilin Zou ◽  
Feng Kong
Keyword(s):  
Measurement Invariance ◽  
Time Interval ◽  
Longitudinal Measurement Invariance ◽  
Multiple Group ◽  
Longitudinal Measurement ◽  
Confirmatory Factor ◽  
Adolescent Sample ◽  
Good Internal Consistency ◽  
And Gender ◽  
Mean Differences

The 5-item Gratitude Questionnaire (GQ-5) is one of the most commonly used instruments to measure dispositional gratitude in adolescents. The purpose of this study was to verify the longitudinal measurement invariance (LMI) and gender measurement invariance (GMI) of the GQ-5 that was administered to an adolescent sample twice over the course of 18 months ( N = 669). Single-group confirmatory factor analysis (CFA) was adopted to examine the LMI and multiple-group CFA was conducted to assess the GMI. The results showed that the GQ-5 had strong invariance (i.e., equality of factor patterns, loadings, and intercepts) across time and gender. Validation of latent factor mean differences showed that females had higher gratitude scores than males. In addition, the GQ-5 exhibited good internal consistency indices across time and a moderate stability coefficient was also found across an 18-month time interval in adolescents. In summary, our study showed that LMI and GMI of the GQ-5 are satisfactory and the GQ-5 is a reliable instrument for measuring gratitude in adolescents.

Measurement Invariance of the Sex-Related Cannabis Expectancies Scale across Age and Gender

2021 ◽  
pp. 1-9
Author(s):  
Jessica Fitts Willoughby ◽  
Stacey J. T. Hust ◽  
Jiayu Li ◽  
Leticia Couto
Keyword(s):  
Measurement Invariance ◽  
Age And Gender ◽  
And Gender

Ramadan and blood pressure: importance of chronotherapy

2021 ◽  
Vol 28 (Supplement_1) ◽  
Author(s):  
MA Bejar ◽  
I Zairi ◽  
I Ben Mrad ◽  
B Besbes ◽  
K Mzoughi ◽  
...  
Keyword(s):  
Blood Pressure ◽  
Heart Rate ◽  
Dual Therapy ◽  
Average Heart Rate ◽  
Hypertensive Patients ◽  
Mean Values ◽  
Funding Sources ◽  
Cardiology Department ◽  
Group 2 ◽  
And Gender

Abstract Funding Acknowledgements Type of funding sources: None. Background During Ramadan, alterations in the daily patterns of sleep, activities and medication timing might contribute to changes in blood pressure (BP) and heart rate among hypertensive patients. The aim of this study was to examine the effect of medication timing during Ramadan on blood pressure and heart rate in hypertensive subjects taking their treatment once daily. Methods The study prospectively recruited 44 hypertensive patients between April and June 2019, followed up at the cardiology department of our   Hospital. A 24-hour pressure monitoring was carried out during two periods: prior to Ramadan and during the last ten days of Ramadan. Results We studied 29 women and 15 men, mean age was 58.7 years. 34% of the patients were diabetics and 16% had coronaropathy. 46% of the patients were on monotherapy, 43% on dual therapy and 11% on a triple antihypertensive therapy. During Ramadan, 57% of the patients took their treatment during the dinner (group1), whereas 43% took their treatment during the Shour (group 2). Average 24hour blood pressure in the whole group was 129 ± 18/74 ± 10 mmHg before Ramadan and 129 ± 19/74 ± 10 mmHg during Ramadan (p > 0.05). Daytime and nighttime mean values of systolic and diastolic blood pressure as well as mean values of heart rate were not different between both periods regardless of age and gender. However, during Ramadan, those who took their treatment after dinner had significant higher values of 24 hour systolic BP, awake systolic and diastolic BP, asleep systolic and diastolic BP than those who took their treatment with the shour (p < 0.05). Conclusion In this study, there were no significant changes in systolic and diastolic blood pressures as well as heart rate during the 2 periods. However, during Ramadan, a slight superiority of taking the treatment with the shour is observed. Average values of BP and heart rate Group 1 Group 2 p 24 hour SBP (mmHg) 134 ± 23 122 ± 6 0.017 24 hour DBP (mmHg) 76 ± 12 70 ± 5 0.052 Awake SBP (mmHg) 138 ± 23 125 ± 6 0.012 Awake DBP (mmHg) 79 ± 12 73 ± 5 0.044 Asleep SBP (mmHg) 127 ± 26 114 ± 12 0.030 Asleep DBP (mmHg) 71 ± 13 65 ± 7 0.045 24 hour average heart rate (bpm) 71 ± 7 70 ± 6 0.524 Awake average heart rate (bpm) 76 ± 7 74 ± 7 0.322 Asleep average heart rate (bpm) 65 ± 7 65 ± 7 0.931 Average values of blood pressure and heart rate in both groups Abstract Figure. 24hour course of blood pressure

scholarly journals Functional capacity, pulmonary and respiratory muscle strength in individuals undergoing hemodialysis

2016 ◽  
Vol 29 (2) ◽  
pp. 343-350 ◽  
Author(s):  
Simone Regina Posser ◽  
Sheila Cristina Cecagno-Zanini ◽  
Fabiana Piovesan ◽  
Camila Pereira Leguisamo
Keyword(s):  
Muscle Strength ◽  
Functional Capacity ◽  
Respiratory Muscle ◽  
Respiratory Muscles ◽  
Cross Sectional Study ◽  
Respiratory Muscle Strength ◽  
Cross Sectional ◽  
Mean Values ◽  
Pressure Meter ◽  
And Gender

Abstract Introduction: Individuals with chronic kidney disease (CKD) undergoing hemodialysis (HD) present low cardiorespiratory fitness and functional capacity. Metabolic changes, due to the disease, can result in a variety of pathophysiological conditions that favor the development of respiratory muscle weakness. However, very little is known about the performance of the respiratory muscles and the influence of HD on them. Aim: To evaluate and correlate pulmonary function, functional capacity and respiratory muscle strength in patients with CKD undergoing HD. Methods: Cross-sectional study comprising 23 patients with CKD, that met the following inclusion criteria: patients of both genders, who perform HD three times a week for a minimum period of three months. Respiratory muscle strength was evaluated using a respiratory pressure meter, lung function through spirometry and functional capacity through the 6-minute walk test (6MWT) before the HD session. Results: All patients were male and mean age was 50.2 ± 15.8 years. The median duration of HD was 3 (1.5 to 6.0) years. The mean values obtained in comparison to those predicted were MIP% 36.0 ± 13.6, MEP% 49.5 ± 15.8, FVC% 93.8 ± 21.1, FEV1% 93.7 ± 21.1, FVC/VEF1% 104.1 ± 10.3, and 6MWT% 66.33 ± 20.53. A statistically significant positive correlation was observed between the 6MWT and MIP (r = .63, p =.001) and MEP (r = .67, p < .001), between the MIP and MEP (r =.79, p < .001) and between the FEV1 and FVC (r = .91, p < .001). Conclusion: Patients with CKD undergoing HD present changes in respiratory muscle strength, with the predicted values decreasing for age and gender, as well as the distance covered in the 6MWT, although, with normal spirometric values. Functional capacity was dependent on respiratory muscle strength, as well as the values of MIP and MEP, and the values of FVC and FEV1.

Abstract P165: Comparing Grip Strength, Weakness, And Frailty Based On Comorbidity And Laboratory Data Among Patients With Cardiovascular Disease

Circulation ◽  
2020 ◽  
Vol 141 (Suppl_1) ◽  
Author(s):  
Gloria Kim ◽  
Arati A Gangadharan ◽  
Matthew A Corriere
Keyword(s):  
Grip Strength ◽  
Frailty Index ◽  
Laboratory Data ◽  
Categorical Variables ◽  
P Value ◽  
Continuous Variables ◽  
Chi Square ◽  
Mean Values ◽  
Multivariable Models ◽  
And Gender

Introduction: Some approaches to frailty screening use diagnostic or laboratory data that may be incomplete. Grip strength can identify weakness, a component of phenotype-based frailty assessment. We compared grip strength as a reductionist, phenotype-based approach to frailty screening with comorbidity and laboratory-based alternatives. Hypothesis: Grip strength and categorical weakness are correlated with the modified frailty index-5 (mFI-5) and lab values associated with frailty. Methods: Weakness based on grip, BMI, and gender was compared with mFI-5 comorbidities and lab values. Patients with at least 3/5 mFI-5 comorbidities were considered frail. Lab data collected within 6 months of grip measurement was assessed. Associations were evaluated using multivariable models and kappa. Methods: 2,597 patients had grip strength measured over 5 months. Mean age was 64.4±14.6, mean BMI was 29.5±6.9;46% were women, and 87% white. Prevalent comorbidities included hypertension (28%), CHF (22%), diabetes (29%), and COPD (26%); 9% were functionally dependent. 34% were weak, but only 13% were frail based on mFI-5. Hemoglobin, creatinine, and CRP differed significantly based on weakness ( Table ). Laboratory data were missing for 36%- 95% of patients. Multivariable models identified significant associations between weakness, hemoglobin, and all MFI-5 comorbidities. Categorical agreement between weakness and frailty was limited (kappa =0.09; 95% CL 0.0641-0.1232). Conclusion: Weakness based on grip strength provides a practical, inexpensive approach to risk assessment, especially when incomplete data excludes other approaches. Comorbidity-based assessment categorizes many weak patients as non-frail. Table. Demographic, laboratory values, and comorbidities by categorical weakness based on grip 20 th percentile. Mean values for continuous variables by weakness adjusted for gender and BMI, p-value for T-test; frequency and total percent for categorical variables, p-value represents chi-square test.

scholarly journals Nurses’ views on promotion and the influence of race, class and gender in relation to the Employment Equity Act

2019 ◽  
Vol 45 ◽  
Author(s):  
Mariana M. Van der Heever ◽  
Anita S. Van der Merwe ◽  
Talitha Crowley
Keyword(s):  
South Africa ◽  
Public Sector ◽  
Diversity Training ◽  
Survey Design ◽  
Mixed Race ◽  
Western Cape ◽  
Employment Equity ◽  
Cross Sectional ◽  
Managerial Positions ◽  
And Gender

Orientation: Regardless of the implementation of the Employment Equity Act (EEA), No. 55 of 1998 and the abolishment of apartheid in 1994, African and mixed-race females are under-represented in managerial positions in the public sector of the Western Cape (WC) in South Africa and nationally in the private health sector.Research purpose: The purpose was to explore the views of nurses about promotion to managerial positions in view of the Employment Equity Act (EEA) and the possible influence of race, class and gender.Motivation for the study: South Africa has a history of racial hierarchies and gender inequities. It was therefore important to explore the influence of the EEA and race, class and gender on the promotion of nurses in the post-apartheid context.Research approach/design and method: A cross-sectional descriptive survey design was completed. Six hundred and eighty-eight (n = 688) nurses consented to participate and 573 (83%) questionnaires were returned.Main findings: Race as a social construct surfaced in the superior viewing of white and the inferior viewing of African nurses. Mixed-race and white nurses seemed disgruntled with the EEA because of the benefits it holds for African nurses. African nurses seemed angered by their under-representation in managerial positions in the private and public sectors in the WC. White nurses seemed convinced that African, mixed-race and Indian nurses experience upward mobility. Mixed-race nurses (public sector WC) showed concerns about the career successes of males in a female-dominated profession.Practical/managerial implications: Managerial structures should be required to invest in diversity training, create awareness of the noble intentions of the EEA and communicate the relevance of employment equity plans.Contribution/value-add: The findings provided evidence that reflected a need for diversity training and the creation of awareness about the longstanding influence of racial and gender hierarchies.

scholarly journals Hidden Invalidity Among 15 Commonly Used Measures in Social and Personality Psychology

2020 ◽  
Vol 3 (2) ◽  
pp. 166-184 ◽  
Author(s):  
Ian Hussey ◽  
Sean Hughes
Keyword(s):  
Measurement Invariance ◽  
Internal Consistency ◽  
Degrees Of Freedom ◽  
Self Report ◽  
Structural Validity ◽  
Data Set ◽  
Personality Psychology ◽  
Reliability Factor ◽  
And Gender ◽  
Gender Groups

It has recently been demonstrated that metrics of structural validity are severely underreported in social and personality psychology. We comprehensively assessed structural validity in a uniquely large and varied data set ( N = 144,496 experimental sessions) to investigate the psychometric properties of some of the most widely used self-report measures ( k = 15 questionnaires, 26 scales) in social and personality psychology. When the scales were assessed using the modal practice of considering only internal consistency, 88% of them appeared to possess good validity. Yet when validity was assessed comprehensively (via internal consistency, immediate and delayed test-retest reliability, factor structure, and measurement invariance for age and gender groups), only 4% demonstrated good validity. Furthermore, the less commonly a test was reported in the literature, the more likely the scales were to fail that test (e.g., scales failed measurement invariance much more often than internal consistency). This suggests that the pattern of underreporting in the field may represent widespread hidden invalidity of the measures used and may therefore pose a threat to many research findings. We highlight the degrees of freedom afforded to researchers in the assessment and reporting of structural validity and introduce the concept of validity hacking ( v-hacking), similar to the better-known concept of p-hacking. We argue that the practice of v-hacking should be acknowledged and addressed.

scholarly journals How Organizational Culture Affects Employee(s) Work Engagement in the Insurance Industries in Ghana: An Ambidextrous Approach [AAA]

2018 ◽  
Vol 9 (4) ◽  
pp. 22
Author(s):  
Aphu Elvis Selase ◽  
Xinhai Lu ◽  
Ekor Sophia Enyonam Abla
Keyword(s):  
Organizational Culture ◽  
Work Engagement ◽  
Survey Design ◽  
Insurance Companies ◽  
Cross Sectional Survey ◽  
Statistical Tools ◽  
Cross Sectional ◽  
Pearson Product Moment Correlation ◽  
And Gender ◽  
Employee Work Engagement

The study assessed how organizational culture affects employee work engagement in the insurance industries in Ghana. A cross sectional survey design was used to purposively sample one hundred and sixty-one (161) employees from two leading insurance companies ambidextrously. The Pearson Product Moment Correlation and Independent t-test were the statistical tools used to test the three hypotheses of the study. The results of the study revealed that, there is a positive significant relationship between organizational culture and employee work engagement. Again it was established that managers are more likely to be engaged on their job than non-managers and gender has no significant influence on engagement levels. The study therefore concluded that, to increase employee work engagement, organizations must adopt a favorable culture. Therefore we recommend that organizations should maintain and sustain favorable culture in order to increase the level of employees work engagement.

Sign in / Sign up

Export Citation Format

Share Document