Method Bias Mechanisms and Procedural Remedies

2021 ◽  
pp. 004912412110431
Author(s):  
Minghui Yao ◽  
Yunjie (Calvin) Xu
Keyword(s):  
Social Behavior ◽  
Survey Design ◽  
Survey Response ◽  
Self Report ◽  
Statistical Control ◽  
Detailed Review ◽  
Post Hoc ◽  
Method Bias

As a crucial method in organizational and social behavior research, self-report surveys must manage method bias. Method biases are distorted scores in survey response, distorted variance in variables, and distorted relational estimates between variables caused by method designs. Studies on method bias have focused on post hoc statistical control, but integrated analyses of the sociopsychological mechanism of method bias are lacking. This review proposes a framework for method bias and offers a relatively complete and detailed review of the sociopsychological and statistical mechanisms of four main types of method bias and their procedural remedies. This review proposes “reduce, remove, and rectify” as a guideline for researchers in survey design to address method bias. Finally, this review presents two directions for future methodology research.

scholarly journals Using Wearable Cameras to Assess Foods and Beverages Omitted in 24 Hour Dietary Recalls and a Text Entry Food Record App

Nutrients ◽  
2021 ◽  
Vol 13 (6) ◽  
pp. 1806
Author(s):  
Virginia Chan ◽  
Alyse Davies ◽  
Lyndal Wellard-Cole ◽  
Silvia Lu ◽  
Hoi Ng ◽  
...  
Keyword(s):  
Dietary Assessment ◽  
Fats And Oils ◽  
Point Of View ◽  
Self Report ◽  
Smartphone App ◽  
Food Record ◽  
Post Hoc Analysis ◽  
Significant Difference ◽  
Post Hoc ◽  
Paired T Test

Technology-enhanced methods of dietary assessment may still face common limitations of self-report. This study aimed to assess foods and beverages omitted when both a 24 h recall and a smartphone app were used to assess dietary intake compared with camera images. For three consecutive days, young adults (18–30 years) wore an Autographer camera that took point-of-view images every 30 seconds. Over the same period, participants reported their diet in the app and completed daily 24 h recalls. Camera images were reviewed for food and beverages, then matched to the items reported in the 24 h recall and app. ANOVA (with post hoc analysis using Tukey Honest Significant Difference) and paired t-test were conducted. Discretionary snacks were frequently omitted by both methods (p < 0.001). Water was omitted more frequently in the app than in the camera images (p < 0.001) and 24 h recall (p < 0.001). Dairy and alternatives (p = 0.001), sugar-based products (p = 0.007), savoury sauces and condiments (p < 0.001), fats and oils (p < 0.001) and alcohol (p = 0.002) were more frequently omitted in the app than in the 24 h recall. The use of traditional self-report methods of assessing diet remains problematic even with the addition of technology and finding new objective methods that are not intrusive and are of low burden to participants remains a challenge.

Factors Affecting Organisational Learning: The Case of a Medical Centre

2021 ◽  
pp. 097206342110352
Author(s):  
Orit Shamir-Bladerman
Keyword(s):  
Organisational Culture ◽  
Organisational Learning ◽  
Self Report ◽  
Common Method ◽  
Learning Mechanisms ◽  
Medical Department ◽  
Large Hospital ◽  
Common Method Bias ◽  
Method Bias ◽  
The Relationship

Despite many studies that examined the relationship between organisational learning and organisational culture, none examined whether the levels of learning differ within a given organisation and if so, what factors lead to this difference. This article is based upon a study on organisational learning and investigates the relationship among organisational learning, culture and structure. Quantitative research was conduct on organisational learning practices in 17 medical departments of a large hospital in Israel. Three main categories of variables were examined: mapping the learning mechanisms, characterising the organisational culture and examining the organisational structure of various departments. Organisational learning was measured by means of a set of organisational learning mechanisms used in each medical department. Because data were collected from individuals, it was necessary to control and overcome self-report and common method bias. Reverse scoring of items, the use of variation in wording of items and guaranteeing anonymity to respondents helped control common method bias. As expected, it was found that those departments do differ one from the others by the extent to which organisational learning mechanisms are systematically used. The article further presents and discusses the effects of some structural and cultural factors upon levels of organisational learning on those departments. Both the method and the results of this research differ from previous studies of organisational learning; thus, the article sheds a new light on the concept of organisational learning. The study points to the importance and need of organisations to adopt a culture that encourages use of these organisational learning mechanisms to create effective and ongoing organisational learning. Increasing awareness among hospital departments of organisational learning as an essential process for coping with environmental change is also an important practical contribution.

Using the MMPI-2-RF in Preemployment Evaluations of Police Officer Candidates

2017 ◽  
pp. 51-78 ◽  
Author(s):  
Yossef S. Ben-Porath ◽  
David M. Corey ◽  
Anthony M. Tarescavage
Keyword(s):  
High Risk ◽  
Police Officer ◽  
Self Report ◽  
Sources Of Information ◽  
Detailed Review ◽  
Police Candidates ◽  
Practical Guidance ◽  
Report Measure

The MMPI-2 Restructured Form (MMPI-2-RF) is the current, most up-to-date version of the most widely used self-report measure of personality and psychopathology. Prior versions of the test were studied and used extensively in police candidate assessments. This chapter reviews the legal and empirical foundations for using the MMPI-2-RF in preemployment evaluations of police officer candidates and provides practical guidance for doing so. A detailed review of a series of recent studies on using the MMPI-2-RF in identification of high risk candidates is presented, followed by practical suggestions for integrating MMPI-2-RF findings with other sources of information when conducting preemployment evaluations of police candidates. The MMPI-2-RF Police Candidate Interpretive Report is highlighted.

scholarly journals Gender Bias in Agricultural Child Labor: Evidence from Survey Design Experiments

2020 ◽  
Author(s):  
Jose Galdo ◽  
Ana C Dammert ◽  
Degnet Abebaw
Keyword(s):  
Child Labor ◽  
Rural Areas ◽  
Survey Design ◽  
Self Report ◽  
Farm Labor ◽  
Agricultural Labor ◽  
Gender Stratification ◽  
Social Lives ◽  
Rural Ethiopia ◽  
Labor Statistics

ABSTRACT Agricultural labor accounts for the largest share of child labor worldwide. Yet, measurement of farm labor statistics is challenging due to its inherent seasonality, variable and irregular work schedules, and the varying saliencies of individuals’ work activities. The problem is further complicated by the presence of widespread gender stratification of work and social lives. This study reports the findings of three randomized survey design interventions over the agricultural coffee calendar in rural Ethiopia to address whether response by proxy rather than by self-report has effects on the measurement of child labor statistics within and across seasons. While the estimates do not report differences for boys across all seasons, the analysis shows sizable self/proxy discrepancies in child labor statistics for girls. Overall, the results highlight concerns on the use of survey proxy respondents in agricultural labor, particularly for girls. The main findings have important implications for policymakers about data collection in rural areas in developing countries.

scholarly journals Predictive Influence of Executive Functions, Effortful Control, Empathy, and Social Behavior on the Academic Performance in Early Adolescents

2017 ◽  
Vol 39 (2) ◽  
pp. 253-279 ◽  
Author(s):  
Juan P. Zorza ◽  
Julián Marino ◽  
Alberto Acosta Mesas
Keyword(s):  
Academic Performance ◽  
Social Behavior ◽  
Executive Functions ◽  
Effortful Control ◽  
Social Preference ◽  
Self Regulation ◽  
Early Adolescents ◽  
Self Report ◽  
Mediating Role

In this study, we explored the predictive role of behavioral measures of Executive Functions (EFs) and a self-report measure of Effortful Control (EC) on the academic performance of early adolescents. We also analyzed the mediating role of self-reported empathy and social behavior rated by peers (i.e., prosocial behavior and social preference) and by the lead teacher (i.e., social competence). A sample of 244 adolescents aged between 12 and 13 years participated in the study. The resulting structural equation model indicated that EFs and EC predict academic performance in a complementary and independent way. Results also confirmed the mediating role of empathy and social behavior. The final model explained 64% of academic performance. We discuss the appropriateness of obtaining complementary measures of EFs and EC in predictions of academic performance as well as the importance of introducing activities involving self-regulation, empathy, and socioemotional skills in the school setting.

Construction and Validation of the Clinical Judgment Skill Inventory: Clinical Judgment Skill Competencies That Measure Counselor Debiasing Techniques

2015 ◽  
Vol 29 (1) ◽  
pp. 27-46 ◽  
Author(s):  
Bryan S. Austin ◽  
Michael J. Leahy
Keyword(s):  
Factor Analysis ◽  
Clinical Judgment ◽  
Cognitive Complexity ◽  
Survey Design ◽  
Rehabilitation Counseling ◽  
Reliability And Validity ◽  
Cultural Bias ◽  
Self Report ◽  
Evidence Based ◽  
Empirically Supported

Purpose:To construct and validate a new self-report instrument, the Clinical Judgment Skill Inventory (CJSI), inclusive of clinical judgment skill competencies that address counselor biases and evidence-based strategies.Method:An Internet-based survey design was used and an exploratory factor analysis was performed on a sample of rehabilitation counselor educators’ (n= 126) ratings of clinical judgment skill importance for effective rehabilitation counseling practice.Results:New knowledge of 7 empirically supported clinical judgment skill areas of debiasing techniques (scientific attitude, cultural bias, cognitive complexity, memory bias, confirmatory bias, negative bias, and evidence-based practice) was generated.Conclusion:The 35-item CJSI has initial empirical evidence to support its reliability and validity and to assess clinical judgment skill competencies (debiasing techniques) of master’s students in rehabilitation counseling programs. However, follow-up studies and use of confirmatory factor analysis are needed to further test and substantiate the CJSI’s content and construct validity.

scholarly journals B-56 Personal and Family Psychiatric Histories and Self-Report of Post-Concussive Symptoms in Concussed Children and Adolescents with Prolonged Recovery

2019 ◽  
Vol 34 (6) ◽  
pp. 1002-1002
Author(s):  
K Hassara ◽  
D Pulsipher ◽  
L Stanford ◽  
B Schneider ◽  
E Krapf
Keyword(s):  
Children And Adolescents ◽  
Self Report ◽  
Group Differences ◽  
Psychiatric History ◽  
Targeted Intervention ◽  
Clinical Database ◽  
Duration Of Symptoms ◽  
Prolonged Recovery ◽  
Concussion Recovery ◽  
Post Hoc

Abstract Objective This study seeks to examine whether personal psychiatric history (PPH) and/or family psychiatric history (FPH) are related to prolonged concussion recovery and increased post-concussive symptoms (PCs) in concussed children and adolescents. We hypothesized that individuals with PPH/FPH would endorse a greater number of and more severe PCs relative to those with concussion only or concussion with either PPH or FPH. Methods Data from 255 concussed 8 to 18-year-olds (median = 15.50 years, range = 10.25 years) were retrospectively examined from a clinical database excluding patients with confounding medical comorbidities. PCs (i.e., total symptom count and severity [frequency, intensity, and duration of symptoms]) were compared among four groups (concussion only [n = 80], concussion + PPH [n = 14], concussion + FPH [n = 125], and concussion + PPH/FPH [n = 36]) using a multivariate Kruskal-Wallis test and post-hoc Mann-Whitney U tests. Results The omnibus analysis indicated group differences for injury interval (p = 0.05) and PCs severity (p = 0.002). Post-hoc analyses indicated patients with concussion + PPH/FPH reported greater PCs severity than those with concussion only (U = 726.00, p = 0.0001, r = 0.36) and those with concussion + FPH (U = 1203.00, p = 0.003, r = 0.23). Injury interval was greater for patients with concussion + FPH than those with concussion alone (U = 3474.50, p = 0.007, r = 0.19). Other group differences were non-significant. Conclusions All groups reported a similar number of PCs. FPH contributes to severity of symptoms when combined with PPH. PPH alone did not significantly affect PCs severity. Findings suggest that providers should screen for both PPH and FPH at the time of concussion diagnosis. Early identification of risk factors may lead to targeted intervention, therefore reducing persistent PCs.

scholarly journals Perceived Injustice Moderates the Relationship between Pain and Depressive Symptoms among Individuals with Persistent Musculoskeletal Pain

2012 ◽  
Vol 17 (5) ◽  
pp. 335-340 ◽  
Author(s):  
Whitney Scott ◽  
Michael Sullivan
Keyword(s):  
Depressive Symptoms ◽  
Musculoskeletal Pain ◽  
Pain Catastrophizing ◽  
Self Report ◽  
Pain Severity ◽  
Hierarchical Regression ◽  
Perceived Injustice ◽  
Symptoms Of Depression ◽  
Post Hoc ◽  
The Relationship

BACKGROUND: Numerous investigations report that depressive symptoms frequently coexist with persistent pain. However, evidence suggests that symptoms of depression are not an inevitable consequence of pain. Diathesis-stress formulations suggest that psychological factors interact with the stress of pain to heighten the risk of depressive symptoms. Perceptions of injustice have recently emerged as a factor that may interact with the stress of pain to increase depressive symptoms.OBJECTIVES: The purpose of the present study was to examine whether perceived injustice moderates the relationship between pain and depressive symptoms.METHODS: A total of 107 individuals with persistent musculoskeletal pain completed self-report measures of pain severity, depressive symptoms, perceived injustice and catastrophizing.RESULTS: A hierarchical regression analysis revealed that the interaction between pain severity and perceived injustice uniquely contributed an additional 6% of the variance to the prediction of depressive symptoms, beyond the main effects of these variables. Post hoc probing indicated that pain was significantly related to depressive symptoms at high, but not low levels of perceived injustice. This finding remained statistically significant even when controlling for pain catastrophizing.CONCLUSIONS: The results suggest that perceived injustice augments the relationship between pain severity and depressive symptoms. The inclusion of techniques specifically targeting perceptions of injustice may enhance the effectiveness of interventions aimed at reducing symptoms of depression for individuals presenting with strong perceptions of injustice.

A Longitudinal Study: Some Preliminary Results of Association of Prenatal Maternal Stress and Fetal Movements, Temperament Factors in Early Childhood and Behavior at Age 2 Years

2004 ◽  
Vol 95 (3) ◽  
pp. 767-770 ◽  
Author(s):  
Helmut Niederhofer
Keyword(s):  
Early Childhood ◽  
Longitudinal Study ◽  
Social Behavior ◽  
Maternal Stress ◽  
Self Report ◽  
Prenatal Maternal Stress ◽  
Preliminary Results ◽  
Confounding Variables ◽  
Fetal Movements ◽  
And Behavior

Niederhofer (1994) found that maternal stress during pregnancy was significantly associated with development of personality in early childhood. This study examined the correlation between maternal stress (self-report) during pregnancy for 22 women, its ultrasound objectification by observation of intrauterine fetal movements, child's temperament in early childhood, and child's Independence and social behavior at the age of 2 years while controlling for possible confounding variables. Only intrauterine fetal movements (head/arm/leg) were not associated with stress during pregnancy, temperament, or independence.

scholarly journals Validation of a Speed-Based Classification System Using Quantitative Measures of Walking Performance Poststroke

2008 ◽  
Vol 22 (6) ◽  
pp. 672-675 ◽  
Author(s):  
Mark G. Bowden ◽  
Chitralakshmi K. Balasubramanian ◽  
Andrea L. Behrman ◽  
Steven A. Kautz
Keyword(s):  
Classification System ◽  
Walking Speed ◽  
Step Length ◽  
Self Report ◽  
Group Differences ◽  
Community Based ◽  
Walking Behavior ◽  
Significant Difference ◽  
Walking Performance ◽  
Post Hoc

Background. For clinical trials in stroke rehabilitation, self-selected walking speed has been used to stratify persons to predict functional walking status and to define clinical meaningfulness of changes. However, this stratification was validated primarily using self-report questionnaires. Objective. This study aims to validate the speed-based classification system with quantitative measures of walking performance. Methods. A total of 59 individuals who had hemiparesis for more than 6 months after stroke participated in this study. Spatiotemporal and kinetic measures included the percentage of total propulsion generated by the paretic leg (Pp), the percentage of the stride length accounted for by the paretic leg step length (PSR), and the percentage of the gait cycle spent in paretic preswing (PPS). Additional measures included the synergy portion of the Fugl-Meyer Assessment and the average number of steps/day in the home and community measured with a step activity monitor. Participants were stratified by self-selected gait speed into 3 groups: household (<0.4 m/s), limited community (0.4-0.8 m/s), and community (>0.8 m/s) ambulators. Group differences were analyzed using a Kruskal—Wallis H test with rank sums test post hoc analyses. Results. Analyses demonstrated a main effect in all measures, but only steps/day and PPS demonstrated a significant difference between all 3 groups. Conclusions. Classifying individuals poststroke by self-selected walking speed is associated with home and community-based walking behavior as quantified by daily step counts. In addition, PPS distinguishes all 3 groups. Pp differentiates the moderate from the fast groups and may represent a contribution to mechanisms of increasing walking speed. Speed classification presents a useful yet simple mechanism to stratify subjects poststroke and may be mechanically linked to changes in PPS.

Sign in / Sign up

Export Citation Format

Share Document