scholarly journals Are Attention Check Questions a Threat to Scale Validity?

2017 ◽  
Author(s):  
Franki Y. H. Kung ◽  
Navio Kwok ◽  
Douglas Brown

Attention checks have become increasingly popular in survey research as a means to filter out careless respondents. Despite their widespread use, little research has empirically tested the impact of attention checks on scale validity. In fact, because attention checks can induce a more deliberative mindset in survey respondents, they may change the way respondents answer survey questions, posing a threat to scale validity. In two studies, we tested this hypothesis (N = 816). We examined whether common attention checks—instructed-response items (Study 1) and an instructional manipulation check (Study 2)—impact responses to a well-validated management scale. Results showed no evidence that they affect scale validity, both in reported scale means and tests of measurement invariance. These findings allow researchers to justify the use of attention checks without compromising scale validity and encourage future research to examine other survey characteristic-respondent dynamics to advance our use of survey methods.

2016 ◽  
Vol 26 (3) ◽  
pp. 587-603 ◽  
Author(s):  
Vincent Cicchirillo ◽  
Amanda Mabry

Purpose – The purpose of this paper is to understand how healthy eating involvement (HEI) impacts the evaluations of branded food advergames. Design/methodology/approach – This paper invokes the elaboration likelihood model and reactance theory to explain the effects of different levels of brand integration within a food advergame on individuals with different reported levels of HEI. Undergraduate students were assigned (non-random) to play one of three different advergames with varying levels of brand integration. Furthermore, participant’s health involvement was measured and incorporated as a moderating variable on brand and advergame attitudes. Regression analyses were used to analyze the data. Findings – The results showed significant interaction effects between HEI levels and level of brand advergame integration. Individuals with higher levels of HEI showed more negative attitudes toward the brand and game when integration was high. However, lower levels of brand advergame integration resulted in positive effects among lower HEI individuals. Research limitations/implications – Limitations of this research are that gamer experience was not measured prior to game play. Also, that no control of advergame playing time was conducted. However, a manipulation check was conducted. Future research should examine the impact of healthy advergames on individual’s reactions and information processing. Practical implications – Editors and creators of advergames must be more aware of the impact that branded items have within a gaming situation. Individuals may not always positively evaluate the brand integrated within a fun online environment. Furthermore, better consumer targeting will likely lead to higher message acceptance based upon individuals levels of self-congruency with that message. Originality/value – This study provides needed examination of contextual and individual level variables in responses to advergaming content.


2019 ◽  
Vol 44 (4) ◽  
pp. 282-295
Author(s):  
HyeSun Lee ◽  
Weldon Z. Smith

This study examined whether cutoffs in fit indices suggested for traditional formats with maximum likelihood estimators can be utilized to assess model fit and to test measurement invariance when a multiple group confirmatory factor analysis was employed for the Thurstonian item response theory (IRT) model. Regarding the performance of the evaluation criteria, detection of measurement non-invariance and Type I error rates were examined. The impact of measurement non-invariance on estimated scores in the Thurstonian IRT model was also examined through accuracy and efficiency in score estimation. The fit indices used for the evaluation of model fit performed well. Among six cutoffs for changes in model fit indices, only ΔCFI > .01 and ΔNCI > .02 detected metric non-invariance when the medium magnitude of non-invariance occurred and none of the cutoffs performed well to detect scalar non-invariance. Based on the generated sampling distributions of fit index differences, this study suggested ΔCFI > .001 and ΔNCI > .004 for scalar non-invariance and ΔCFI > .007 for metric non-invariance. Considering Type I error rate control and detection rates of measurement non-invariance, ΔCFI was recommended for measurement non-invariance tests for forced-choice format data. Challenges in measurement non-invariance tests in the Thurstonian IRT model were discussed along with the direction for future research to enhance the utility of forced-choice formats in test development for cross-cultural and international settings.


Author(s):  
Ellen Boeren

This chapter critically explores the tendency of research methods books to discuss survey research under the header of quantitative research approaches. It starts by providing a brief history on survey research, sets out core definitions, and situates survey research in the current methodological literature. The chapter then explores the nature of specific survey questions and the differences in format based on whether one is gathering qualitative versus quantitative data. Finally, the chapter explores the impact of survey methodologies and provides insight into the format of questions to be used during telephone, face-to-face, and self-completing surveys.


2016 ◽  
Vol 8 (3) ◽  
pp. 99
Author(s):  
James A. Adeniran ◽  
Thomas K. Egwuonwu ◽  
Clara O. K. Egwuonwu

<p>This study seeks to determine the impact of sales promotions on sales turnover in the airlines industry in Nigeria. Ex post facto and survey research design were adopted. Secondary data on average monthly passenger turnover covering a period of 25 years (1991-2015) were collected from the records of airport authority. A questionnaire was also administered to 450 air travellers to ascertain the extent to which sales promotions incentives stimulate them to travel by air within Nigeria. Frequency analysis, regression and t-Test methods of analysis were applied. The results show that sales promotions incentives significantly impacted sales turnover in the airlines industry; and air travellers prefer non-monetary sales promotional offers and off-line incentives to monetary and online offers. The study, therefore, recommends that the management of the airlines need to be more innovative in making promotion offers to air travellers so as to optimize the opportunity. Non-monetary and offline incentives offerings should be emphasized to meet the preference of air travellers. For future research, the study suggests that the focus can be on identifying other salient factors that motivate passengers to travel by air so as to boost industry sales.</p>


2015 ◽  
pp. 836-855
Author(s):  
Ellen Boeren

This chapter critically explores the tendency of research methods books to discuss survey research under the header of quantitative research approaches. It starts by providing a brief history on survey research, sets out core definitions, and situates survey research in the current methodological literature. The chapter then explores the nature of specific survey questions and the differences in format based on whether one is gathering qualitative versus quantitative data. Finally, the chapter explores the impact of survey methodologies and provides insight into the format of questions to be used during telephone, face-to-face, and self-completing surveys.


2020 ◽  
Vol 29 (4) ◽  
pp. 2097-2108
Author(s):  
Robyn L. Croft ◽  
Courtney T. Byrd

Purpose The purpose of this study was to identify levels of self-compassion in adults who do and do not stutter and to determine whether self-compassion predicts the impact of stuttering on quality of life in adults who stutter. Method Participants included 140 adults who do and do not stutter matched for age and gender. All participants completed the Self-Compassion Scale. Adults who stutter also completed the Overall Assessment of the Speaker's Experience of Stuttering. Data were analyzed for self-compassion differences between and within adults who do and do not stutter and to predict self-compassion on quality of life in adults who stutter. Results Adults who do and do not stutter exhibited no significant differences in total self-compassion, regardless of participant gender. A simple linear regression of the total self-compassion score and total Overall Assessment of the Speaker's Experience of Stuttering score showed a significant, negative linear relationship of self-compassion predicting the impact of stuttering on quality of life. Conclusions Data suggest that higher levels of self-kindness, mindfulness, and social connectedness (i.e., self-compassion) are related to reduced negative reactions to stuttering, an increased participation in daily communication situations, and an improved overall quality of life. Future research should replicate current findings and identify moderators of the self-compassion–quality of life relationship.


Author(s):  
Endy Gunanto ◽  
Yenni Kurnia Gusti

In this article we present a conceptual of the effect of cross culture on consumer behavior incorporating the impact of globalization. This conceptual idea shows that culture inûuences various domains of consumer behavior directly as well as through international organization to implement marketing strategy. The conceptual identify several factors such as norm and value in the community, several variables and also depicts the impact of other environmental factors and marketing strategy elements on consumer behavior. We also identify categories of consumer culture orientation resulting from globalization. Highlights of each of the several other articles included in this special issue in Asia region. We conclude with the contributions of the articles in terms of the consumer cultural orientations and identify directions for future research.


2020 ◽  
Vol 91 (8) ◽  
pp. 651-661
Author(s):  
Joshua T. Davis ◽  
Hilary A. Uyhelji

INTRODUCTION: Although the impact of microorganisms on their hosts has been investigated for decades, recent technological advances have permitted high-throughput studies of the collective microbial genomes colonizing a host or habitat, also known as the microbiome. This literature review presents an overview of microbiome research, with an emphasis on topics that have the potential for future applications to aviation safety. In humans, research is beginning to suggest relationships of the microbiome with physical disorders, including type 1 and type 2 diabetes mellitus, cardiovascular disease, and respiratory disease. The microbiome also has been associated with psychological health, including depression, anxiety, and the social complications that arise in autism spectrum disorders. Pharmaceuticals can alter microbiome diversity, and may lead to unintended consequences both short and long-term. As research strengthens understanding of the connections between the microbiota and human health, several potential applications for aerospace medicine and aviation safety emerge. For example, information derived from tests of the microbiota has potential future relevance for medical certification of pilots, accident investigation, and evaluation of fitness for duty in aerospace operations. Moreover, air travel may impact the microbiome of passengers and crew, including potential impacts on the spread of disease nationally and internationally. Construction, maintenance, and cleaning regimens that consider the potential for microbial colonization in airports and cabin environments may promote the health of travelers. Altogether, the mounting knowledge of microbiome effects on health presents several opportunities for future research into how and whether microbiome-based insights could be used to improve aviation safety.Davis JT, Uyhelji HA. Aviation and the microbiome. Aerosp Med Hum Perform. 2020; 91(8):651–661.


Author(s):  
Dzhyhil Yu. ◽  

Residential architecture has one of the most conservative styles based on its specifics. However, today this type of architecture seeks to actively respond to changes in the modern world. These changes are caused by multiple factors, among them are: technological and information progress; lack of resources and environmental pollution; military conflicts and population migration etc. The purpose of this article is to summarize the experience of the Department of Architectural Environment of Lviv Polytechnic National University over housing issues and outline the methodological principles of innovation in designing both individual houses and the architectural environment of residential formations. While writing this article, we analyzed the 15-year experience of Architectural Environment's Department diploma projects. The unique feature of these projects is the priority on the design of the environment. The evolution of diploma project topics is revealed on multiple distinctive examples such as the reconstruction of old buildings in Lviv and the construction of prefabricated homes and container-type housing. Futuristic settlements are represented in projects such as “The Ocean Settlements” and “Prykarpatsk - the City of Future”. Research projects were developed to study current trends in housing design and the impact of innovative technologies on planning decisions. These projects discoursed the protection of housing from traffic noise and issues related to environmental preservation. Innovative architectural ideas of future housing, developed by students in these projects, are based on a combination of aesthetic, technical, and social components of architecture. The conclusion indicates that when educating future architects, it is important to teach them the basics of the craft, as well as the ability to defend their innovative ideas. The emphasis is placed on the importance of educating the architect's personal responsibility for their own design solutions. It is stated that professional motivation and the ability to constantly renew previously acquired knowledge and skills will be among the main tasks in training future architects.


2020 ◽  
Vol 8 (2) ◽  
pp. 112
Author(s):  
Sura Altheeb ◽  
Kholoud Sudqi Al-Louzi

The current research investigates the impact of internal corporate social responsibility on job satisfaction in Jordanian pharmaceutical companies. Quantitative research design and regression analysis were applied on a total of 302 valid returns that were obtained in a questionnaire based survey from 14 pharmaceutical companies among employees, supervisors and managers. The results showed that internal corporate social responsibility was significantly related to job satisfaction and three of its dimensions, namely working conditions, work life balance and empowerment contributed significantly to job satisfaction, whereas employment stability and skills development had no contribution. This study implies that Jordanian pharmaceutical companies have to try their best to promote and facilitate internal corporate social responsibility among their employees in an effort to improve their job satisfaction, which will eventually yield positive results for the company as a whole. In light of these results, the research presented many recommendations for future research; the most important ones were the application of this study in other sectors, cultures, and countries, and using of multi method for collecting data.


Sign in / Sign up

Export Citation Format

Share Document