ENSURING QUALITY IN SURVEY RESEARCH

2017 ◽  
Vol 7 (1) ◽  
Author(s):  
Gopi K Khanal

This descripto-analytical paper on ensuring quality in survey research discusses the management of errors in administering survey. This paper aims to help the social science researchers to ensure the quality in the process and outcomes of survey research. It begins with the brief conceptual underpinnings of survey research, discusses about reliability and validity tests in survey, elaborates the notion of total survey error approach, and suggests some measures on handling survey errors. Given the wider applications and substantial costs associated with survey research, the issues of sampling and non-sampling errors have always been major concerns in the quality of survey research. Survey research can be instrumental in generating knowledge provided survey errors are handled properly. Though a variety of measures are in practices to ensure quality of survey data, this paper gives importance on total survey approach that gives emphasis on total quality management in the collection, analysis, and interpretation of data. Dealing survey data from the perspective of total survey approach would yield fruitful results from survey research.

Author(s):  
Mitchell Seligson ◽  
Daniel E. Moreno Morales

Controlling field interview quality is a major challenge in survey research. Even in high-quality surveys, interviewers often make mistakes that ultimately result in added error in results, including visiting the wrong locations, skipping questions or entire pages, failing to read the complete wording of the questions, or even committing fraud while filling out responses. Survey research conducted in developing countries has to deal with these problems more frequently than research conducted in advanced industrial countries. Computer assisted personal interview (CAPI) systems provide an ideal opportunity for improving the quality of the data by eliminating many sources of error and allowing unprecedented control of the field process. The Latin American Public Opinion Project’s (LAPOP) experience using ADGYS, an Android-based CAPI system, provides useful information on how this technology reduces interviewer-related error, offers opportunities to control the field process, and ultimately significantly improves the reliability and validity of survey data.


HortScience ◽  
1998 ◽  
Vol 33 (3) ◽  
pp. 554c-554
Author(s):  
Sonja M. Skelly ◽  
Jennifer Campbell Bradley

Survey research has a long precedence of use in the social sciences. With a growing interest in the area of social science research in horticulture, survey methodology needs to be explored. In order to conduct proper and accurate survey research, a valid and reliable instrument must be used. In many cases, however, an existing measurement tool that is designed for specific research variables is unavailable thus, an understanding of how to design and evaluate a survey instrument is necessary. Currently, there are no guidelines in horticulture research for developing survey instruments for use with human subjects. This presents a problem when attempting to compare and reference similar research. This workshop will explore the methodology involved in preparing a survey instrument; topics covered will include defining objectives for the survey, constructing questions, pilot testing the survey, and obtaining reliability and validity information. In addition to these topics some examples will be provided which will illustrate how to complete these steps. At the conclusion of this session a discussion will be initiated for others to share information and experiences dealing with creating survey instruments.


Author(s):  
Kristina M. Kays ◽  
Tashina L. Keith ◽  
Michael T. Broughal

This chapter addresses the main considerations in online survey research with sensitive topics. Advances in technology have allowed numerous options in addressing survey design, and thus created a need to evaluate and consider best approaches when using online survey research. This chapter identifies subjects such as item non-response in online survey research. In addition, this chapter includes a description of the differences in researching non-sensitive topics versus sensitive topics, and then lists a number of best practice strategies to reduce item non-response and improve the quality of survey data obtained. Included are specific considerations for defining sensitive topics and addressing gender differences when surveying more sensitive material. Additional resources in online survey research design are recommended.


This chapter describes the work of creating multimodal open-access online Delphi studies (OAODS). These are electronic Delphi studies that do not begin with an invited group of identified experts to seat a Delphi panel but rather with self-identified domain-specific authorities active on the Social Web, with post-data-collection vetting of the participants (when knowable) and their responses. This chapter explores how to design such instruments with efficacy and nuance, and built-in tests of respondent expertise, and fraud detection, and further, how to test such instruments for efficacy, reliability, and validity, while using some of the latest features available in online survey research platforms. The platform used in this work is the Qualtrics Research Suite.


Author(s):  
Frauke Kreuter

This article provides a brief overview of key trends in the survey research to address the nonresponse challenge. Noteworthy are efforts to develop new quality measures and to combine several data sources to enhance either the data collection process or the quality of resulting survey estimates. Mixtures of survey data collection modes and less burdensome survey designs are additional steps taken by survey researchers to address nonresponse.


2019 ◽  
Vol 31 (01) ◽  
pp. 1950006
Author(s):  
Mai S. Mabrouk ◽  
Samir Y. Marzouk ◽  
Heba M. Afify

There is a demand to evaluate the quality of dental clinics for improving the healthcare of dentistry sector. The American Dental Education Association (ADEA) presented the quality factors in a dental career which are technical skills, ethics, expertise and cost in the light of the international criterions of dental instruments. There is the low possibility that is still untapped in the aspect of the quality program for dental clinics because of lack of awareness, unapplied of total quality management (TQM) principles and fabrication of a mismatch between the patient needs and the services provided. Therefore, this study described a framework of TQM application for Egyptian dental clinics in the view of clinical engineer that based on random questionnaires from doctors, patients and quality control supervisors at different medical entities under study. All blinding data that obtained from statistical measurements are analyzed by Statistical Package for the Social Science program (SPSS) to provide some recommendations that related to risk management, infection control and thus reduce the spread of diseases in the clinics. The findings of this study elucidated the methodology of clinical engineering in development the quality program among dental clinics through the design of clinic, equipment maintenance and dissemination of quality standard guidelines. This work is considered as the first survey of dental clinics quality in Egypt that will represent a preliminary step in the application of quality standards to promote the level of patient safety.


2019 ◽  
Vol 53 (1) ◽  
pp. 46-50
Author(s):  
Carolyn Logan ◽  
Pablo Parás ◽  
Michael Robbins ◽  
Elizabeth J. Zechmeister

ABSTRACTData quality in survey research remains a paramount concern for those studying mass political behavior. Because surveys are conducted in increasingly diverse contexts around the world, ensuring that best practices are followed becomes ever more important to the field of political science. Bringing together insights from surveys conducted in more than 80 countries worldwide, this article highlights common challenges faced in survey research and outlines steps that researchers can take to improve the quality of survey data. Importantly, the article demonstrates that with the investment of the necessary time and resources, it is possible to carry out high-quality survey research even in challenging environments in which survey research is not well established.


2020 ◽  
Author(s):  
Nasar Ahmad Shayan ◽  
Erhan Eser ◽  
Ahmad Neyazi ◽  
Sultan Eser

Abstract Background In order to predict social, mental and health care needs we must measure Quality of life of residents. In Afghanistan there was no assessment to measure quality of life of people. The aim of this study was to culturally adapt the WHOQOL-BREF into Dari language of Afghanistan and present its psychometric properties. Methods Cultural adaptation of the WHOQOL-BREF into Dari has consisted of two stages: translation stage, and the cognitive debriefing (pilot) stage following the translation stage. The process of translation of WHOQOL-BREF included recommended methodology, mandating forward translation, backward translation was followed. A total number of 1473 people did participate in this research. Psychometric analyses consisted of item analyses; reliability and validity analyses. Internal consistency analyses were done by Cronbach's alpha value and validity analyses consisted of construct validity (convergent validity by SF-36 and confirmatory factor analyses) and criterion validity (multiple linear regression by overall QoL item (item1)) analyses. Acceptable type 1 error was considered as 0.05 in all analyses. Analyses were done by using Lisrel v8.05 statistical package. Results Item domain correlations and -if item deleted- Cronbach alpha values no problematic item in Afghan version of the WHOQOL-BREF. Internal consistency of the scale was in acceptable limits for all domains (alpha values = 0.79–0.80) except for the social relations domain (alpha = 0.41). Using overall QoL item (item q1) as the dependent variable, multiple regression analysis revealed a R2 value of 57% and all of the four domains of the WHOQOL except that of Social relation domain (beta = 0.03) could explain the variance of the q1, the best domain is the environmental domain with a beta value of 0.30. Construct validity is tested by known groups validity; factorial validity and the convergent validity. All of the known categories of the age, gender, education, social class and economic status, having chronic illness were significantly sensitive to the domain scores of the WHOQOL (p < 0.001). Physical and Psychological domains of the WHOQOL-BREF was highly correlated with the related domains of the SF-36 (r = 0.60 and 0.64). Social and environmental domains showed poor correlations with the SF36. Confirmatory factor analyses showed acceptable goodness of fit results. Chi-square = 2174,748 and Degrees of freedom = 246; GFI: 0.88, CFI: 0.83; RMR: 0.066 and RMSEA: 0.073. Conclusion Afghan Dari version of the WHOQOL-BREF can confidently be used in clinical setting and in population level to assess the QoL of the people. The results of the social relations domain should be interpreted with caution due to its poor psychometric power. Further studies are needed to address the social aspects of quality of life in Afghan population.


2020 ◽  
Author(s):  
Jacob Brauner

Introduction: Survey research is often designed based on multiple-choice questions although many other formats, also referred to as innovative item formats (IIF) exist, such as ranking, sorting, questions with pictures or smileys as response options. Research has suggested that IIF in a broad sense can strengthen data quality, but research is needed on a more specific level. Therefore, the purpose of this article is to present research for separate IIFs about the data quality for that type of item. Method: A literature study was conducted to identify articles that test the data quality of IIF. For each IIF research was discussed regarding aspects of data quality, such as reliability, validity and response rate. Results: A total of 166 research articles were identified with data from 218,532 participants revealing aspects of 22 IIFs with 13 subcategories. The type of evidence on data quality is quite varied and for some IIFs the evidence is supportive, for some it is not and for some it is inconclusive. With 6 IIFs the evidence was estimated in favour hereof, for 11 IIFs the evidence was inconclusive, 1 unfavoured and for 3 there was no evidence. With 6 IIFs potential confounders were identified. Discussion: The study suggests further research is needed where evidence is scarce. The present study could initiate more extensive systematic reviews within specific categories of IIF.


2013 ◽  
Vol 31 (15_suppl) ◽  
pp. 6616-6616
Author(s):  
Carrie M Tamarelli ◽  
David D. Howell

6616 Background: Survey research (SR) has been increasing as a percentage of published manuscripts in medical journals. SR plays an important role in studies of quality of life and patient preferences in treatment. Appropriate quality of methodology in SR is critical both to assure reliability and validity of survey results as well as to derive sound generalizations for larger populations from the subsets surveyed. Surveys that have deficient methodological criteria may suffer from significant flaws. A complete description and discussion of quality survey methodology, analysis, and results is essential for a thorough understanding and evaluation of published SR. Methods: Between January 2006 and December 2010, 227 articles in JCO were identified to have either “survey” or “questionnaire” in either the title or abstract. The most recent 52 consecutive articles fulfilling criteria from that time period were reviewed for reporting of survey methodology. A modification of Bennett et al.’s checklist for reporting SR was used for this analysis (Bennett C., et al. Reporting guidelines for survey research: An analysis of published guidance and reporting practices. PLoS Med 8(8): e1001069, 2011.). 35 metrics were used to analyze each survey. These metrics were grouped in the following categories: 1) title and abstract, 2) introduction, 3) methods (research tool, sample selection, survey administration and analysis), 4) results, 5) discussion, and 6) ethical quality indicators. Results: Of the 52 survey articles reviewed, the top quartile reported greater than 72% of the analyzed metrics. Half of the articles contained 63% or more of the desired metrics, and half of the articles had between 42% and 62% of the desired metrics. Some metrics were usually reported, such as ethics board review (reported in 85% of articles), but others were not consistently reported, such as calculation or justification of sample size (neither were reported in 71% of articles). Conclusions: A substantial number of articles reviewed reporting on survey research in JCO did not report critical components of survey methodology. More rigorous quality recommendations should be offered to guide authors in the report of survey research results.


Sign in / Sign up

Export Citation Format

Share Document