scholarly journals Conducting Online Surveys

2019 ◽  
Vol 35 (3) ◽  
pp. 413-417 ◽  
Author(s):  
Helen L. Ball

There is an established methodology for conducting survey research that aims to ensure rigorous research and robust outputs. With the advent of easy-to-use online survey platforms, however, the quality of survey studies has declined. This article summarizes the pros and cons of online surveys and emphasizes the key principles of survey research, for example questionnaire validation and sample selection. Numerous texts are available to guide researchers in conducting robust survey research online, however this is neither a quick nor easy undertaking. While online survey websites and software are useful for assisting in questionnaire design and delivery, they can also introduce sources of bias. Researchers considering conducting online surveys are encouraged to read carefully about how the principles of survey research can be applied to online formats in order to reduce bias and enhance rigor. In addition to alerting researchers to the pitfalls of online surveys this article also aims to equip readers of this journal with the knowledge of how to critically appraise publications based on online surveys.

2018 ◽  
Vol 28 (4) ◽  
pp. 854-887 ◽  
Author(s):  
Joel R. Evans ◽  
Anil Mathur

Purpose The purpose of this paper is to present a detailed and critical look at the evolution of online survey research since Evans and Mathur’s (2005) article on the value of online surveys. At that time, online survey research was in its early stages. Also covered are the present and future states of online research. Many conclusions and recommendations are presented. Design/methodology/approach The look back focuses on online surveys, strengths and weaknesses of online surveys, the literature on several aspects of online surveys and online survey best practices. The look ahead focuses on emerging survey technologies and methodologies, and new non-survey technologies and methodologies. Conclusions and recommendations are provided. Findings Online survey research is used more frequently and better accepted by researchers than in 2005. Yet, survey techniques are still regularly transformed by new technologies. Non-survey digital research is also more prominent than in 2005 and can better track actual behavior than surveys can. Hybrid surveys will be widespread in the future. Practical implications The paper aims to provide insights for researchers with different levels of online survey experience. And both academics and practitioners should gain insights. Social implications Adhering to a strong ethics code is vital to gain respondents’ trust and to produce valid results. Originality/value Conclusions and recommendations are offered in these specific areas: defining concepts, understanding the future role of surveys, developing and implementing surveys and a survey code of ethics. The literature review cites more than 200 sources.


Author(s):  
Kristina M. Kays ◽  
Tashina L. Keith ◽  
Michael T. Broughal

This chapter addresses the main considerations in online survey research with sensitive topics. Advances in technology have allowed numerous options in addressing survey design, and thus created a need to evaluate and consider best approaches when using online survey research. This chapter identifies subjects such as item non-response in online survey research. In addition, this chapter includes a description of the differences in researching non-sensitive topics versus sensitive topics, and then lists a number of best practice strategies to reduce item non-response and improve the quality of survey data obtained. Included are specific considerations for defining sensitive topics and addressing gender differences when surveying more sensitive material. Additional resources in online survey research design are recommended.


Author(s):  
J. Ye

The widespread use of personal computers in the work place and at home has created a new opportunity of conducting research. With the increasing accessibility of the Internet and e-mail, using the new medium to distribute surveys is gaining popularity among researchers. The online survey, however, is a “double-edged sword” with the ability to access a large number of respondents at low costs but the risk of increasing difficulties to evaluate the quality of the research (Couper, 2000). Concerns over response rates, sampling, and controlling the data collection environment have posed serious challenges to online survey researchers. The purpose of the present paper is to offer suggestions for addressing these concerns. After a brief discussion on the formats of online surveys, the author will outline the challenges of conducting online surveys and provide some strategies to overcome these challenges.


2013 ◽  
Vol 31 (15_suppl) ◽  
pp. 6616-6616
Author(s):  
Carrie M Tamarelli ◽  
David D. Howell

6616 Background: Survey research (SR) has been increasing as a percentage of published manuscripts in medical journals. SR plays an important role in studies of quality of life and patient preferences in treatment. Appropriate quality of methodology in SR is critical both to assure reliability and validity of survey results as well as to derive sound generalizations for larger populations from the subsets surveyed. Surveys that have deficient methodological criteria may suffer from significant flaws. A complete description and discussion of quality survey methodology, analysis, and results is essential for a thorough understanding and evaluation of published SR. Methods: Between January 2006 and December 2010, 227 articles in JCO were identified to have either “survey” or “questionnaire” in either the title or abstract. The most recent 52 consecutive articles fulfilling criteria from that time period were reviewed for reporting of survey methodology. A modification of Bennett et al.’s checklist for reporting SR was used for this analysis (Bennett C., et al. Reporting guidelines for survey research: An analysis of published guidance and reporting practices. PLoS Med 8(8): e1001069, 2011.). 35 metrics were used to analyze each survey. These metrics were grouped in the following categories: 1) title and abstract, 2) introduction, 3) methods (research tool, sample selection, survey administration and analysis), 4) results, 5) discussion, and 6) ethical quality indicators. Results: Of the 52 survey articles reviewed, the top quartile reported greater than 72% of the analyzed metrics. Half of the articles contained 63% or more of the desired metrics, and half of the articles had between 42% and 62% of the desired metrics. Some metrics were usually reported, such as ethics board review (reported in 85% of articles), but others were not consistently reported, such as calculation or justification of sample size (neither were reported in 71% of articles). Conclusions: A substantial number of articles reviewed reporting on survey research in JCO did not report critical components of survey methodology. More rigorous quality recommendations should be offered to guide authors in the report of survey research results.


2018 ◽  
Vol 68 (6) ◽  
pp. 235
Author(s):  
Volodymyr M. Moroz ◽  
Volodymyr P. Sadkovyi ◽  
Volodymyr M. Babayev ◽  
Svitlana A. Moroz

Based on the results of the analysis of world experience on the participation of higher education graduates in assessing the quality of educational activities of higher education institutions and the quality of higher education in general, the possibility of including students in expert groups for monitoring the quality of higher education has been substantiated. There was considered the history of implementation the toolkit for surveying the students into the mechanisms of monitoring the higher education quality. Comparative analysis of the domestic experience on attracting the higher education graduates to the assessment of higher education quality with the relevant foreign experience has been conducted. The peculiarities of the organization and conducting of students surveys within the framework of the international consortium "Student experience in the research university" are determined. The authors have considered the prospects of use of the online survey toolkit for the quality control system in higher education, as well as the level of professional activity of universities. The requirements for a software product, that the expert in assessing the quality of higher education can use to ensure the effectiveness of online surveys of students and the guaranteed achievement of the goal of appropriate monitoring are given. The advantages and disadvantages of online surveys of students as a tool for monitoring the quality of higher education have been identified. The benefits of using the cloud service survey by the organizer for development of the questionnaire for students surveys and analysis of the received answers have been proved. In addition, the paper provides conclusions on the possibility of using the online survey of students in the system for quality assurance in higher education both at university and at the state level, as well as practical recommendations on the use of questionnaires for higher education applicants in the framework of mechanisms for monitoring its quality. The directions of further scientific researches concerning the development and using cloud technologies for assessing the level of quality assurance in higher education institutions, the quality of educational activities and higher education as a whole have been formulated.


2021 ◽  
Vol 12 ◽  
Author(s):  
Naoyasu Hirao ◽  
Koyo Koizumi ◽  
Hanako Ikeda ◽  
Hideki Ohira

Online experimental methods are used in psychological studies investigating the perceptions and impressions of facial photographs, even without substantial evidence supporting their reliability and validity. Although, the quality of visual stimuli is more difficult to control remotely, the methods might allow us to obtain a large amount of data. Then the statistical analysis of a larger volume of data may reduce errors and suggest significant difference in the stimuli. Therefore, we analyzed the reliability and validity of online surveys in investigating the perceptions (shine, red, and dark) and impressions (attractiveness, trustworthy, and so on) of facial photographs created from averaged faces with skin tones modified using computer graphics (CG). In this study, we conducted online (Online1) and laboratory experiments with well-controlled conditions (Control). For each experiment, 50 participants (men and women in Japan, age: 20–59years) completed the same questionnaire regarding their impressions of the same 28 CG facial photographs. The results showed significant correlations between the two experiments for all 19 items in the questionnaire. SD in the Online1 compared to the Control from the stimuli and individual differences were 56–84 and 88–104% in each questionnaire items, respectively. Moreover, the rates of mismatching perceptual evaluations to the corresponding physical features demonstrated in the photographs were 4.9–9.7% on average in an additional online survey of another 2,000 participants (Online2). These results suggest that online surveys can be applied to experiments to investigate impressions from CG facial photographs instead of general laboratory experiment by obtaining an appropriate number of participants to offset larger statistical errors that may result from the increased noise in the data from conducting the experiment online.


CCIT Journal ◽  
2014 ◽  
Vol 7 (3) ◽  
pp. 335-354
Author(s):  
Untung Rahardja ◽  
Muhamad Yusup ◽  
Ana Nurmaliana

The accuracy and reliability is the quality of the information. The more accurate and reliable, the more information it’s good quality. Similarly, a survey, the better the survey, the more accurate the information provided. Implementation of student satisfaction measurement to the process of teaching and learning activities on the quality of the implementation of important lectures in order to get feedback on the assessed variables and for future repair. Likewise in Higher Education Prog has undertaken the process of measuring student satisfaction through a distributed questioner finally disemester each class lecture. However, the deployment process questioner is identified there are 7 (seven) problems. However, the problem can be resolved by the 3 (three) ways of solving problems one of which is a system of iLearning Survey (Isur), that is by providing an online survey to students that can be accessed anywhere and anytime. In the implementation shown a prototype of Isur itself. It can be concluded that the contribution Isur system can maximize the decision taken by the Higher Education Prog. By using this Isur system with questions and evaluation forms are submitted and given to the students and the other colleges. To assess the extent to which the campus has grown and how faculty performance in teaching students class, and can be used as a media Isur valid information for an assessment of activities throughout college.


2007 ◽  
Vol 30 (4) ◽  
pp. 66
Author(s):  
N. Tenn-Lyn ◽  
S. Verma ◽  
R. Zulla

We developed and implemented an annual online survey to administer to residents exiting residency training in order to (1) assess the quality of the residency experience and (2) identify areas of strength and areas requiring improvement. Long-term goals include program planning, policy-making and maintenance of quality control. Survey content was developed from an environmental scan, pre-existing survey instruments, examination of training criteria established by the CFPC and the CanMEDS criteria established by the RCPSC. The survey included evaluation benchmarks and satisfaction ratings of program director and faculty, preparation for certification and practice, quality of life, quality of education, and work environment. The response rate was 28%. Seventy-five percent of respondents were exiting from Royal College training programs. Results of descriptive statistics determined that the overall educational experience was rated highly, with 98.9% of respondents satisfied or very satisfied with their overall patient care experience. Ninety-six percent of respondents were satisfied or very satisfied with the overall quality of teaching. Preparation for practice was identified as needing improvement, with 26% and 34% of respondents giving an unsatisfactory rating to career guidance and assistance with finding employment, respectively. Although 80% of respondents reported receiving ongoing feedback and 84% discussed their evaluations with their supervisors, only 38% of evaluations were completed by the end of the rotation. The results indicate that residents are generally satisfied with their experiences during residency training, especially with their overall educational experience. Areas of improvement include preparation for practice and timeliness of evaluations. Further iterations of this survey are needed to refine the instrument, identify data trends and maintain quality control in residency training programs. Frank JR (ed.). The CanMEDS competency framework: better standards, better physicians, better care. Ottawa: The Royal College of Physicians and Surgeons of Canada, 2005. Merritt, Hawkins and Associates. Summary Report: 2003 Survey of final-year medical residents. http://www.merritthawkins.com/pdf/MHA2003residentsurv.pdf. Accessed May 1, 2006. Regnier K, Kopelow M, Lane D, Alden A. Accreditation for learning and change: Quality and improvement as the outcome. The Journal of Continuing Education in the Health Professions 2005; 25:174-182.


Author(s):  
G.B. Lyubomirsky ◽  
T.L. Redinova

This article assesses the reliability, constructive validity and reproducibility of a special questionnaire for determining the quality parameters of rendering physiotherapeutic care to patients with chronic generalized periodontitis. The analysis of literary sources showed that there are studies of quality of dental services, however, we have not met with research into the quality and comfort of physiotherapy procedures for periodontal patients. At the same time, the importance of this issue is obvious and requires study and analysis. Without making judgments about the quality of the service, a full-fledged medical dental procedure can not take place. The assortment of physical devices and methods grows annually, their use in the periodontoloical treatment is not always sufficiently justified, the effectiveness is not always confimed therefore it is important to pay attention not only to the marketing efforts directed by the clinics for comfort, but also to analyze the ideas about the quality of the clinical characteristics of physiotherapeutic procedures.


Author(s):  
Erika Viktória Miszory ◽  
Melinda Járomi ◽  
Annamária Pakai

Abstract Aim The number of Hungarian polio patients can be estimated at approximately 3000. Polio infection is currently affecting people 56–65 years of age. The aim of the study was to reveal the quality of life of patients living with polio virus in Hungary. Subject and methods The quantitative cross-sectional study was conducted in January–April 2017 among polyomyelitis patients living in Hungary. In the non-random, targeted, expert sample selection, the target group was composed of patients infected with poliovirus (N = 268). We have excluded those who refused to sign the consent statement. Our data collection method was an SF-36 questionnaire. Using the IBM SPSS Statistics Version 22 program, descriptive and mathematical statistics (χ2-test) were calculated (p < 0.05). Results The mean age of the members of the examined population is 63.5 years; 68.1% were women and 31.90% were men. The majority of the respondents were infected by the polyovirus in 1956 (11.9%), 1957 (24.3%), and 1959 (19.5%). Polio patients, with the exception of two dimensions (mental health, social operation), on the scale of 100 do not reach the “average” quality of life (physical functioning 23 points, functional role 36 points, emotional role 47 points, body pain 48 points, general health 42 points, vitality 50 points, health change 31 points). Conclusion The quality of life of polio patients is far below the dimensions of physical function, while the difference in mental health compared to healthy people is minimal. It would be important to educate health professionals about the existing disease, to develop an effective rehabilitation method.


Sign in / Sign up

Export Citation Format

Share Document