Does User Choice of Device Impact the Results of Online Surveys?

Author(s):  
Helge Nissen ◽  
Monique Janneck

This article investigates how and to what extent the data collected, the dropout rate, and the completion time in online surveys is influenced by the device used to fill out the questionnaire. To that end, an extensive online study with N=1493 was carried out. To address difficulties associated with the use of devices with smaller displays, different layout variants aimed at optimizing questionnaire usability for smartphones were developed and analyzed. Completion time, drop-out rate, and response patterns were compared across different display sizes and layout variants. Results show significantly lower completion times and drop-out rates when the questionnaire was answered on a larger display. Also, different answering patterns emerged among participants using mobile devices. Likewise, the study revealed effects of different questionnaire layouts. The authors discuss implications for the design of online questionnaire in order to obtain reliable data from online surveys.

2018 ◽  
Vol 37 (3) ◽  
pp. 435-445
Author(s):  
Rebecca Hofstein Grady ◽  
Rachel Leigh Greenspan ◽  
Mingnan Liu

Across two studies, we aimed to determine the row and column size in matrix-style questions that best optimizes participant experience and data quality for computer and mobile users. In Study 1 ( N = 2,492), respondents completed 20 questions (comprising four short scales) presented in a matrix grid (converted to item-by-item format on mobile phones). We varied the number of rows (5, 10, or 20) and columns (3, 5, or 7) of the matrix on each page. Outcomes included both data quality (straightlining, item skip rate, and internal reliability of scales) and survey experience measures (dropout rate, rating of survey experience, and completion time). Results for row size revealed dropout rate and reported survey difficulty increased as row size increased. For column size, seven columns increased the completion time of the survey, while three columns produced lower scale reliability. There was no interaction between row and column size. The best overall size tested was a 5 × 5 matrix. In Study 2 ( N = 2,570), we tested whether the effects of row size replicated when using a single 20-item scale that crossed page breaks and found that participant survey ratings were still best in the five-row condition. These results suggest that having around five rows or potentially fewer per page, and around five columns for answer options, gives the optimal survey experience, with equal or better data quality, when using matrix-style questions in an online survey. These recommendations will help researchers gain the benefits of using matrices in their surveys with the least downsides of the format.


2015 ◽  
Vol 63 (2) ◽  
pp. 117-124 ◽  
Author(s):  
Max Böckermann ◽  
Annika Gieselmann ◽  
Marjolijn Sorbi ◽  
Reinhard Pietrowsky
Keyword(s):  
Drop Out ◽  

Hintergrund: Dieser Artikel beschreibt die Entwicklung eines internetbasierten begleiteten Selbsthilfetrainings (Albtraumcoach) zur Bewältigung von Albträumen, das innerhalb zweier Pilotstudien auf seine Durchführbarkeit und Anwendbarkeit getestet wurde. Methoden: Innerhalb eines neunstufigen Modells wird die Entwicklung der Intervention beschrieben. Dabei wird neben der wissenschaftlichen Evidenz, die die Basis für die Intervention bildet, auf technische, ethische, datenschutzrechtliche und weitere spezifische Maßnahmen innerhalb der Interventionsentwicklung eingegangen. In zwei Pilotstudien evaluierten zudem 10 Personen mit schlechten Träumen in der Vergangenheit die Durchführbarkeit (Studie 1) und 12 Personen mit wiederkehrenden Albträumen die Anwendbarkeit sowie den Nutzen der Intervention (Studie 2). Abhängige Variablen waren die Qualität der einzelnen Sitzungen, die Zufriedenheit mit der Intervention sowie Albtraumfrequenz, Albtraumbelastung, Schlafqualität und Depressivität. Ergebnisse und Diskussion: Die Durchführbarkeit und Anwendbarkeit des Trainings wurden positiv beurteilt. Während die Drop-out-Rate verhältnismäßig hoch war, ergaben sich erste, zurückhaltend zu beurteilende, Hinweise für einen Nutzen der Intervention.


Author(s):  
Stephanie Kunz ◽  
Michael Schulz ◽  
Gabriele Syrbe ◽  
Martin Driessen

<B>Fragestellung:</B> Lässt die wissenschaftliche Datenlage positive Behandlungseffekte durch Ohrakupunktur in der Entzugsbehandlung von Alkohol- und Opiatabhängigen erwarten? </P><P> <B>Methodik:</B> Die im Rahmen der Recherche gefundenen Studien bezogen sich auf den Entzug von Alkohol (sechs) und von Kokain und Opiaten (acht). Die Studien wurden auf ihre methodische Qualität hin überprüft. </P><P> <B>Ergebnisse:</B> Es konnten 14 randomisierte kontrollierte Studien (RCT) zu Ohrakupunktur in der Behandlung von Alkohol- und Opiatabhängigkeit identifiziert werden. Dabei weisen die meisten Studien methodische Mängel auf. Ein Vergleich der Studien ist aufgrund unterschiedlicher Paradigmen kaum möglich, die Drop Out Rate liegt häufig über 20%. </P><P> <B>Schlussfolgerung:</B> Insgesamt reicht die verfügbare wissenschaftliche Datenlage nicht aus, um eine positive Wirkung der Akupunktur bei substanzbezogenen Störungen als gesichert anzunehmen.


2012 ◽  
Vol 21 (5-6) ◽  
pp. 145-172
Author(s):  
Yair Galily ◽  
Orly Kayam ◽  
Michael Bar-Eli

Abstract Human resources are the most crucial element in the selection of suitable fitness instruction trainers (FIT) and the results of the screening process impact greatly on the entire physical training system in the Israeli army, both in the short-term and the long-term (potential officers, young officers and developing and veteran officers). The aim of the current study is to examine the effectiveness, validity and reliability of the screening process for acceptance to the female fitness instructors training course in the Israel Defense Forces (IDF). The screening process aims to identify those that are most suitable from a large pool of candidates, in order to ensure the highest possible level of candidates and the lowest possible drop-out rate from the training course and subsequent army service. The paper examines the reliability of the classification exam currently administered in the course and its validity in predicting those candidates who will succeed in the course and in their assignments afterwards. The sample is based on a data analysis of nine screening dates over three years (three each year). The evaluation of validity is based on the relationship between the course entrance exam grades (administered a year before enlistment), exam grades at the beginning of the course and additional data relating to success in the field.


2020 ◽  
Vol 4 (Supplement_1) ◽  
pp. 950-950
Author(s):  
Jamie Rincker ◽  
Jessica Wallis ◽  
Angela Fruik ◽  
Alyssa King ◽  
Kenlyn Young ◽  
...  

Abstract Recommendations for older adults to socially isolate during the COVID-19 pandemic will have lasting impacts on body weight and physical activity. Due to the pandemic, two in-person RCT weight-loss interventions in obese older adults with prediabetes, Veterans Achieving Weight Loss and Optimizing Resilience-Using Protein (VALOR-UP, n=12) and the Egg-Supplemented Pre-Diabetes Intervention Trial (EGGSPDITE, n=7), were converted to remote formats and weekly nutrition (EGGSPDITE and VALOR-UP) and exercise (VALOR-UP only) classes were delivered using synchronous videoconference technology (Webex); classes were accessed via tablet/desktop/laptop or smart phone. Steps taken to transition participants to remote formats included technology training, implementation of staff tech-support, and delivery of nutrition education, tablets, scales, and exercise bands. The time to successfully transition participants was 1 week for early adopters (n=10) and up to 4 weeks for those with significant technology barriers (n=9); their difficulties included internet access, camera and microphone access and use, and electronic submission of weight and food records. Even with these challenges, in the first 3 months of remote delivery, participant dropout rate was low (10.5%, n=2), attendance was high (87.6% nutrition class (n=19); 76.4% exercise class (VALOR-UP, n=12)), and weight loss was successful (&gt;2.5% loss (n=13); &gt;5% loss (n=8)), showing that lifestyle interventions can be successfully adapted for remote delivery. Remote interventions also have potential for use in non-pandemic times to reach underserved populations who often have high drop-out rates due to caretaker roles, transportation limitations, and work schedules. These barriers were significantly reduced using a virtual intervention platform.


2021 ◽  
pp. 1-19
Author(s):  
Nina Lindblom ◽  
Lars Lindquist ◽  
Jacob Westman ◽  
Mikael Åström ◽  
Roger Bullock ◽  
...  

Background: Accumulating data suggest infectious agents are involved in Alzheimer’s disease (AD). The two primary aims of this trial were to assess safety and efficacy of an antiviral drug combination on AD progression. Objective: The trial evaluated whether Apovir, a combination of two antiviral agents, pleconaril (active on enteroviruses) and ribavirin (active on several viruses), could slow AD progression. Methods: Sixty-nine patients 60–85 years were treated with Apovir or placebo for 9 months and followed until 12 months after end of treatment. Cognitive tests, safety, biomarkers, drug plasma, and cerebrospinal fluid concentrations were assessed. Results: The tolerability of Apovir was compromised as demonstrated by the large drop-out rate and increased frequency and severity of adverse events. The primary endpoint, demonstrating a difference in change from baseline to 9 months between groups in ADAS-cog total score, was not met (p = 0.1809). However, there were observations indicating potential effects on both ADAS-cog and CDR-SB but these effects need to be verified. Also, there was a decrease in cerebrospinal fluid amyloid-β in Apovir at 9 months (p = 0.0330) but no change in placebo. Conclusion: This was the first randomized, placebo controlled clinical trial exploring antiviral treatment on AD progression. The trial is considered inconclusive due to the large drop-out rate. New trials are needed to verify if the indications of effect observed can be confirmed and which component(s) in Apovir contributed to such effects. Pleconaril alone may be studied to improve the tolerability and to verify if enterovirus is involved in the disease process.


2014 ◽  
Vol 42 (6) ◽  
pp. 747-759 ◽  
Author(s):  
Stella W. Y. Chan ◽  
Malcolm Adams

Background: The IAPT services provide high and low intensity psychological treatments for adults suffering from depression and anxiety disorders using a stepped care model. The latest national evaluation study reported an average recovery rate of 42%. However, this figure varied widely between services, with better outcomes associated with higher “step-up” rates between low and high intensity treatments. Aims: This study aimed to compare the two intensity groups in an IAPT service in Suffolk. Method: This study adopted a between groups design. A sample of 100 service users was randomly selected from the data collected from an IAPT service in Suffolk between May 2008 and February 2011. The treatment outcomes, drop-out rate, and other characteristics were compared between those who received high and low intensity treatments. Results: The high intensity group received, on average, more sessions and contact time. They received more CBT sessions and less guided self-help. There were no group differences in terms of the drop-out and appointment cancellation rates. Analyses on clinical outcomes suggested no group difference but demonstrated an overall recovery rate of 52.6% and significant reduction in both depression and anxiety symptoms. Conclusions: Despite methodological limitations, this study concludes that the service as a whole achieved above-average clinical outcomes. Further research building upon the current study in unpacking the relative strengths and weaknesses for the high and low intensity treatments would be beneficial for service delivery.


1994 ◽  
Vol 11 (4) ◽  
pp. 180-182
Author(s):  
Gerry Lynch ◽  
Margaret McKee ◽  
Daniel M Brennan

AbstractObjective: To examine the service utilisation of a newly opened psychiatric day centre. We wished to determine if different diagnostic groups had different perspectives of the day centre, and to see if the drop-out rate differed among clients with neurotic or psychotic disorders.Method: Demographic and diagnostic data was gathered for all clients referred in the first year of operation of the day centre. Those who defaulted from attendance were visited at home and asked to detail reasons for non-attendance. Those who continued to attend 16 months after the centre opened completed a satisfaction survey.Results: The drop-out rate was high for both clients with neurotic and psychotic disorders. Clients who continued to attend were very positive about the day centre. Both client groups saw the benefits of attendance in social rather than therapeutic terms.Conclusions: Consumer opinion may have a valuable part to play in overall measure,measurement of service quality, particularly if it includes the opinion of those who no longer use that service.


PEDIATRICS ◽  
1989 ◽  
Vol 83 (3) ◽  
pp. 336-336
Author(s):  
Student

Eighty percent of students entering school feel good about themselves and who they are. By the fifth grade only 20 percent have high self-esteem. By the time students become seniors in high school, the percentage who have managed to keep a positive level of self-esteem has dropped to 5 percent. Students encounter the equivalent of 60 days each year reprimanding, nagging and punishment. During 12 years of schooling a student is subject to 15,000 negative statements. That's three times the amount of positive statements received.


Author(s):  
İsmail Volkan Gülüm

Schema therapy (ST) is a relatively new, but promising, psychotherapy approach. Able to be implemented in both individual and group settings, research findings suggest that ST is a highly effective treatment for personality disorders. As in other treatments for personality disorders, some patients decide to drop out from treatment, feeling they did not benefit. To date, there has been no study in the literature that investigates the dropout rates across ST studies specifically. Consequently, this study systematically researched eight different ST studies in which dropout rates were reported. Together, these studies featured both individual and group therapy settings, inpatient and outpatient settings, and different personality disorder diagnoses. The weighted mean dropout rate was 23.3%, 95% CI (14.8-31.7%) across these studies. Although this finding is very similar to those meta-analyses that obtained their dropout rates from different orientations and diagnoses, namely psychotherapy in general, ST’s dropout rates might be significantly lower than studies that included personality disorders in particular.


Sign in / Sign up

Export Citation Format

Share Document