scholarly journals Quality control questions on Amazon’s Mechanical Turk (MTurk): A randomized trial of impact on the USAUDIT, PHQ-9, and GAD-7

2021 ◽  
Author(s):  
Jon Agley ◽  
Yunyu Xiao ◽  
Rachael Nolan ◽  
Lilian Golzarri-Arroyo
Keyword(s):  
Quality Control ◽  
Controlled Trial ◽  
Screening Tools ◽  
Mechanical Turk ◽  
Task Completion ◽  
Randomized Controlled ◽  
The Us ◽  
Outcome Scores ◽  
Patient Health ◽  
Amazon's Mechanical Turk

AbstractCrowdsourced psychological and other biobehavioral research using platforms like Amazon’s Mechanical Turk (MTurk) is increasingly common – but has proliferated more rapidly than studies to establish data quality best practices. Thus, this study investigated whether outcome scores for three common screening tools would be significantly different among MTurk workers who were subject to different sets of quality control checks. We conducted a single-stage, randomized controlled trial with equal allocation to each of four study arms: Arm 1 (Control Arm), Arm 2 (Bot/VPN Check), Arm 3 (Truthfulness/Attention Check), and Arm 4 (Stringent Arm – All Checks). Data collection was completed in Qualtrics, to which participants were referred from MTurk. Subjects (n = 1100) were recruited on November 20–21, 2020. Eligible workers were required to claim U.S. residency, have a successful task completion rate > 95%, have completed a minimum of 100 tasks, and have completed a maximum of 10,000 tasks. Participants completed the US-Alcohol Use Disorders Identification Test (USAUDIT), the Patient Health Questionnaire (PHQ-9), and a screener for Generalized Anxiety Disorder (GAD-7). We found that differing quality control approaches significantly, meaningfully, and directionally affected outcome scores on each of the screening tools. Most notably, workers in Arm 1 (Control) reported higher scores than those in Arms 3 and 4 for all tools, and a higher score than workers in Arm 2 for the PHQ-9. These data suggest that the use, or lack thereof, of quality control questions in crowdsourced research may substantively affect findings, as might the types of quality control items.

scholarly journals Examining the Efficacy of an Online Program to Cultivate Mindfulness and Self-Compassion Skills (Mind-OP): Randomized Controlled Trial on Amazon’s Mechanical Turk

2020 ◽  
Author(s):  
Shadi Beshai
Keyword(s):  
Randomized Controlled Trial ◽  
Perceived Stress ◽  
Controlled Trial ◽  
Mechanical Turk ◽  
Face To Face ◽  
Randomized Controlled ◽  
Self Compassion ◽  
Intent To Treat ◽  
Amazon's Mechanical Turk ◽  
The Mind

Objectives: The demand for effective psychological treatments for depression, anxiety, and heightened stress is far outstripping their supply. Accordingly, internet delivered, self-help interventions offer hope to many people, as they can be easily accessed and at a fraction of the price of face-to-face options. Mindfulness and self-compassion are particularly exciting approaches, as evidence suggests interventions that cultivate these skills are effective in reducing depression, anxiety, and heightened stress. We examined the efficacy of a newly developed program that combines mindfulness and self-compassion exercises into a brief self-guided intervention (Mind-OP). The secondary aim of this study was to investigate the feasibility of conducting a randomized-controlled trial entirely on a popular crowdsourcing platform, Amazon’s Mechanical Turk (MTurk). Methods: We randomized 456 participants reporting heightened depression, anxiety, or stress to one of two conditions: the 4-week Mind-OP intervention (n= 227) or to an active control condition (n =229) where participants watched nature videos superimposed onto relaxing meditation music for four consecutive weeks. We administered measures of anxiety, depression, perceived stress, dispositional and state mindfulness, self-compassion, and nonattachment. Results: Intent-to-treat and per-protocol analyses revealed that, compared to participants in the control condition, participants in the Mind-OP intervention condition reported significantly less anxiety and stress at the end of the trial, as well as significantly greater mindfulness, self-compassion, and nonattachment. Conclusions: Mind-OP appears efficacious in reducing anxiety symptoms and perceived stress among MTurk participants. We highlight issues (e.g., attrition) related to feasibility of conducting randomized trials on crowdsourcing platforms such as MTurk.

Clinical Research on Antioxidant-Based Modalities in 2021

2021 ◽  
Vol 11 ◽  
Author(s):  
Editorial Office ROS
Keyword(s):  
Vitamin C ◽  
Mediterranean Diet ◽  
Mendelian Randomization ◽  
Causal Effect ◽  
Biological Activities ◽  
Controlled Trial ◽  
Positive Finding ◽  
Randomized Controlled ◽  
The Us ◽  
Anti Inflammatory

Being updated biweekly till the end of the year, this Education & Resources web page lists major clinical studies on antioxidant-based modalities or related entities in disease intervention and health promotion, which have been published in highly influential journals during 2021. It should be noted that this is not intended to be a complete list, but is rather to focus on rigorously designed and well conducted high-profile randomized controlled trials (RCTs) whose findings were reported in medical or bioscience journals of the highest impact. For more comprehensive information on antioxidant-based clinical trials, the reader may refer to the ClinicalTrials.gov (https://clinicaltrials.gov), the largest clinical trials database, run by the US National Library of Medicine, that holds registrations from over 368,000 trials from 219 countries. 2021 LIST IN REVERSE CHRONOLOGICAL ORDER Xu et al. Edaravone dexborneol versus edaravone alone for the treatment of acute ischemic stroke: a phase III, randomized, double-blind, comparative trial. Stroke 2021 Mar; 52(3):772-780. doi: https://dx.doi.org/10.1161/STROKEAHA.120.031197. Key finding: Edaravone dexborneol (a combination of edaravone and borneol) was superior to edaravone alone in improving the clinical outcomes of the acute ischemic stroke patients. Note: Edaravone, a synthetic free radical scavenger, was approved by the US FDA in 2017 for treating amyotrophic lateral sclerosis (ALS). Borneol is a phytochemical with diverse biological activities including antioxidative and anti-inflammatory effects. Kim et al. Reactive oxygen species scavenger in acute intracerebral hemorrhage patients: a multicenter, randomized controlled trial. Stroke 2021 Feb 25; doi: https://doi.org/10.1161/STROKEAHA.120.032266. Key finding: Giving N-acetylcysteine 2000 mg/day and selenium 1600 µg/day, intravenously, for 14 days significantly improved the clinical outcomes in the acute intracerebral hemorrhage patients. Note: N-Acetylcysteine is a precursor of glutathione (GSH). Selenium acts as an antioxidant element due, at least partly, to its essentialness for the function of various selenoproteins, including selenium-dependent glutathione peroxidases (GPx). Kalstad et al. Effects of n-3 fatty acid supplements in elderly patients after myocardial infarction: a randomized, controlled trial. Circulation 2021 Feb 9; 143(6):528-539. doi: https://dx.doi.org/10.1161/CIRCULATIONAHA.120.052209. Key finding: Null Note: n-3 Fatty acids, also known as omega-3 fatty acids, possess potent antioxidative and anti-inflammatory activities. Lynch et al. Safety and efficacy of omaveloxolone in Friedreich ataxia (MOXIe Study). Ann Neurol 2021 Feb; 89(2):212-225. doi: https://dx.doi.org/10.1002/ana.25934. Key finding: Omaveloxolone significantly improved neurological function compared to placebo and is well tolerated. Note: Omaveloxolone, a synthetic oleanane triterpenoid, is an activator of Nrf2, the chief regulator of cellular antioxidant and other cytoprotective genes. Meir et al. Effect of green-Mediterranean diet on intrahepatic fat: the DIRECT PLUS randomised controlled trial. Gut 2021 Jan 18; gutjnl-2020-323106. doi: https://dx.doi.org/10.1136/gutjnl-2020-323106. Key finding: Green-Mediterranean diet enriched with green plants and polyphenols improved non-alcoholic fatty liver disease (NAFLD). Note: Mediterranean diet and green plants (green tea) and nuts are rich in antioxidants and anti-inflammatory compounds and possess many health benefits, especially cardiovascular protection. However, the exact contribution of antioxidant components to the health benefits of Mediterranean diet remains to be established. Rinott et al. Effects of diet-modulated autologous fecal microbiota transplantation on weight regain. Gastroenterology 2021 Jan; 160(1):158-173.e10. doi: https://dx.doi.org/10.1053/j.gastro.2020.08.041. Key finding: Polyphenol-enriched diet-modulated autologous fecal microbiota transplantation attenuated weight regain and preserved glycemic control. Note: Dietary polyphenols possess antioxidative, anti-inflammatory, and many other biological activities. Zheng et al. Plasma vitamin C and type 2 diabetes: genome-wide association study and Mendelian randomization analysis in European populations. Diabetes Care 2021 Jan; 44(1):98-106. doi: https://dx.doi.org/10.2337/dc20-1328. Key finding: Null; no evidence to support an efficacy of vitamin C supplement in type 2 diabetes prevention. Note: Vitamin C is a multitasking compound; it is an antioxidant, but also possesses many other biological functions. According to Dr Davey Smith,  Mendelian randomization is a method of using measured variation in genes of known function to examine the causal effect of a modifiable exposure on disease in observational studies (from the US CDC website: https://cdc.gov). A positive finding in a Mendelian randomization study provides strong evidence for a causal relationship. Luo et al. Diet-derived circulating antioxidants and risk of coronary heart disease: a Mendelian randomization study. J Am Coll Cardiol 2021 Jan 5; 77(1):45-54. doi: https://dx.doi.org/10.1016/j.jacc.2020.10.048. Key finding: Null Note: According to Dr Davey Smith,  Mendelian randomization is a method of using measured variation in genes of known function to examine the causal effect of a modifiable exposure on disease in observational studies (from the US CDC website: https://cdc.gov). A positive finding in a Mendelian randomization study provides strong evidence for a causal relationship.

scholarly journals A Randomized Controlled Trial to Evaluate and Assess the Effect of Comprehensive Pre-End Stage Kidney Disease Education on Home Dialysis Use in Veterans, Rationale and Design

2021 ◽  
Author(s):  
Ashutosh M. Shukla ◽  
Jennifer Hale-Gallardo ◽  
Tatiana Orozco ◽  
Ivette Freytes ◽  
Sergio Romero ◽  
...  
Keyword(s):  
Kidney Disease ◽  
Controlled Trial ◽  
End Stage Kidney Disease ◽  
Patient Centered ◽  
Advanced Chronic Kidney Disease ◽  
Home Dialysis ◽  
Clinical Patient ◽  
Randomized Controlled ◽  
The Us ◽  
End Stage

Abstract Background Informed dialysis selection and greater home dialysis use are the two long-desired, underachieved targets of advanced chronic kidney disease care in the US healthcare system. Observational institutional studies have shown that comprehensive pre-end stage kidney disease (ESKD) disease education (CPE) can improve both these outcomes. However, lack of validated protocols, well-controlled studies, and systemic models have limited wide-spread adoption of CPE in the US. We hypothesized that a universal CPE and patient-centered initiation of renal replacement therapy can improve multiple clinical, patient-centered and health service outcomes in advanced chronic kidney disease (CKD) and ESKD.Methods Trial to Evaluate and Assess the effects of CPE on Home dialysis in Veterans (TEACH-VET) is a mixed method randomized controlled trial aimed to evaluate the effects of a system-based approach for providing CPE to all Veterans with advanced CKD across a regional healthcare System. The study will randomize 544 Veterans with non-dialysis stage 4 and 5 CKD in a 1:1 allocation stratified by their annual family income and the stage of CKD to an intervention (CPE) arm or control arm. Intervention arm will receive a two-phase CPE in an intent-to-teach manner. Control arm will receive usual clinical care supplemented by resources for the freely-available kidney disease information. Participants will be followed after intervention/control for the duration of the study or until 90-days post-ESKD, whichever occurs earlier.Results The primary outcome will assess the proportion of Veterans using home dialysis at 90-days post-ESKD, and secondary outcomes will include post-intervention/control CKD knowledge, confidence in dialysis decision and home dialysis selection. Qualitative arm of the study will use semi-structured interviews to in-depth assess Veterans’ satisfaction with the intervention, preference for delivery, and barriers and facilitators to home dialysis selection and use. Several post-ESKD clinical, patient-centered and health services outcomes will be assessed 90-days post-ESKD as additional secondary outcomes.Conclusion The results will provide evidence regarding the need and efficacy of a system-based, patient-centered approach towards universal CPE for all patients with advanced CKD. If successful, this may provide a blueprint for developing such programs across the similar healthcare infrastructures throughout the country.Trial registration: NCT04064086

The effects of a multi-component dyadic intervention on the psychological distress of family caregivers providing care to people with dementia: a randomized controlled trial

2015 ◽  
Vol 27 (12) ◽  
pp. 2031-2044 ◽  
Author(s):  
Anna-Eva Prick ◽  
Jacomine de Lange ◽  
Jos Twisk ◽  
Anne Margriet Pot
Keyword(s):  
Randomized Controlled Trial ◽  
Physical Exercise ◽  
Family Caregivers ◽  
Controlled Trial ◽  
Skills Training ◽  
Community Dwelling ◽  
Randomized Controlled ◽  
People With Dementia ◽  
The Us ◽  
Person With Dementia

ABSTRACTBackground:Earlier research showed that multi-component dyadic interventions – including a combination of intervention strategies and addressing both the person with dementia and caregiver – have a beneficial impact on the mental and physical health of people with dementia and their family caregivers. A randomized controlled trial (RCT) of a multi-component dyadic intervention, which is a translated and adapted version of an intervention that has been shown to be effective in the US by Teri et al. (2003), was performed. The effects on caregivers’ mood (primary outcome), burden, general health, and salivary cortisol levels (secondary outcomes) were studied.Methods:Community-dwelling people with dementia and their family caregivers (N = 111 dyads) were randomly assigned. The experimental group received eight home visits during three months, combining physical exercise and support (psycho-education, communication skills training, and planning of pleasant activities). Both the physical exercise and support component were directed at both the person with dementia and the caregiver. The comparison group received monthly information bulletins and phone calls. There were three measurements at baseline (prior to the intervention), at three months, and at six months into the intervention. Data were analyzed with Generalized Estimating Equations (GEE) based on an intention-to-treat analysis of all available data.Results:All analyses showed no benefits of the intervention over time on any of the outcomes.Conclusion:The negative results might be explained by the translation and adaptation of the intervention that has been shown to be effective in the US: the intervention was shortened and did not include cognitive reframing. However, only the health effects on people with dementia and not on caregivers were studied in the US. Several other factors might also have played a role, which are important for future studies to take into account. These are: the usual health care in the country or region of implementation; the wishes and needs of participants for specific intervention components; the room for improvement regarding these components; the inclusion of positive outcome measures, such as pleasure, and the quality of the relationship.

scholarly journals An analysis of productivity app strengths: An environmental scan

2021 ◽  
Author(s):  
Harshdeep Dhaliwal ◽  
Kundan Ahluwalia ◽  
Dana Kukje Zada ◽  
Daphne Qin ◽  
Rameen Tanveer ◽  
...  
Keyword(s):  
Controlled Trial ◽  
Muscle Relaxation ◽  
Research Question ◽  
Grey Literature ◽  
Harvard Business Review ◽  
Screening Tools ◽  
Literature Information ◽  
Randomized Controlled ◽  
Business Source Premier ◽  
Reducing Stress

BACKGROUNDIn recent years, productivity apps have become the most commonly used apps. While some may feel productivity apps work solely as a result of the placebo effect , productivity apps have been shown to have three major benefits: accountability, assessment, and improvement. Stress levels were especially reduced in the two meditation groups as opposed to the muscle relaxation group . Furthermore, there has been reported evidence on the effectiveness of app-based meditation and mindfulness in reducing stress and increasing productivity for users.METHODSIn order to answer the research question, published articles from ProQuest, Business Source Premier and Web of Science were used. Additionally, Harvard Business Review was also used as a source of grey literature. Information was collected in order to determine the strengths of competing productivity apps and how they could limit or be applied to the Felicity App. The research was reviewed based on screening tools that assessed validity and relevance. Included studies were published within Asia, North America, Australia, or Europe, and were either quantitative, qualitative, randomized controlled trial (RCT), surveys, experiments with participants, or academic studies. Study screening and extraction were completed independently among two authors. Disagreements following reconciliation between the two authors were settled by a third author.RESULTSThe selected articles discuss information including methods of improving productivity, mobile-based interventions that are effective at improving either overall health or productivity, and techniques that may be applicable to the Felicity App as a mobile-based intervention.CONCLUSIONThe results show that the Felicity App can improve user outcomes by integrating features from other applications.

Sign in / Sign up

Export Citation Format

Share Document