Evaluate

Reset ◽  
2020 ◽  
pp. 117-124
Author(s):  
Robert Aunger

Evaluating how well a program has worked—has it actually achieved the goal of changing behavior significantly?—is also highly desirable if the field of behavior change is to advance conceptually and become more effective. For this reason, efforts to evaluate programs should be undertaken, not just for research projects. This chapter provides a discussion of how this can be achieved with scientific rigor. Standard research designs are covered, such as Randomized Controlled Trials, as well as less common models. It is also noted that while evaluating whether the desired outcomes were achieved (such as improved public health indicators), it is equally important to understand how those outcomes arose—was it through the activities of the intervention? Can the observed improvements be assigned to the intended effects (e.g., on how people behave and think)?

2015 ◽  
Vol 11 (4) ◽  
pp. 1096-1123 ◽  
Author(s):  
Clare Robertson ◽  
Alison Avenell ◽  
Fiona Stewart ◽  
Daryll Archibald ◽  
Flora Douglas ◽  
...  

Men are underrepresented in obesity services, suggesting current weight loss service provision is suboptimal. This systematic review evaluated evidence-based strategies for treating obesity in men. Eight bibliographic databases and four clinical trials’ registers were searched to identify randomized controlled trials (RCTs) of weight loss interventions in men only, with mean/median body mass index of ≥30 kg/m2 (or ≥28 kg/m2 with cardiac risk factors), with a minimum mean/median duration of ≥52 weeks. Interventions included diet, physical activity, behavior change techniques, orlistat, or combinations of these; compared against each other, placebo, or a no intervention control group; in any setting. Twenty-one reports from 14 RCTs were identified. Reducing diets produced more favorable weight loss than physical activity alone (mean weight change after 1 year from a reducing diet compared with an exercise program −3.2 kg, 95% confidence interval −4.8 to −1.6 kg, reported p < .01). The most effective interventions combined reducing diets, exercise, and behavior change techniques (mean difference in weight at 1 year compared with no intervention was −4.9 kg, 95% confidence interval −5.9 to −4.0, reported p < .0001). Group interventions produced favorable weight loss results. The average reported participant retention rate was 78.2%, ranging from 44% to 100% retention, indicating that, once engaged, men remained committed to a weight loss intervention. Weight loss for men is best achieved and maintained with the combination of a reducing diet, increased physical activity, and behavior change techniques. Strategies to increase engagement of men with weight loss services to improve the reach of interventions are needed.


2021 ◽  
Author(s):  
Hannes Baumann ◽  
Janis Fiedler ◽  
Kathrin Wunsch ◽  
Bettina Wollesen ◽  
Alexander Woll

BACKGROUND Children and adolescents increasingly do not meet physical activity (PA) recommendations. Hence, insufficient physical activity (IPA) and sedentary behavior (SB) among children and adolescents are relevant behavior change domains for using individualized mobile health (mHealth) interventions. OBJECTIVE The current review and meta-analysis investigates the effectiveness of mHealth interventions on IPA and SB with a special focus on age level of individualization. METHODS PubMed, Scopus, Web of Science, SPORTDiscus, and Cochrane Library were searched for randomized controlled trials published between January 2000 and March 2021. mHealth interventions for primary prevention in children and adolescents addressing behavior change regarding insufficient PA and SB were included. Included studies were compared for content characteristics as well as methodological quality and summarized narratively. In addition, a meta-analysis with a subsequent exploratory meta-regression examining the moderating effects of age and individualization on overall effectiveness was performed. RESULTS Based on inclusion criteria, 11 of the preliminary 825 identified studies were included for qualitative synthesis and 10 were included for the meta-analysis. Trials included a total of 1515 participants (Age (M, SD) = 11.69 ± 0.788; 65% male; 35% female) with self-reported (n = 4) or device-based measured (n = 7) health data on the duration of SB and physical inactivity (PIA) for an average of 9.3±5.6 weeks. Studies with high levels of individualization decreased insufficient PA levels significantly (d = 0.33; CI = 0.08, 0.58; z = 2.55; p = 0.01), whereas those with low levels of individualization (d = -0.06; CI = -0.32, 0.20; Z = 0.48; p = 0.63), or targeting SB (d = -0.11; CI = -0.01, 0.23; z = 1.73; p = 0.08) indicated no overall significant effect. Heterogeneity of the studies was moderate to low, and significant subgroup differences between trials with high and low levels of individualization (χ2 = 4.04; df = 1; p = 0.04; I² = 75,2%) were found. Age as a moderator variable showed a small effect, but the results were not significant which might have been due to being underpowered. CONCLUSIONS Evidence suggests that mHealth interventions for children and adolescents can foster moderate reductions in PIA but not SB. Moreover, individualized mHealth interventions to reduce PIA seem more effective for adolescents than for children. Although to date only few mHealth studies address inactive and sedentary young people and their quality of evidence is moderate, these findings indicate the relevance of individualization on the one hand and the difficulties in reducing SB using mHealth interventions on the other hand. CLINICALTRIAL PROSPERO International Prospective Register of Systematic Reviews CRD42020209417; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=209417


Author(s):  
Rachael Jinnette ◽  
Ai Narita ◽  
Byron Manning ◽  
Sarah A McNaughton ◽  
John C Mathers ◽  
...  

ABSTRACT Personalized nutrition (PN) behavior-change interventions are being used increasingly in attempts to improve dietary intake; however, the impact of PN advice on improvements in dietary intake has not been reviewed systematically. The aim of this systematic review was to evaluate the effect of PN advice on changes in dietary intake compared with generalized advice in healthy adults. Three databases (EMBASE, PubMed, and CINAHL) were searched between 2009 and 2020 for randomized controlled trials (RCTs) that tested the effect of PN and tailored advice based on diet, phenotype, or genetic information. The Evidence Analysis Library Quality Criteria checklist was used to conduct a risk-of-bias assessment. Information on intervention design and changes in nutrients, foods, and dietary patterns was extracted from the 11 studies meeting the inclusion criteria. Studies were conducted in the United States, Canada, or Europe; reported outcomes on 57 to 1488 participants; and varied in follow-up duration from 1 to 12 mo. Five studies incorporated behavior-change techniques. The risk of bias for included studies was low. Overall, the available evidence suggests that dietary intake is improved to a greater extent in participants randomly assigned to receive PN advice compared with generalized dietary advice. Additional well-designed PN RCTs are needed that incorporate behavior-change techniques, a broader range of dietary outcomes, and comparisons between personalization based on dietary, biological, and/or lifestyle information.


Sign in / Sign up

Export Citation Format

Share Document