scholarly journals Challenges and opportunities in evaluating programmes incorporating human-centred design: lessons learnt from the evaluation of Adolescents 360

2019 ◽  
Vol 3 ◽  
pp. 1472
Author(s):  
Aoife M. Doyle ◽  
Emma Mulhern ◽  
James Rosen ◽  
Gabrielle Appleford ◽  
Christina Atchison ◽  
...  

Adolescents 360 (A360) is a four-year initiative (2016–2020) to increase 15-19-year-old girls’ use of modern contraception in Nigeria, Ethiopia and Tanzania. The innovative A360 approach is led by human-centred design (HCD), combined with social marketing, developmental neuroscience, public health, sociocultural anthropology and youth engagement ‘lenses’, and aims to create context-specific, youth-driven solutions that respond to the needs of adolescent girls. The A360 external evaluation includes a process evaluation, quasi-experimental outcome evaluation, and a cost-effectiveness study. We reflect on evaluation opportunities and challenges associated with measuring the application and impact of this novel HCD-led design approach. For the process evaluation, participant observations were key to capturing the depth of the fast-paced, highly-iterative HCD process, and to understand decision-making within the design process. The evaluation team had to be flexible and align closely with the work plan of the implementers. The HCD process meant that key information such as intervention components, settings, and eligible populations were unclear and changed over outcome evaluation and cost-effectiveness protocol development. This resulted in a more time-consuming and resource-intensive study design process. As much time and resources went into the creation of a new design approach, separating one-off “creation” costs versus those costs associated with actually implementing the programme was challenging. Opportunities included the potential to inform programmatic decision-making in real-time to ensure that interventions adequately met the contextualized needs in targeted areas. Robust evaluation of interventions designed using HCD, a promising and increasingly popular approach, is warranted yet challenging. Future HCD-based initiatives should consider a phased evaluation, focusing initially on programme theory refinement and process evaluation, and then, when the intervention program details are clearer, following with outcome evaluation and cost-effectiveness analysis. A phased approach would delay the availability of evaluation findings but would allow for a more appropriate and tailored evaluation design.

2019 ◽  
Vol 3 ◽  
pp. 1472
Author(s):  
Aoife M. Doyle ◽  
Emma Mulhern ◽  
James Rosen ◽  
Gabrielle Appleford ◽  
Christina Atchison ◽  
...  

Adolescents 360 (A360) is a four-year initiative (2016–2020) to increase 15-19-year-old girls’ use of modern contraception in Nigeria, Ethiopia and Tanzania. The innovative A360 approach is led by human-centred design (HCD), combined with social marketing, developmental neuroscience, public health, sociocultural anthropology and youth engagement ‘lenses’, and aims to create context-specific, youth-driven solutions that respond to the needs of adolescent girls. The A360 external evaluation includes a process evaluation, quasi-experimental outcome evaluation, and a cost-effectiveness study. We reflect on evaluation opportunities and challenges associated with measuring the application and impact of this novel HCD-led design approach. For the process evaluation, participant observations were key to capturing the depth of the fast-paced, highly-iterative HCD process, and to understand decision-making within the design process. The evaluation team had to be flexible and align closely with the work plan of the implementers. The HCD process meant that key information such as intervention components, settings, and eligible populations were unclear and changed over outcome evaluation and cost-effectiveness protocol development. This resulted in a more time-consuming and resource-intensive study design process. As much time and resources went into the creation of a new design approach, separating one-off “creation” costs versus those costs associated with actually implementing the programme was challenging. Opportunities included the potential to inform programmatic decision-making in real-time to ensure that interventions adequately met the contextualized needs in targeted areas. Robust evaluation of interventions designed using HCD, a promising and increasingly popular approach, is warranted yet challenging. Future HCD-based initiatives should consider a phased evaluation, focusing initially on programme theory refinement and process evaluation, and then, when the intervention program details are clearer, following with outcome evaluation and cost-effectiveness analysis. A phased approach would delay the availability of evaluation findings but would allow for a more appropriate and tailored evaluation design.


Author(s):  
Antoine Millet ◽  
Audrey Abi Akle ◽  
Dimitri Masson ◽  
Jérémy Legardeur

AbstractProduct success depends on its capacity to meet users’ expectations. Human Centred Design approach helps to reach this success by focussing on users’ needs in the design process. These needs are as well functional as hedonic. Designing products requires then to design hedonic properties affecting users’ perception. For sport products, people wants to improve their performances while maintaining their health. Sport products are then considered not only “sporty” but also “healthy”. Thus, integrating both health and sport expectations into the design process are necessary.Last decades, Affective Engineering was developed to integrate perception into the design process. Applying this approach for sport products may allow defining and mixing sport and health perceptual characteristics all along the design process. However, defining these characterisitics into requirements implies to translate them into semantic terms. If we observe semantic descriptors for sport products and for health products, they seem opposite. In this paper, we aim defining a semantic space representative and respectful of both domains, sport and health, while they oppose.


Author(s):  
Ammer Harb

Human Centred Design is a significant approach in design. It increases the value of design as well as helping businesses to overcome the challenges of not meeting user needs. However, the abundance of Human Centred Design tools and the difficulty to discriminate between them have created the urge to develop selection framework for these tools in regard to the design process. In this paper, I present a framework to assist in selecting Human Centred Design tools. I highlight the significance of the Human Centred Design approach. I also explain the theoretical background behind creating the framework. Then I describe the participatory design workshop method I used to support and validate the results of the theoretical background in order to further develop the selection framework. This framework can be adopted in the design field in order to facilitate the process and to support practitioners’ decisions to select suitable tools.


2021 ◽  
Author(s):  
Rebeccah Bartlett ◽  
Jacqueline Boyle ◽  
Jessica Simons Smith ◽  
Nadia Khan ◽  
Tracy Robinson ◽  
...  

Abstract Background: Australian women from migrant and refugee communities experience reduced access to sexual and reproductive healthcare. Human-centred design is an ethical and effective approach to developing health solutions with underserved populations that are more likely to experience significant disadvantage or social marginalisation. This study aimed to evaluate how well Shifra, a small Australian-based not-for-profit, applied human-centred design when developing a web-based application that delivers local, evidence-based and culturally relevant health information to its non-English speaking users. Methods: This study undertook a document review, survey and semi-structured interviews to evaluate how well Shifra was able to achieve its objectives using a human-centred design approach. Results: A co-design process successfully led to the development of a web-based health app for refugee and migrant women. This evaluation also yielded several important recommendations for improving Shifra’s human-centred design approach moving forward. Conclusions: Improving refugees’ access to sexual and reproductive health is complex and requires innovative and thoughtful problem solving. This evaluation of Shifra’s human-centred design approach provides a helpful and rigorous guide in reporting that may encourage other organisations undertaking human-centred design work to evaluate their own implementation. Keywords: human-centred design; design thinking; refugee health; evaluation Plain language summary: Australian women from non-English speaking migrant and refugee communities face reduced access to sexual and reproductive healthcare and many then go on to experience poor health outcomes as a result. There is an urgent need for new approach to improve access to healthcare for underserved communities, one that centres these women in the process of finding, developing and disseminating the solutions themselves. Human-centred design is an ethical and effective methodology to working with communities to develop these health solutions. This study aimed to evaluate how well Shifra, a small Australian-based not-for-profit focused on improving access to healthcare for refugees and new migrants, undertook human-centred design approach when developing a Smartphone app that deliver local, safe and culturally relevant health information to non-English speaking Australians. The authors interviewed refugees, health and social sector experts and computer programmers involved in creating Shifra to evaluate how well they used human-centred design to achieve its goals. This evaluation found that Shifra’s approach was successful whilst also highlighting several important recommendations for improving collaborative efforts with refugee communities. These findings could help other projects also seeking to undertake an authentic community co-design process.


2015 ◽  
Vol 47 (8) ◽  
pp. 1028 ◽  
Author(s):  
Yiwen WANG ◽  
Zhen ZHANG ◽  
Sheng YUAN ◽  
Fengbo GUO ◽  
Shaoying HE ◽  
...  

Author(s):  
Daniëlle N. Zijlstra ◽  
Jean W.M. Muris ◽  
Catherine Bolman ◽  
J. Mathis Elling ◽  
Vera E.R.A. Knapen ◽  
...  

Abstract Background: To expedite the use of evidence-based smoking cessation interventions (EBSCIs) in primary care and to thereby increase the number of successful quit attempts, a referral aid was developed. This aid aims to optimize the referral to and use of EBSCIs in primary care and to increase adherence to Dutch guidelines for smoking cessation. Methods: Practice nurses (PNs) will be randomly allocated to an experimental condition or control condition, and will then recruit smoking patients who show a willingness to quit smoking within six months. PNs allocated to the experimental condition will provide smoking cessation guidance in accordance with the referral aid. Patients from both conditions will receive questionnaires at baseline and after six months. Cessation effectiveness will be tested via multilevel logistic regression analyses. Multiple imputations as well as intention to treat analysis will be performed. Intervention appreciation and level of informed decision-making will be compared using analysis of (co)variance. Predictors for appreciation and informed decision-making will be assessed using multiple linear regression analysis and/or structural equation modeling. Finally, a cost-effectiveness study will be conducted. Discussion: This paper describes the study design for the development and evaluation of an information and decision tool to support PNs in their guidance of smoking patients and their referral to EBSCIs. The study aims to provide insight into the (cost) effectiveness of an intervention aimed at expediting the use of EBSCIs in primary care.


2019 ◽  
Vol 69 (689) ◽  
pp. e809-e818 ◽  
Author(s):  
Sophie Chima ◽  
Jeanette C Reece ◽  
Kristi Milley ◽  
Shakira Milton ◽  
Jennifer G McIntosh ◽  
...  

BackgroundThe diagnosis of cancer in primary care is complex and challenging. Electronic clinical decision support tools (eCDSTs) have been proposed as an approach to improve GP decision making, but no systematic review has examined their role in cancer diagnosis.AimTo investigate whether eCDSTs improve diagnostic decision making for cancer in primary care and to determine which elements influence successful implementation.Design and settingA systematic review of relevant studies conducted worldwide and published in English between 1 January 1998 and 31 December 2018.MethodPreferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were followed. MEDLINE, EMBASE, and the Cochrane Central Register of Controlled Trials were searched, and a consultation of reference lists and citation tracking was carried out. Exclusion criteria included the absence of eCDSTs used in asymptomatic populations, and studies that did not involve support delivered to the GP. The most relevant Joanna Briggs Institute Critical Appraisal Checklists were applied according to study design of the included paper.ResultsOf the nine studies included, three showed improvements in decision making for cancer diagnosis, three demonstrated positive effects on secondary clinical or health service outcomes such as prescribing, quality of referrals, or cost-effectiveness, and one study found a reduction in time to cancer diagnosis. Barriers to implementation included trust, the compatibility of eCDST recommendations with the GP’s role as a gatekeeper, and impact on workflow.ConclusioneCDSTs have the capacity to improve decision making for a cancer diagnosis, but the optimal mode of delivery remains unclear. Although such tools could assist GPs in the future, further well-designed trials of all eCDSTs are needed to determine their cost-effectiveness and the most appropriate implementation methods.


Sign in / Sign up

Export Citation Format

Share Document