Combining Farmers’ Preferences With Evidence-Based Strategies to Prevent and Lower Farmers’ Distress: Co-design and Acceptability Testing of ifarmwell

Background Farming is physically and psychologically hazardous. Farmers face many barriers to help seeking from traditional physical and mental health services; however, improved internet access now provides promising avenues for offering support. Objective This study aims to co-design with farmers the content and functionality of a website that helps them adopt transferable coping strategies and test its acceptability in the broader farming population. Methods Research evidence and expert opinions were synthesized to inform key design principles. A total of 18 farmers detailed what they would like from this type of website. Intervention logic and relevant evidence-based strategies were mapped. Website content was drafted and reviewed by 2 independent mental health professionals. A total of 9 farmers provided detailed qualitative feedback on the face validity of the draft content. Subsequently, 9 farmers provided feedback on the website prototype. Following amendments and internal prototype testing and optimization, prototype usability (ie, completion rate) was examined with 157 registered website users who were (105/157, 66.9%) female, aged 21-73 years; 95.5% (149/156) residing in inner regional to very remote Australia, and 68.2% (107/157) “sheep, cattle and/or grain farmers.” Acceptability was examined with a subset of 114 users who rated at least module 1. Interviews with 108 farmers who did not complete all 5 modules helped determine why, and detailed interviews were conducted with 18 purposively sampled users. Updates were then made according to adaptive trial design methodology. Results This systematic co-design process resulted in a web-based resource based on acceptance and commitment therapy and designed to overcome barriers to engagement with traditional mental health and well-being strategies—ifarmwell. It was considered an accessible and confidential source of practical and relevant farmer-focused self-help strategies. These strategies were delivered via 5 interactive modules that include written, drawn, and audio- and video-based psychoeducation and exercises, as well as farming-related jokes, metaphors, examples, and imagery. Module 1 included distress screening and information on how to speak to general practitioners about mental health–related concerns (including a personalized conversation script). Modules were completed fortnightly. SMS text messages offered personalized support and reminders. Qualitative interviews and star ratings demonstrated high module acceptability (average 4.06/5 rating) and suggested that additional reminders, higher quality audio recordings, and shorter modules would be useful. Approximately 37.1% (52/140) of users who started module 1 completed all modules, with too busy or not got to it yet being the main reason for non-completion, and previous module acceptability not predicting subsequent module completion. Conclusions Sequential integration of research evidence, expert knowledge, and farmers’ preferences in the co-design process allowed for the development of a self-help intervention that focused on important intervention targets and was acceptable to this difficult-to-engage group. Trial Registration Australian New Zealand Clinical Trials Registry ACTRN12617000506392; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=372526

An Interactive Voice Response System to Increase Physical Activity and Prevent Cancer in the Rural Alabama Black Belt: Design and Usability Study

Background Increased physical activity (PA) levels are associated with reduced risk and improved survival for several cancers; however, most Americans engage in less than the recommended levels of PA. Using interactive voice response (IVR) systems to provide personalized health education and counseling may represent a high-reach, low-cost strategy for addressing physical inactivity and cancer disparities in disproportionately burdened rural regions. However, there has been a paucity of research conducted in this area to date. Objective The aim of this study is to design, develop, and test the usability of an IVR system aimed at increasing PA levels in the rural Alabama Black Belt. Methods A pilot version of the IVR system was used to assess initial feasibility and acceptability. Detailed exit interviews were conducted to elicit participant feedback, which helped inform the development of a substantially upgraded in-house IVR system. This refined IVR system was then subjected to a sequential explanatory mixed methods evaluation. Participating rural county coordinators and research staff (N=10) tested the usability of the IVR system features for 2 weeks and then completed the System Usability Scale and qualitative semistructured interviews. Results The study sample comprised mostly African American people, women, rural county coordinators, and research staff (N=10). Participants rated the IVR system with a mean score of 81 (SD 5) on the System Usability Scale, implying excellent usability. In total, 5 overarching themes emerged from the qualitative interviews: likes or dislikes of the intervention, barriers to or facilitators of PA, technical difficulties, quality of calls, and suggestions for intervention improvement. Message framing on step feedback, call completion incentives, and incremental goal-setting challenges were areas identified for improvement. The positive areas highlighted in the interviews included the personalized call schedules, flexibility to call in or receive a call, ability to make up for missed calls, narration, and PA tips. Conclusions The usability testing and feedback received from the rural county coordinators and research staff helped inform a final round of refinement to the IVR system before use in a large randomized controlled trial. This study stresses the importance of usability testing of all digital health interventions and the benefits it can offer to the intervention.

Using Health Concept Surveying to Elicit Usable Evidence: Case Studies of a Novel Evaluation Methodology

Background Developers, designers, and researchers use rapid prototyping methods to project the adoption and acceptability of their health intervention technology (HIT) before the technology becomes mature enough to be deployed. Although these methods are useful for gathering feedback that advances the development of HITs, they rarely provide usable evidence that can contribute to our broader understanding of HITs. Objective In this research, we aim to develop and demonstrate a variation of vignette testing that supports developers and designers in evaluating early-stage HIT designs while generating usable evidence for the broader research community. Methods We proposed a method called health concept surveying for untangling the causal relationships that people develop around conceptual HITs. In health concept surveying, investigators gather reactions to design concepts through a scenario-based survey instrument. As the investigator manipulates characteristics related to their HIT, the survey instrument also measures proximal cognitive factors according to a health behavior change model to project how HIT design decisions may affect the adoption and acceptability of an HIT. Responses to the survey instrument were analyzed using path analysis to untangle the causal effects of these factors on the outcome variables. Results We demonstrated health concept surveying in 3 case studies of sensor-based health-screening apps. Our first study (N=54) showed that a wait time incentive could influence more people to go see a dermatologist after a positive test for skin cancer. Our second study (N=54), evaluating a similar application design, showed that although visual explanations of algorithmic decisions could increase participant trust in negative test results, the trust would not have been enough to affect people’s decision-making. Our third study (N=263) showed that people might prioritize test specificity or sensitivity depending on the nature of the medical condition. Conclusions Beyond the findings from our 3 case studies, our research uses the framing of the Health Belief Model to elicit and understand the intrinsic and extrinsic factors that may affect the adoption and acceptability of an HIT without having to build a working prototype. We have made our survey instrument publicly available so that others can leverage it for their own investigations.

A Mobile App to Support Self-management of Chronic Kidney Disease: Development Study

Background Chronic kidney disease (CKD) is a common and costly condition that is usually accompanied by multiple comorbidities including type 2 diabetes, hypertension, and obesity. Proper management of CKD can delay or prevent kidney failure and help mitigate cardiovascular disease risk, which increases as kidney function declines. Smart device apps hold potential to enhance patient self-management of chronic conditions including CKD. Objective The objective of this study was to develop a mobile app to facilitate self-management of nondialysis-dependent CKD. Methods Our stakeholder team included 4 patients with stage 3-4 nondialysis-dependent CKD; a kidney transplant recipient; a caretaker; CKD care providers (pharmacists, a nurse, primary care physicians, a nephrologist, and a cardiologist); 2 health services and CKD researchers; a researcher in biomedical informatics, nutrition, and obesity; a system developer; and 2 programmers. Focus groups and in-person interviews with the patients and providers were conducted using a focus group and interview guide based on existing literature on CKD self-management and the mobile app quality criteria from the Mobile App Rating Scale. Qualitative analytic methods including the constant comparative method were used to analyze the focus group and interview data. Results Patients and providers identified and discussed a list of requirements and preferences regarding the content, features, and technical aspects of the mobile app, which are unique for CKD self-management. Requirements and preferences centered along themes of communication between patients and caregivers, partnership in care, self-care activities, adherence to treatment regimens, and self-care self-efficacy. These identified themes informed the features and content of our mobile app. The mobile app user can enter health data including blood pressure, weight, and blood glucose levels. Symptoms and their severity can also be entered, and users are prompted to contact a physician as indicated by the symptom and its severity. Next, mobile app users can select biweekly goals from a set of predetermined goals with the option to enter customized goals. The user can also keep a list of medications and track medication use. Our app includes feedback mechanisms where in-range values for health data are depicted in green and out-of-range values are depicted in red. We ensured that data entered by patients could be downloaded into a user-friendly report, which could be emailed or uploaded to an electronic health record. The mobile app also includes a mechanism that allows either group or individualized video chat meetings with a provider to facilitate either group support, education, or even virtual clinic visits. The CKD app also includes educational material on CKD and its symptoms. Conclusions Patients with CKD and CKD care providers believe that a mobile app can enhance CKD self-management by facilitating patient-provider communication and enabling self-care activities including treatment adherence.

Medical Specialists' Perspectives on the Influence of Electronic Medical Record Use on the Quality of Hospital Care: Semistructured Interview Study

Background Numerous publications show that electronic medical records (EMRs) may make an important contribution to increasing the quality of care. There are indications that particularly the medical specialist plays an important role in the use of EMRs in hospitals. Objective The aim of this study was to examine how, and by which aspects, the relationship between EMR use and the quality of care in hospitals is influenced according to medical specialists. Methods To answer this question, a qualitative study was conducted in the period of August-October 2018. Semistructured interviews of around 90 min were conducted with 11 medical specialists from 11 different Dutch hospitals. For analysis of the answers, we used a previously published taxonomy of factors that can influence the use of EMRs. Results The professional experience of the participating medical specialists varied between 5 and 27 years. Using the previously published taxonomy, these medical specialists considered technical barriers the most significant for EMR use. The suboptimal change processes surrounding implementation were also perceived as a major barrier. A final major problem is related to the categories “social” (their relationships with the patients and fellow care providers), “psychological” (based on their personal issues, knowledge, and perceptions), and “time” (the time required to select, implement, and learn how to use EMR systems and subsequently enter data into the system). However, the medical specialists also identified potential technical facilitators, particularly in the assured availability of information to all health care professionals involved in the care of a patient. They see promise in using EMRs for medical decision support to improve the quality of care but consider these possibilities currently lacking. Conclusions The 11 medical specialists shared positive experiences with EMR use when comparing it to formerly used paper records. The fact that involved health care professionals can access patient data at any time they need is considered important. However, in practice, potential quality improvement lags as long as decision support cannot be applied because of the lack of a fully coded patient record.