scholarly journals The Impact of Explanations on Layperson Trust in Artificial Intelligence–Driven Symptom Checker Apps: Experimental Study

10.2196/29386 ◽  
2021 ◽  
Vol 23 (11) ◽  
pp. e29386
Author(s):  
Claire Woodcock ◽  
Brent Mittelstadt ◽  
Dan Busbridge ◽  
Grant Blank

Background Artificial intelligence (AI)–driven symptom checkers are available to millions of users globally and are advocated as a tool to deliver health care more efficiently. To achieve the promoted benefits of a symptom checker, laypeople must trust and subsequently follow its instructions. In AI, explanations are seen as a tool to communicate the rationale behind black-box decisions to encourage trust and adoption. However, the effectiveness of the types of explanations used in AI-driven symptom checkers has not yet been studied. Explanations can follow many forms, including why-explanations and how-explanations. Social theories suggest that why-explanations are better at communicating knowledge and cultivating trust among laypeople. Objective The aim of this study is to ascertain whether explanations provided by a symptom checker affect explanatory trust among laypeople and whether this trust is impacted by their existing knowledge of disease. Methods A cross-sectional survey of 750 healthy participants was conducted. The participants were shown a video of a chatbot simulation that resulted in the diagnosis of either a migraine or temporal arteritis, chosen for their differing levels of epidemiological prevalence. These diagnoses were accompanied by one of four types of explanations. Each explanation type was selected either because of its current use in symptom checkers or because it was informed by theories of contrastive explanation. Exploratory factor analysis of participants’ responses followed by comparison-of-means tests were used to evaluate group differences in trust. Results Depending on the treatment group, two or three variables were generated, reflecting the prior knowledge and subsequent mental model that the participants held. When varying explanation type by disease, migraine was found to be nonsignificant (P=.65) and temporal arteritis, marginally significant (P=.09). Varying disease by explanation type resulted in statistical significance for input influence (P=.001), social proof (P=.049), and no explanation (P=.006), with counterfactual explanation (P=.053). The results suggest that trust in explanations is significantly affected by the disease being explained. When laypeople have existing knowledge of a disease, explanations have little impact on trust. Where the need for information is greater, different explanation types engender significantly different levels of trust. These results indicate that to be successful, symptom checkers need to tailor explanations to each user’s specific question and discount the diseases that they may also be aware of. Conclusions System builders developing explanations for symptom-checking apps should consider the recipient’s knowledge of a disease and tailor explanations to each user’s specific need. Effort should be placed on generating explanations that are personalized to each user of a symptom checker to fully discount the diseases that they may be aware of and to close their information gap.

2021 ◽  
Author(s):  
Claire Woodcock ◽  
Brent Mittelstadt ◽  
Dan Busbridge ◽  
Grant Blank

BACKGROUND Artificial intelligence (AI)–driven symptom checkers are available to millions of users globally and are advocated as a tool to deliver health care more efficiently. To achieve the promoted benefits of a symptom checker, laypeople must trust and subsequently follow its instructions. In AI, explanations are seen as a tool to communicate the rationale behind black-box decisions to encourage trust and adoption. However, the effectiveness of the types of explanations used in AI-driven symptom checkers has not yet been studied. Explanations can follow many forms, including <i>why</i>-explanations and <i>how</i>-explanations. Social theories suggest that <i>why</i>-explanations are better at communicating knowledge and cultivating trust among laypeople. OBJECTIVE The aim of this study is to ascertain whether explanations provided by a symptom checker affect explanatory trust among laypeople and whether this trust is impacted by their existing knowledge of disease. METHODS A cross-sectional survey of 750 healthy participants was conducted. The participants were shown a video of a chatbot simulation that resulted in the diagnosis of either a migraine or temporal arteritis, chosen for their differing levels of epidemiological prevalence. These diagnoses were accompanied by one of four types of explanations. Each explanation type was selected either because of its current use in symptom checkers or because it was informed by theories of contrastive explanation. Exploratory factor analysis of participants’ responses followed by comparison-of-means tests were used to evaluate group differences in trust. RESULTS Depending on the treatment group, two or three variables were generated, reflecting the prior knowledge and subsequent mental model that the participants held. When varying explanation type by disease, migraine was found to be nonsignificant (<i>P</i>=.65) and temporal arteritis, marginally significant (<i>P</i>=.09). Varying disease by explanation type resulted in statistical significance for input influence (<i>P</i>=.001), social proof (<i>P</i>=.049), and no explanation (<i>P</i>=.006), with counterfactual explanation (<i>P</i>=.053). The results suggest that trust in explanations is significantly affected by the disease being explained. When laypeople have existing knowledge of a disease, explanations have little impact on trust. Where the need for information is greater, different explanation types engender significantly different levels of trust. These results indicate that to be successful, symptom checkers need to tailor explanations to each user’s specific question and discount the diseases that they may also be aware of. CONCLUSIONS System builders developing explanations for symptom-checking apps should consider the recipient’s knowledge of a disease and tailor explanations to each user’s specific need. Effort should be placed on generating explanations that are personalized to each user of a symptom checker to fully discount the diseases that they may be aware of and to close their information gap.


BMJ Open ◽  
2021 ◽  
Vol 11 (12) ◽  
pp. e055916
Author(s):  
Jun Kako ◽  
Yoshiyasu Ito ◽  
Kohei Kajiwara ◽  
Yasutaka Kimura ◽  
Takahiro Kakeda ◽  
...  

IntroductionThe COVID-19 pandemic is spreading globally with a high risk of mortality. It is also significantly affecting mental health. For nursing students, the impact of COVID-19 on mental health is predicted to be significant; however, sufficient data have not been obtained. Therefore, this study will aim to assess the mental health of nursing students and evaluate the related factors.Methods and analysisThis proposed study is a cross-sectional survey using a self-report questionnaire. An online questionnaire will be distributed among all nursing students of eight universities in Japan. The survey questionnaire will consist of questions related to demography, life satisfaction, fear of COVID-19, mental health and physical activities. The target sample size is 1300 nursing students. We will calculate descriptive statistics for each measurement item and perform univariate and logistic regression analyses to evaluate the potential risk factors for anxiety, depression and insomnia symptoms in nursing students. The strength of association will be assessed using the OR and its 95% CIs. Statistical significance will be set at a p<0.05.Ethics and disseminationThe protocol was approved by the Institutional Review Board (IRB) of the University of Hyogo on 22 March 2021 (ID: 2020F29). In addition, all of the participating facilities required ethical approval from their local IRBs. The findings will be disseminated through peer-reviewed publications and conference presentations. We believe that the proposed large-scale investigation of the mental health of nursing students during the COVID-19 pandemic and the relationship between mental health and fear of COVID-19 are novel and will be a strength of this study.


2020 ◽  
Vol 6 (3) ◽  
pp. 55
Author(s):  
Ashraf Elsafty ◽  
Dalia Abadir ◽  
Ashraf Shaarawy

The literature has widely covered the factors that determine the success of entrepreneurial ventures from financial and organizational perspectives. This study intends to tackle how the Financial Capital, the Human Capital, the Social Capital, and the Psychological Capital of the Entrepreneur affect Entrepreneurial Success. Despite that the Financial, Human, and Social Capitals are extensively examined in the literature as they relate to entrepreneurial success, this paper will add the psychological capital of the entrepreneur and examine its effect on entrepreneurial success in Egypt.This study aimed to investigate the effect of Financial Capital, Human Capital, Social Capital, and Psychological Capital on Entrepreneurial Success using a cross-sectional survey. Respondents were the owners and founders of small and medium enterprises (SMEs) in Cairo, Egypt. The results revealed that Social Capital and Psychological capital had a statistical significance as well as a positive strong relationship with Entrepreneurial success, while the Financial Capital and the Human Capital had statistical insignificance as well as a positive weak to a very weak relationship with Entrepreneurial success respectively.The study findings suggested that entrepreneurial success is strongly connected to the intangible resources of the entrepreneur, which are Social Capital and Psychological Capital, and that the Psychological Capital had the highest impact on Entrepreneurial success. However, the impact of the Financial Capital and Human Capital on Entrepreneurial Success was statistically insignificant.


2020 ◽  
Author(s):  
Khanh Ngoc Cong Duong ◽  
Tien Nguyen Le Bao ◽  
Phuong Thi Lan Nguyen ◽  
Thanh Vo Van ◽  
Toi Phung Lam ◽  
...  

BACKGROUND The first nationwide lockdown due to the COVID-19 pandemic was implemented in Vietnam from April 1 to 15, 2020. Nevertheless, there has been limited information on the impact of COVID-19 on the psychological health of the public. OBJECTIVE This study aimed to estimate the prevalence of psychological issues and identify the factors associated with the psychological impact of COVID-19 during the first nationwide lockdown among the general population in Vietnam. METHODS We employed a cross-sectional study design with convenience sampling. A self-administered, online survey was used to collect data and assess psychological distress, depression, anxiety, and stress of participants from April 10 to 15, 2020. The Impact of Event Scale-Revised (IES-R) and the Depression, Anxiety, and Stress Scale-21 (DASS-21) were utilized to assess psychological distress, depression, anxiety, and stress of participants during social distancing due to COVID-19. Associations across factors were explored using regression analysis. RESULTS A total of 1385 respondents completed the survey. Of this, 35.9% (n=497) experienced psychological distress, as well as depression (n=325, 23.5%), anxiety (n=195, 14.1%), and stress (n=309, 22.3%). Respondents who evaluated their physical health as average had a higher IES-R score (beta coefficient [B]=9.16, 95% CI 6.43 to 11.89), as well as higher depression (B=5.85, 95% CI 4.49 to 7.21), anxiety (B=3.64, 95% CI 2.64 to 4.63), and stress (B=5.19, 95% CI 3.83 to 6.56) scores for DASS-21 than those who rated their health as good or very good. Those who self-reported their health as bad or very bad experienced more severe depression (B=9.57, 95% CI 4.54 to 14.59), anxiety (B=7.24, 95% CI 3.55 to 10.9), and stress (B=10.60, 95% CI 5.56 to 15.65). Unemployment was more likely to be associated with depression (B=3.34, 95% CI 1.68 to 5.01) and stress (B=2.34, 95% CI 0.84 to 3.85). Regarding worries about COVID-19, more than half (n=755, 54.5%) expressed concern for their children aged &lt;18 years, which increased their IES-R score (B=7.81, 95% CI 4.98 to 10.64) and DASS-21 stress score (B=1.75, 95% CI 0.27 to 3.24). The majority of respondents (n=1335, 96.4%) were confident about their doctor’s expertise in terms of COVID-19 diagnosis and treatment, which was positively associated with less distress caused by the outbreak (B=–7.84, 95% CI –14.58 to –1.11). CONCLUSIONS The findings highlight the effect of COVID-19 on mental health during the nationwide lockdown among the general population in Vietnam. The study provides useful evidence for policy decision makers to develop and implement interventions to mitigate these impacts. CLINICALTRIAL


Author(s):  
Hasan S. Alamri ◽  
Wesam F. Mousa ◽  
Abdullah Algarni ◽  
Shehata F. Megahid ◽  
Ali Al Bshabshe ◽  
...  

Objective: Little is known about the impact of Coronavirus (COVID-19) among the health care workers in Saudi Arabia. Therefore, the present study aimed to assess the psychological impact of COVID-19 among the health care workers. Methods: A cross-sectional survey was conducted from May till mid-July among 389 health care workers from government and private hospitals in Saudi Arabia. Data was collected using a pre-structured online questionnaire that measured adverse psychological outcomes, including the Patient Health Questionnaire-9 (PHQ-9) scale and the Generalized Anxiety Disorder 7-item (GAD-7) scale. The Pearson chi-square test was used to assess the distribution of depression and anxiety among health care workers. Results: A high level of anxiety was recorded among the health care workers, and 69.3% of health care workers below the age of 40 were found to have depression. There was a significant increase in depression among staff with chronic health problems (72.1% vs. 61.9%; p = 0.048). High anxiety levels were detected among young staff compared to others (68.7% vs. 43.8%; p = 0.001). Moreover, 82.1% of the female staff were anxious, as compared to 55.6% of the males (p = 0.001). Conclusions: We found increased prevalence of adverse psychological outcomes among the health care workers in Saudi Arabia during the outbreak of COVID-19. Therefore, there is a need for proper screening and development of corresponding preventive measures to decrease the adverse psychological outcomes.


2020 ◽  
pp. 1-10
Author(s):  
Colin J. McMahon ◽  
Justin T. Tretter ◽  
Theresa Faulkner ◽  
R. Krishna Kumar ◽  
Andrew N. Redington ◽  
...  

Abstract Objective: This study investigated the impact of the Webinar on deep human learning of CHD. Materials and methods: This cross-sectional survey design study used an open and closed-ended questionnaire to assess the impact of the Webinar on deep learning of topical areas within the management of the post-operative tetralogy of Fallot patients. This was a quantitative research methodology using descriptive statistical analyses with a sequential explanatory design. Results: One thousand-three-hundred and seventy-four participants from 100 countries on 6 continents joined the Webinar, 557 (40%) of whom completed the questionnaire. Over 70% of participants reported that they “agreed” or “strongly agreed” that the Webinar format promoted deep learning for each of the topics compared to other standard learning methods (textbook and journal learning). Two-thirds expressed a preference for attending a Webinar rather than an international conference. Over 80% of participants highlighted significant barriers to attending conferences including cost (79%), distance to travel (49%), time commitment (51%), and family commitments (35%). Strengths of the Webinar included expertise, concise high-quality presentations often discussing contentious issues, and the platform quality. The main weakness was a limited time for questions. Just over 53% expressed a concern for the carbon footprint involved in attending conferences and preferred to attend a Webinar. Conclusion: E-learning Webinars represent a disruptive innovation, which promotes deep learning, greater multidisciplinary participation, and greater attendee satisfaction with fewer barriers to participation. Although Webinars will never fully replace conferences, a hybrid approach may reduce the need for conferencing, reduce carbon footprint. and promote a “sustainable academia”.


Nursing Open ◽  
2021 ◽  
Author(s):  
Rachel King ◽  
Tony Ryan ◽  
Michaela Senek ◽  
Emily Wood ◽  
Bethany Taylor ◽  
...  

2021 ◽  
pp. 229255032110300
Author(s):  
Caroline F. Illmann ◽  
Christopher Doherty ◽  
Margaret Wheelock ◽  
Joshua Vorstenbosch ◽  
Joan E. Lipa ◽  
...  

Background: The COVID-19 pandemic has led to unprecedented challenges and restrictions in surgical access across Canada, including for breast reconstructive services which are an integral component of comprehensive breast cancer care. We sought to determine how breast reconstructive services are being restricted, and what strategies may be employed to optimize the provision of breast reconstruction through a pan-Canadian evaluation from the providers’ perspective. Methods: This was a cross-sectional survey of Canadian plastic and reconstructive surgeons who perform breast reconstruction. The 33-item web-based questionnaire was developed by a pan-Canadian working group of breast reconstruction experts and disseminated via email to members of the Canadian Society of Plastic Surgery. The questionnaire queried respondents on the impact of the COVID-19 pandemic and associated restrictions on surgeons’ breast reconstruction practice patterns and opinions on strategies for resource utilization. Results: Responses were received from 49 surgeons, who reported practicing in 8 of 10 Canadian provinces. Restrictions on the provision of breast reconstructive procedures were most limited during the First Wave of the COVID-19 pandemic, where all respondents reported at least some reduction in capacity and more than a quarter reporting complete cessation. Average reported reduction in capacity ranged from 31% to 78% across all 3 waves. Autologous, delayed, and prophylactic reconstructions were most commonly restricted. Conclusion: This study provides a pan-Canadian impact assessment on breast reconstructive services during the COVID-19 pandemic from the providers’ perspective. To uphold the standards of patient-centred care, a unified approach to strategically reorganize health care delivery now and in the future is needed.


Sign in / Sign up

Export Citation Format

Share Document