The WOOL Dialogue Platform: Enabling Interdisciplinary User-Friendly Development of Dialogue for Conversational Agents

Health coaching applications can include (embodied) conversational agents as coaches. The development of these agents requires an interdisciplinary cooperation between eHealth application developers, interaction designers and domain experts. Therefore, proper dialogue authoring tools and tools to integrate these dialogues in a conversational agent system are essential in the process of creating successful agent-based applications. However, we found no existing open source, easy-to-use authoring tools that support multidisciplinary agent development. To that end, we developed the WOOL Dialogue Platform. The WOOL Dialogue Platform provides the eHealth and conversational agent communities with an open source platform, consisting of a set of easy to use tools that facilitate virtual agent development. The platform consists of a dialogue definition language, an editor, application development libraries and a web service. To illustrate the platform’s possibilities and use in practice, we describe two use cases from EU Horizon 2020 research projects. The WOOL Dialogue Platform is an ‘easy to use, and powerful if needed’ platform for the development of conversational agent applications that is seeing a slow but steady increase in uptake in the eHealth community. Developed to support dialogue authoring for embodied conversational agents in the health coaching domain, this platform’s strong points are its ease of use and ability to let domain experts and agents technology experts work together by providing all parties with tools that support their work effectively.

Use and effect of web-based embodied conversational agents for improving eating behavior and decreasing loneliness among community-dwelling older adults: A randomized controlled trial (Preprint)

BACKGROUND Embodied conversational agents (ECAs) have been proposed as a promising interaction modality for the delivery of programs focused on promoting lifestyle changes. However, it is not understood which factors influence use of an ECA and their health effects. OBJECTIVE We aim to (1) identify whether ECAs can persuade community-dwelling older adults to change their dietary behavior and whether ECAs use can decrease loneliness, (2) test these pathways to effects, and (3) understand the use of an ECA. METHODS The web-based eHealth app PACO is a fully automated 8-week intervention in which 2 ECAs engage older adults in dialogue to motivate them to change their dietary behavior and decrease their loneliness. PACO was developed via a human-centered and stakeholder-inclusive design approach and incorporates Self-determination Theory and various behavior change techniques For this study, an unblinded web-based randomized controlled trial was conducted. Participants were recruited via social media, an online panel, flyers and advertorials. The intervention group received access to the PACO service for eight weeks. The waitlist group received PACO after waiting for four weeks. The primary outcomes, eating behavior and loneliness, were assessed via self-assesed online questionnaires at intake, waitlist, after 4 weeks, and after eight weeks. In addition, the primary outcome—use—was assessed via data logs. Secondary outcomes were measured at the same times, via questionnaires or an optional interview. RESULTS In total, 32 participants completed the intervention. We found a significant correlation between use in minutes on the one hand, and perceived usefulness (r = .39, P =.030) and enjoyment on the other (r = .38, P = .032). However, these did not predict use in the full regression model (F(2,29) = 1.98, P = .16, R2 = .12). Additionally, PACO use did not lead to improvements in eating behavior (χ2(2) = .34, = .85) or a decrease in loneliness (χ2(2) = .02, = .99). CONCLUSIONS Our study did not provide any concluding evidence about factors that are linked to the use or health effects of ECAs. Future service design could benefit from either creating a functional design catered towards the predominant stage of the targeted population, or by personalizing the service based on an intake in which the end-user’s stage is determined. CLINICALTRIAL ClinicalTrials.gov NCT04510883; https://clinicaltrials.gov/ct2/show/NCT04510883 INTERNATIONAL REGISTERED REPORT RR2-10.2196/22186

Commercial ERP Chatbots : Conversational Intelligence Agents' Performance Analysis, User experience Benchmarks, and Quality Standards

A key goal of this paper is to investigate commercial applications for chatbots and propose several evaluation metrics for evaluating an embodied conversational agent's performance, usability, and overall quality. Our assessment is based on metrics that include a) size of market share & reach, b) range of users and c) likelihood of being the most advanced commercial chatbot created by their creators. Our study examines several aspects of the function of embodied conversational agents, including their visual appearance, implementation of web sites, speech synthesis unit, built-in knowledge base (with general and specialized information), presentation of knowledge and additional functionality, emergency responses in unexpected situations, and user ratings. An evaluation of any commercial chatbot deployment requires a multidimensional assessment and the current state of Conversational Intelligence in the commercial virtual assistant market.