scholarly journals Commercial ERP Chatbots : Conversational Intelligence Agents' Performance Analysis, User experience Benchmarks, and Quality Standards

Author(s):  
Uday Kumar Adusumilli ◽  
Rajneesh Pandeya ◽  
Arvind Sebastian ◽  
Nanda Ashwin

A key goal of this paper is to investigate commercial applications for chatbots and propose several evaluation metrics for evaluating an embodied conversational agent's performance, usability, and overall quality. Our assessment is based on metrics that include a) size of market share & reach, b) range of users and c) likelihood of being the most advanced commercial chatbot created by their creators. Our study examines several aspects of the function of embodied conversational agents, including their visual appearance, implementation of web sites, speech synthesis unit, built-in knowledge base (with general and specialized information), presentation of knowledge and additional functionality, emergency responses in unexpected situations, and user ratings. An evaluation of any commercial chatbot deployment requires a multidimensional assessment and the current state of Conversational Intelligence in the commercial virtual assistant market.

2020 ◽  
Author(s):  
Arfan Ahmed ◽  
Nashva ALi ◽  
Sarah Aziz ◽  
Alaa A Abd-Alrazaq ◽  
Asmaa Hassan ◽  
...  

BACKGROUND Anxiety and depression rates are at an all-time high along with other mental health disorders. Smartphone-based mental health chatbots or conversational agents can aid psychiatrists and replace some of the costly human based interaction and represent a unique opportunity to expand the availability and quality of mental health services and treatment. Regular up-to-date reviews will allow medics and individuals to recommend or use anxiety and depression related smartphone based chatbots with greater confidence. OBJECTIVE Assess the quality and characteristics of chatbots for anxiety and depression available on Android and iOS systems. METHODS A search was performed in the App Store and Google Play Store following the Preferred Reporting Items for Systematic reviews and Meta-Analysis (PRISMA) protocol to identify existing chatbots for anxiety and depression. Eligibility of the chatbots was assessed by two individuals based on predefined eligibility criteria. Meta-data of the included chatbots and their characteristics were extracted from their description and upon installation by 2 reviewers. Finally, chatbots quality information was assessed by following the mHONcode principles. RESULTS Although around 1000 anxiety and depression related chatbots exist, only a few (n=11) contained actual chatbots that could provide the user a real substitute for a human-human based interaction, even with today's Artificial Intelligence advancements, only one of these chatbots had voice as an input/output modality. Of the selected apps that contained chatbots all were clearly built with a therapeutic human substitute goal in mind. The majority had high user ratings and downloads highlighting the popularity of such chatbots and their promising future within the realm of anxiety and depression. CONCLUSIONS Anxiety and depression chatbot apps have the potential to increase the capacity of mental health self-care providing much needed assistance to professionals. In the current covid-19 pandemic, chatbots can also serve as a conversational companion with the potential of combating loneliness, especially in lockdowns where there is a lack of social interaction. Due to the ubiquitous nature of chatbots users can access them on-demand at the touch of a screen on ones’ smartphone. Self-care interventions are known to be effective and exist in various forms and some can be made available as chatbot features, such as assessment, mood tracking, medicine tracking, or simply providing conversation in times of loneliness.


2007 ◽  
Vol 8 (3) ◽  
pp. 391-410 ◽  
Author(s):  
Justine Cassell ◽  
Andrea Tartaro

What is the hallmark of success in human–agent interaction? In animation and robotics, many have concentrated on the looks of the agent — whether the appearance is realistic or lifelike. We present an alternative benchmark that lies in the dyad and not the agent alone: Does the agent’s behavior evoke intersubjectivity from the user? That is, in both conscious and unconscious communication, do users react to behaviorally realistic agents in the same way they react to other humans? Do users appear to attribute similar thoughts and actions? We discuss why we distinguish between appearance and behavior, why we use the benchmark of intersubjectivity, our methodology for applying this benchmark to embodied conversational agents (ECAs), and why we believe this benchmark should be applied to human–robot interaction.


2008 ◽  
Author(s):  
Markku Turunen ◽  
Jaakko Hakulinen ◽  
Cameron Smith ◽  
Daniel Charlton ◽  
Li Zhang ◽  
...  

2006 ◽  
Vol 6 ◽  
pp. 37-45
Author(s):  
Barbara Becker

The construction of embodied conversational agents – robots as well as avatars – seem to be a new challenge in the field of both cognitive AI and human-computer-interface development. On the one hand, one aims at gaining new insights in the development of cognition and communication by constructing intelligent, physical instantiated artefacts. On the other hand people are driven by the idea, that humanlike mechanical dialog-partners will have a positive effect on human-machine-communication. In this contribution I put for discussion whether the visions of scientist in this field are plausible and which problems might arise by the realization of such projects.


Sign in / Sign up

Export Citation Format

Share Document