Assessing Collaborative Explanations of AI using Explanation Goodness Criteria

2021 ◽  
Vol 65 (1) ◽  
pp. 988-993
Author(s):  
Tauseef Ibne Mamun ◽  
Kenzie Baker ◽  
Hunter Malinowski ◽  
Rober R. Hoffman ◽  
Shane T. Mueller
Keyword(s):  
Formative Evaluation ◽  
Machine Intelligence ◽  
Human Understanding ◽  
Explainable Ai ◽  
Explanation System ◽  
Scale Data

Explainable AI represents an increasingly important category of systems that attempt to support human understanding and trust in machine intelligence and automation. Typical systems rely on algorithms to help understand underlying information about decisions and establish justified trust and reliance. Researchers have proposed using goodness criteria to measure the quality of explanations as a formative evaluation of an XAI system, but these criteria have not been systematically investigated in the literature. To explore this, we present a novel collaborative explanation system (CXAI) and propose several goodness criteria to evaluate the quality of its explanations. Results suggest that the explanations provided by this system are typically correct, informative, written in understandable ways, and focus on explanation of larger scale data patterns than are typically generated by algorithmic XAI systems. Implications for how these criteria may be applied to other XAI systems are discussed.

PENGEMBANGAN MODUL PEMBELAJARAN DENGAN MODEL DICK and CAREY MATA KULIAH EVALUASI PENGAJARAN

2019 ◽  
Vol 2 ◽  
Author(s):  
Yayan Sudrajat
Keyword(s):  
Formative Evaluation ◽  
Development Model ◽  
Teaching Materials ◽  
Evaluation Activity ◽  
Group Evaluation ◽  
Quality Of Teaching ◽  
Evaluation Of Teaching ◽  
One To One ◽  
Blue Print

Abstract The purpose of this article is to develop a learning module for the Evaluation of Teaching Indonesian at the Indraprasta University PGRI Jakarta using the Dick and Carey development model. The implementation of this instruction includes how a prospective teacher is good at evaluating teaching materials so that the lecturer feels the need to develop teaching materials to improve the quality of teaching materials using formative evaluation consisting of One-to-one evaluation by experts, One-to-one evaluation by Learners, Small Group Evaluation, and Field Trial by making a blue print of each formative evaluation activity. Keywords: Dick and Carey Development Model, Formative Evaluation, Blue Print, Summative evaluation

An Adjustable Implant for the Nasal Valve: 3-Year Experience

2008 ◽  
Vol 139 (2_suppl) ◽  
pp. P72-P72
Author(s):  
Charles G Hurbis
Keyword(s):  
Nasal Valve ◽  
Valve Dysfunction ◽  
Nasal Airways ◽  
Quality Of Life Scale ◽  
Life Scale ◽  
Nasal Implant ◽  
Scale Data ◽  
Implantation Success

Objective 1) Measure the effectiveness of the Monarch implant in correcting nasal valve dysfunction. 2) Determine the longevity of effectiveness. Methods This study consists of a prospective, cumulative, three-year experience with the Monarch adjustable nasal implant for correcting nasal valve dysfunction in a total of 46 patients. Implantation success was determined by the use of acoustic rhinomanometry and a subjective NOSE-type quality of life scale. Data was subjected to the student-t test. Results In the series of 46 patients spanning 36 months there is a mean 150% improvement in the internal nasal valve areas at 3 years as measured by acoustic rhinomanometry (p<.0001). Using a NOSE-type questionnaire, patients also noted significant improvements in daytime (p<.0004) and nighttime (p<.0002) nasal airways, a decrease in apnea (p<.01) and snoring (p<.05), and a decrease in the propensity for daytime oral breathing (p<.0002). Conclusions The Monarch Implant provides a simple, consistent, adjustable and apparently long-term correction of the nasal airway in patients suffering from nasal valvular dysfunction.

Lichens as Biomonitors of Sulphur Dioxide Pollution in La Spezia (Northern Italy)

1990 ◽  
Vol 22 (3) ◽  
pp. 333-344 ◽  
Author(s):  
P. L. Nimis ◽  
M. Castello ◽  
M. Perotti
Keyword(s):  
Data Analysis ◽  
Sulphur Dioxide ◽  
Sampling Strategy ◽  
Statistical Correlation ◽  
Northern Italy ◽  
Automatic Mapping ◽  
Olive Trees ◽  
Very High ◽  
Scale Data

AbstractLichens epiphytic on olive trees were used as biomonitors of sulphur dioxide pollution in La Spezia (Northern Italy). The method adopted was designed to avoid subjectivity at all stages, from the sampling strategy to data analysis. Thus, lichen data are expressed by an index that does not depend on any sensitivity scale; data analysis relies on multivariate methods of classification and ordination, and the pollution maps have been produced by automatic mapping programmes. The index, based on the frequency of species within a sampling grid, showed a very high statistical correlation with pollution data measured by recording gauges. The results of classification and ordination indicate that Parmelia caperata is the species with a distribution best related to the lichen index. The quality of air pollution data obtained from biomonitors is discussed.

A Systematic Evaluation of a Soccer Club's College Advisory Program

2015 ◽  
pp. 211-243
Author(s):  
Seung Youn (Yonnie) Chyung ◽  
Stacey E. Olachea ◽  
Colleen Olson ◽  
Ben Davis
Keyword(s):  
Formative Evaluation ◽  
Opportunity To Learn ◽  
Evaluation Process ◽  
Systematic Evaluation ◽  
Multiple Sources ◽  
Advisory Program ◽  
Evaluation Team ◽  
Five Dimensions ◽  
External Evaluators

The College Advisory Program offered by Total Vision Soccer Club aims at providing young players with the opportunity to learn how to navigate the collegiate recruiting process, market themselves to college coaches, and increase their exposure to potential colleges and universities. A team of external evaluators (authors of this chapter) conducted a formative evaluation to determine what the program needs to do to reach its goal. By following a systemic evaluation process, the evaluation team investigated five dimensions of the program and collected data by reviewing various program materials and conducting surveys and interviews with players and their parents, upstream stakeholders, and downstream impactees. By triangulating the multiple sources of data, the team drew a conclusion that most program dimensions were rated as mediocre although the program had several strengths. The team provided evidence-based recommendations for improving the quality of the program.

Vertical Integration Between Providers With Possible Cloud Migration

2019 ◽  
pp. 274-284
Author(s):  
Aleksandra Kostic-Ljubisavljevic ◽  
Branka Mikavica
Keyword(s):  
Large Scale ◽  
Virtual Machines ◽  
Wholesale Price ◽  
Rejection Rate ◽  
Large Scale Data ◽  
Cloud Migration ◽  
Computational Resources ◽  
Charging Strategy ◽  
Scale Data

All vertically integrated participants in content provisioning process are influenced by bandwidth requirements. Provisioning of self-owned resources that satisfy peak bandwidth demand leads to network underutilization and it is cost ineffective. Under-provisioning leads to rejection of customers' requests. Vertically integrated providers need to consider cloud migration in order to minimize costs and improve quality of service and quality of experience of their customers. Cloud providers maintain large-scale data centers to offer storage and computational resources in the form of virtual machines instances. They offer different pricing plans: reservation, on-demand, and spot pricing. For obtaining optimal integration charging strategy, revenue sharing, cost sharing, wholesale price is applied frequently. The vertically integrated content provider's incentives for cloud migration can induce significant complexity in integration contracts, and consequently improvements in costs and requests' rejection rate.

Blog Snippets Based Drug Effects Extraction System Using Lexical and Grammatical Restrictions

2014 ◽  
Vol 5 (2) ◽  
pp. 1-17 ◽  
Author(s):  
Shiho Kitajima ◽  
Rafal Rzepka ◽  
Kenji Araki
Keyword(s):  
Quality Of Life ◽  
Natural Language ◽  
Large Scale ◽  
Medical Information ◽  
Drug Effects ◽  
Large Scale Data ◽  
Medical Documents ◽  
Baseline System ◽  
Scale Data

Obtaining medical information has a beneficial influence on patients' treatment and QOL (quality of life). The authors aim to make a system that helps patients to collect narrative information. Extracting information from data written by patients will allow the acquisition of information which is easy to understand and provides encouragement. Additionally, by using large-scale data, the system can be utilized for discovering unknown effects or patterns. As the first step, the purpose of this paper is to extract descriptions of the effects caused by taking drugs as a triplet of expressions from illness survival blogs' snippets. This paper proposes a method to extract the triplets using specific clue words and parsing the results in order to extract from blogs written in free natural language. Moreover, recall was improved by combining their proposed method and a baseline system, and precision was improved by filtering using dictionaries we created from existing medical documents.

Paideia, Prejudice and the Promise of the Practical

1998 ◽  
pp. 150-158
Author(s):  
Padraig Hogan
Keyword(s):  
Educational Aspirations ◽  
Educational Practice ◽  
Educational Practices ◽  
Cultural Inheritance ◽  
Cultural Ideals ◽  
Radical Pluralism ◽  
Human Understanding ◽  
The Face ◽  
Key Features

In an age of radical pluralism it is increasingly difficult to affirm and sustain the educational aspirations of Greek paideia (Latin humanitas). The most challenging attacks on these aspirations come from standpoints which share a postmodern attitude of opposition towards inherited cultural ideals, especially those which claim universality. This paper first examines optimistic and pessimistic prospects for the educational heritage of humanitas, concluding that, in the face of cultural disparateness which is increasingly evident in post-Enlightenment cultures, the pessimistic case seems to be more convincing. Recognizing that this gives added impetus to postmodernist standpoints, the second section examines some key features of these, taking as its examples arguments of Lyotard, Foucault and Rorty. I show that the prejudices of the postmodernist arguments are as invidious as the discriminatory assumptions and the neglect of the quality of educational practice in the Western cultural inheritance. Recalling some insights which can be gleaned from the educational practices of Socrates, the last section joins these with findings of contemporary philosophers on the pre-judgements and partiality which are inescapable features of human understanding. This is a reclamation and elucidation of a practical and promising humanitas which does justice to the claims of diversity and universality.

Effects of Site-Based Management on the Instructional Program

1994 ◽  
Vol 4 (3) ◽  
pp. 311-329 ◽  
Author(s):  
Martha N. Ovando
Keyword(s):  
School Districts ◽  
Staff Development ◽  
Curriculum And Instruction ◽  
Formative Evaluation ◽  
Instructional Program ◽  
Management Approach ◽  
Site Based Management ◽  
Teachers And Parents ◽  
The Impact

Given the apparent mixed results reported by previous studies (David, 1989; Hellinger, Murphy and Hausman, 1992; Jenni and Mauriel, 1990; Malen, Ogawa, and Kranz, 1990), this exploratory study attempted to examine the extent to which schools using a site-based management approach were engaged in decision making associated with curriculum and instruction, what roles teachers were playing, and what strategies were employed to assure the quality of the instructional program. It was conducted following a qualitative approach in order to understand respondents’ perspectives (Patton, 1990). Data were collected by means of extensive interviews with board members, district office personnel, principals, teachers, and parents from six school districts. These school districts were selected based on their reputation for having adopted a decentralized approach to school management. The findings of this study suggest that the participating schools are progressively addressing curriculum and instruction themes as they are developmentally ready. It was found that whereas schools have considerable freedom, school districts are providing “curriculum framework and guidelines” to assure an overall direction for the school district. Teachers are engaging in a variety of “non-teaching” roles as they introduce curriculum and instruction changes. Schools are using different strategies to maintain the quality of the instructional program, with staff development being the most common strategy. Needs assessment, campus planning, formative evaluation, and summative evaluation are other strategies used by these schools. Apparently, site-based management schools are making progress in addressing curriculum and instruction to meet their students’ needs; however, there is a need to study further how curriculum and instruction changes affect student academic achievement. Additionally, the impact of the changing roles of teachers on their teaching performance and on instruction should be studied.

scholarly journals Factors associated with poor sleep quality in women with cancer

2017 ◽  
Vol 25 (0) ◽  
Author(s):  
Thalyta Cristina Mansano-Schlosser ◽  
Maria Filomena Ceolim
Keyword(s):  
Sleep Quality ◽  
Quality Index ◽  
Sleep Disturbances ◽  
Pittsburgh Sleep Quality Index ◽  
Poor Sleep ◽  
Poor Sleep Quality ◽  
Factors Associated ◽  
Scale Data

ABSTRACT Objectives: to analyze the factors associated with poor sleep quality, its characteristics and components in women with breast cancer prior to surgery for removing the tumor and throughout the follow-up. Method: longitudinal study in a teaching hospital, with a sample of 102 women. The following were used: a questionnaire for sociodemographic and clinical characterization, the Pittsburgh Sleep Quality Index; the Beck Depression Inventory; and the Herth Hope Scale. Data collection covered from prior to the surgery for removal of the tumor (T0) to T1, on average 3.2 months; T2, on average 6.1 months; and T3, on average 12.4 months. Descriptive statistics and the Generalized Estimating Equations model were used. Results: depression and pain contributed to the increase in the score of the Pittsburgh Sleep Quality Index, and hope, to the reduction of the score - independently - throughout follow-up. Sleep disturbances were the component with the highest score throughout follow-up. Conclusion: the presence of depression and pain, prior to the surgery, contributed to the increase in the global score of the Pittsburgh Sleep Quality Index, which indicates worse quality of sleep throughout follow-up; greater hope, in its turn, influenced the reduction of the score of the Pittsburgh Sleep Quality Index.

Sign in / Sign up

Export Citation Format

Share Document