Semantic Analysis for Conversational Datasets: Improving Their Quality Using Semantic Relationships

2020 ◽  
Vol 14 (03) ◽  
pp. 395-422
Author(s):  
Maria Krommyda ◽  
Verena Kantere
Keyword(s):  
Quality Assurance ◽  
Semantic Analysis ◽  
Score Function ◽  
Accurate Data ◽  
Specific Task ◽  
Conversational Agents ◽  
High Quality ◽  
Semantic Relationships ◽  
Inaccurate Information ◽  
Integrated Platform

As more and more datasets become available, their utilization in different applications increases in popularity. Their volume and production rate, however, means that their quality and content control is in most cases non-existing, resulting in many datasets that contain inaccurate information of low quality. Especially, in the field of conversational assistants, where the datasets come from many heterogeneous sources with no quality assurance, the problem is aggravated. We present here an integrated platform that creates task- and topic-specific conversational datasets to be used for training conversational agents. The platform explores available conversational datasets, extracts information based on semantic similarity and relatedness, and applies a weight-based score function to rank the information based on its value for the specific task and topic. The finalized dataset can then be used for the training of an automated conversational assistance over accurate data of high quality.

scholarly journals Seed research for improved technologies

1998 ◽  
Vol 55 (spe) ◽  
pp. 19-26 ◽  
Author(s):  
R.J. Bino ◽  
H. Jalink ◽  
M.O. Oluoch ◽  
S.P.C. Groot
Keyword(s):  
Cell Cycle ◽  
Cell Proliferation ◽  
Quality Assurance ◽  
Seed Germination ◽  
Seed Quality ◽  
Molecular Level ◽  
Control Mechanisms ◽  
High Quality ◽  
Production Chain ◽  
High Quality Seed

The production of high-quality seed is the basis for a durable a profitable agriculture. After production, seed is processed, conditioned, stored, shipped and germinated. For quality assurance, seed quality has to be controlled at all steps of the production chain. Seed functioning is accompanied by programmed transitions from cell proliferation to quiescence upon maturation and from quiescence to reinitiation of cellular metabolism upon imbibition. Despite the obvious importance of these control mechanisms, very little information is available at the molecular level concerning those elements that regulate seed germination. In the present study, the induction of cell cycle activity and the regulation of ß-tubulin expression is related to the water content and other physical properties of the seed.

scholarly journals Human Annotated Dialogues Dataset for Natural Conversational Agents

2020 ◽  
Vol 10 (3) ◽  
pp. 762
Author(s):  
Erinc Merdivan ◽  
Deepika Singh ◽  
Sten Hanke ◽  
Johannes Kropf ◽  
Andreas Holzinger ◽  
...  
Keyword(s):  
Natural Language ◽  
Detailed Analysis ◽  
Human Perception ◽  
Natural Language Understanding ◽  
Industrial Applications ◽  
Benchmark Dataset ◽  
Conversational Agents ◽  
High Quality ◽  
Language Understanding ◽  
Major Drawback

Conversational agents are gaining huge popularity in industrial applications such as digital assistants, chatbots, and particularly systems for natural language understanding (NLU). However, a major drawback is the unavailability of a common metric to evaluate the replies against human judgement for conversational agents. In this paper, we develop a benchmark dataset with human annotations and diverse replies that can be used to develop such metric for conversational agents. The paper introduces a high-quality human annotated movie dialogue dataset, HUMOD, that is developed from the Cornell movie dialogues dataset. This new dataset comprises 28,500 human responses from 9500 multi-turn dialogue history-reply pairs. Human responses include: (i) ratings of the dialogue reply in relevance to the dialogue history; and (ii) unique dialogue replies for each dialogue history from the users. Such unique dialogue replies enable researchers in evaluating their models against six unique human responses for each given history. Detailed analysis on how dialogues are structured and human perception on dialogue score in comparison with existing models are also presented.

scholarly journals Data-driven versus self-similar parameterizations for Stochastic Advection by Lie Transport and Location Uncertainty

2019 ◽  
Author(s):  
Valentin Resseguier ◽  
Wei Pan ◽  
Baylor Fox-Kemper
Keyword(s):  
Fluid Dynamics ◽  
Heterogeneous Data ◽  
Data Driven ◽  
Accurate Data ◽  
High Quality ◽  
Ensemble Forecasts ◽  
Homogeneous Surface ◽  
Location Uncertainty ◽  
Physically Based ◽  
Self Similar

Abstract. Stochastic subgrid parameterizations enable ensemble forecasts of fluid dynamics systems and ultimately accurate data assimilation. Stochastic Advection by Lie Transport (SALT) and models under Location Uncertainty (LU) are recent and similar physically-based stochastic schemes. SALT dynamics conserve helicity whereas LU models conserve kinetic energy. After highlighting general similarities between LU and SALT frameworks, this paper focuses on their common challenge: the parameterization choice. We compare uncertainty quantification skills of a stationary heterogeneous data-driven parameterization and a non-stationary homogeneous self-similar parameterization. For stationary, homogeneous Surface Quasi-Geostrophic (SQG) turbulence, both parameterizations lead to high quality ensemble forecasts. This paper also discusses a heterogeneous adaptation of the homogeneous parameterization targeted at better simulation of strong straight buoyancy fronts.

scholarly journals Building a high quality data linkage spine using a targeted approach to clerical review

2017 ◽  
Vol 1 (1) ◽  
Author(s):  
Nadine Wiggins ◽  
Brian Stokes
Keyword(s):  
Quality Assurance ◽  
Data Linkage ◽  
Quality Data ◽  
High Confidence ◽  
Software Module ◽  
High Quality ◽  
Confidence Levels ◽  
Lower Confidence ◽  
Linkage Quality

ABSTRACTObjectivesThe Tasmanian Data Linkage Unit (TDLU) was established through the University of Tasmania in 2011 with the first dataset imported to its Master Linkage Map (MLM) during 2014. Tasmania an island state of Australia, has a population of approximately 516,000. From the TDLU’s earliest inception, it was deemed important to build a high quality linkage spine comprising key administrative data representative of significant state health and related datasets to support quality population level research.ApproachThe TDLU has embraced a model of continual quality and process enhancement as a determined strategy to support ongoing business improvement. Initial linkage approaches utilised ‘traditional’ methods of reviewing record pairs within an upper and lower confidence range. This approach resulted in false record pairs with high confidence levels being linked (false positives) and true record pairs at lower confidence levels not linked (false negatives). To improve linkage quality, the TDLU has continually refined and modified its clerical review methodology with a specialist software module developed to identify specific record attributes within groups that require the group to be manually reviewed and resolved. A range of SQL queries have also been developed to identify incorrect links and further enhance the linkage quality of the MLM.ResultsThe linkage quality tools implemented have led to improved clerical review and quality assurance processes which in turn have increased the overall quality of the linkage spine. The ‘targeted’ method of clerical review provides easy identification of false positive records, particularly those with high confidence scores such as twins and husband/wife combinations. The review of groups at lower confidence levels has minimised the rate of false negative pairs however further refinement of tools is required to minimise the time spent on reviewing these groups. The clerical review software module has equipped staff with the necessary information to make informed and timely decisions when reviewing groups of records. Detailed documentation is maintained for each linkage project providing continual feedback for system and process improvements as the linkage spine increases in size.ConclusionThe process of clerical review and quality assurance requires a commitment to continual refinement of tools and techniques resulting in a higher quality linkage spine and a reduction in the total time and resource required to link datasets.

scholarly journals Struktura znaczeniowa słownictwa anatomicznego w Nowym dykcjonarzu M.A. Troca

2020 ◽  
pp. 119-133
Author(s):  
Beata Kuryłowicz ◽  
Keyword(s):  
Semantic Analysis ◽  
18Th Century ◽  
The Other ◽  
Medical Terminology ◽  
Uniform Size ◽  
Semantic Relationships ◽  
Anatomical Terminology ◽  
Other Hand ◽  
Lexical Field

This article is an attempt to perform a semantic analysis of anatomical vocabulary collected by Michał Abraham Troc in Nowy dykcjonarz, published in Lipsk in 1764. The aim of individual analyses based on the lexical field theory is to demonstrate the meaning of lexemes, to determine their place within a field, as well as to disclose semantic relationships: synonymy, polysemy and hyponymy. The semantic analysis presented in this article clearly demonstrates abundance and differentiation of 18th century anatomical vocabulary, as well as prevalence of native over borrowed words. Among 250 names, only eleven units are borrowings from foreign languages: seven Latin and four German ones. This provides evidence there is a fundamental role of native lexis, especially colloquial vocabulary, in the formation of Polish anatomical terminology, and, more extensively, also medical terminology, in the first phase of its development which continued until the end of the 18th century. Of note is also the non-uniform arrangement of lexemes in individual fields and asymmetry in their number. Selected lexical fields are characterised by non-uniform size, different level of semantic stratification and differentiated degree of generality of words they contain. On the other hand, semantic relations observed in the analysed anatomical vocabulary, especially synonymy and polysemy, confirm there is a differentiation of anatomical lexis, on the other hand, they indicate lack of precision in expressing content by the discussed lexical units.

lsemantica: A command for text similarity based on latent semantic analysis

2019 ◽  
Vol 19 (1) ◽  
pp. 129-142 ◽  
Author(s):  
Carlo Schwarz
Keyword(s):  
Latent Semantic Analysis ◽  
Semantic Analysis ◽  
Learning Algorithm ◽  
Singular Value ◽  
Machine Learning Algorithm ◽  
Truncated Singular Value Decomposition ◽  
Similarity Comparison ◽  
Text Similarity ◽  
Semantic Relationships ◽  
Value Decomposition

In this article, I present the lsemantica command, which implements latent semantic analysis in Stata. Latent semantic analysis is a machine learning algorithm for word and text similarity comparison and uses truncated singular value decomposition to derive the hidden semantic relationships between words and texts. lsemantica provides a simple command for latent semantic analysis as well as complementary commands for text similarity comparison.

scholarly journals Endoscopy in Canada: Proceedings of the National Roundtable

2015 ◽  
Vol 29 (5) ◽  
pp. 259-265
Author(s):  
Noah Switzer ◽  
Elijah Dixon ◽  
Jill Tinmouth ◽  
Nori Bradley ◽  
Melina Vassiliou ◽  
...  
Keyword(s):  
Quality Assurance ◽  
Resident Training ◽  
The State ◽  
Roundtable Discussion ◽  
High Quality ◽  
Surgical Resident ◽  
Canadian Association ◽  
The Future ◽  
General Surgeons ◽  
And Training

This 2014 roundtable discussion, hosted by the Canadian Association of General Surgeons, brought together general surgeons and gastroenterologists with expertise in endoscopy from across Canada to discuss the state of endoscopy in Canada. The focus of the roundtable was the evaluation of the competence of general surgeons at endoscopy, reviewing quality assurance parameters for high-quality endoscopy, measuring and assessing surgical resident preparedness for endoscopy practice, evaluating credentialing programs for the endosuite and predicting the future of endoscopic services in Canada. The roundtable noted several important observations. There exist inadequacies in both resident training and the assessment of competency in endoscopy. From these observations, several collaborative recommendations were then stated. These included the need for a formal and standardized system of both accreditation and training endoscopists.

Medication Refill Clinics: The Veterans Administration Medical Center Experience

1992 ◽  
Vol 5 (1) ◽  
pp. 12-21 ◽  
Author(s):  
David Lee Cram ◽  
Ann T. Maesner ◽  
Douglas M. Witmore
Keyword(s):  
Quality Assurance ◽  
Pharmaceutical Care ◽  
Medical Center ◽  
Cost Effective ◽  
Veterans Affairs ◽  
Veterans Administration ◽  
High Quality ◽  
Administration Medical ◽  
Medication Refill ◽  
Policies And Procedures

Medication refill clinics have been operating for about two decades. These clinics provide cost-effective and high-quality pharmaceutical care to patients who require refills on their medications. The following article describes one Veterans Affairs Medical Center's experience with a medication refill clinic. Guidelines for setting up a refill clinic are presented, including clinic development and justification, training of the practitioner, policies and procedures, and quality assurance management. Benefits of the clinic also will be discussed.

scholarly journals Service and Price Decisions of a Supply Chain with Optional After-Sale Service

2016 ◽  
Vol 2016 ◽  
pp. 1-11
Author(s):  
Xiaochen Sun ◽  
Qingshuai Zhang ◽  
Yancong Zhou
Keyword(s):  
Quality Assurance ◽  
Supply Chain ◽  
Wholesale Price ◽  
Service Level ◽  
Retail Price ◽  
High Quality ◽  
Optional Service ◽  
Durable Products ◽  
Purchase Behaviors

For durable products, the high quality after-sales service has been playing an increasingly important role in consumers’ purchase behaviors. We mainly study a supply chain composed of a manufacturer and a retailer. In a process of products sales, the manufacturer will provide a basic free quality assurance service. On this basis, the retailer provides paid optional quality assurance service to consumers to promote sales. Users are divided into two categories in this paper: users with no optional service and users with optional services. We derive the equilibrium decisions between the manufacturer and the retailer under the following two cases: (i) the optional after-sales service level and the wholesale price determined by the manufacturer and the retail price determined by the retailer; (ii) the wholesale price determined by the manufacturer and the optional after-sales service level and the retail price determined by the retailer.

Sign in / Sign up

Export Citation Format

Share Document