A Semantic and Syntactic Similarity Measure for Political Tweets

In this article, we present an approach to the automatic discovery of term similarities, which may serve as a basis for a number of term-oriented knowledge mining tasks. The method for term comparison combines internal (lexical similarity) and two types of external criteria (syntactic and contextual similarities). Lexical similarity is based on sharing lexical constituents (i.e. term heads and modifiers). Syntactic similarity relies on a set of specific lexico-syntactic co-occurrence patterns indicating the parallel usage of terms (e.g., within an enumeration or within a term coordination/conjunction structure), while contextual similarity is based on the usage of terms in similar contexts. Such contexts are automatically identified by a pattern mining approach, and a procedure is proposed to assess their domain-specific and terminological relevance. Although automatically collected, these patterns are domain dependent and identify contexts in which terms are used. Different types of similarities are combined into a hybrid similarity measure, which can be tuned for a specific domain by learning optimal weights for individual similarities. The suggested similarity measure has been tested in the domain of biomedicine, and some experiments are presented.

Download Full-text

Answer Evaluation of Short Descriptive Questions

Advances in Data Mining and Database Management - Developing a Keyword Extractor and Document Classifier ◽

10.4018/978-1-7998-3772-5.ch005 ◽

2021 ◽

pp. 104-118

Keyword(s):

Similarity Measure ◽

Assessment System ◽

Similarity Matrix ◽

Test Paper ◽

Continuous Assessment ◽

Simple Interpretation ◽

Cognitive Levels ◽

Stages Of Learning ◽

Syntactic Similarity ◽

Measure Word

Reforms in the educational system emphasize more on continuous assessment. The descriptive examination test paper when compared to objective test paper acts as a better aid in continuous assessment for testing the progress of a student under various cognitive levels at different stages of learning. Unfortunately, assessment of descriptive answers is found to be tedious and time-consuming by instructors due to the increase in number of examinations in continuous assessment system. In this chapter, an attempt has been made to address the problem of automatic evaluation of descriptive answer using vector-based similarity matrix with order-based word-to-word syntactic similarity measure. Word order similarity measure remains as one of the best measures to find the similarity between sequential words in sentences and is increasing its popularity due to its simple interpretation and easy computation.

Download Full-text

Handling WSD using Hierarchical Clustering Algorithm with sentences

International Journal of Scientific Research in Science Engineering and Technology ◽

10.32628/ijsrset1841120 ◽

2018 ◽

pp. 83-88

Author(s):

Mohana Priya K ◽

Pooja Ragavi S ◽

Krishna Priya G

Keyword(s):

Hierarchical Clustering ◽

Similarity Measure ◽

Clustering Algorithm ◽

Clustering Algorithms ◽

Cosine Similarity Measure ◽

Hierarchical Clustering Algorithm ◽

Multiple Levels ◽

Pos Tagger ◽

Sentence Clustering ◽

The Right

Clustering is the process of grouping objects into subsets that have meaning in the context of a particular problem. It does not rely on predefined classes. It is referred to as an unsupervised learning method because no information is provided about the "right answer" for any of the objects. Many clustering algorithms have been proposed and are used based on different applications. Sentence clustering is one of best clustering technique. Hierarchical Clustering Algorithm is applied for multiple levels for accuracy. For tagging purpose POS tagger, porter stemmer is used. WordNet dictionary is utilized for determining the similarity by invoking the Jiang Conrath and Cosine similarity measure. Grouping is performed with respect to the highest similarity measure value with a mean threshold. This paper incorporates many parameters for finding similarity between words. In order to identify the disambiguated words, the sense identification is performed for the adjectives and comparison is performed. semcor and machine learning datasets are employed. On comparing with previous results for WSD, our work has improvised a lot which gives a percentage of 91.2%

Download Full-text