System of Semantic Integration of Non-Structuralized Documents in Natural Language in the Domain of Metallurgy

2013 ◽  
Vol 58 (3) ◽  
pp. 927-930 ◽  
Author(s):  
S. Kluska-Nawarecka ◽  
K. Regulski ◽  
M. Krzyżak ◽  
G. Leśniak ◽  
M. Gurda
Keyword(s):  
Information Search ◽  
Latent Semantic Indexing ◽  
Semantic Integration ◽  
Semantic Indexing ◽  
Text Documents ◽  
New Approach ◽  
Automatic Clustering ◽  
System Administrator ◽  
Mining Methods ◽  
Ontological Model

Abstract This paper presents assumptions for a system of automatic cataloging and semantic text documents searching. As an example, a document repository for metals processing technology was used. The system by using ontological model provides the user with a new approach to the exploration of database resources - easier and more intuitive information search. In the current document storage systems, searching is often based only on keywords and descriptions created manually by the system administrator. The use of text mining methods, especially latent semantic indexing, allows automatic clustering of documents with respect to their content. The result of this clustering is integrated with the ontological model, making navigation through documents resources intuitive and does not require the manual creation of directories. Such an approach seems to be particularly useful in a situation where we are dealing with large repositories of unstructured documents from such sources as the Internet. This situation is very typical for cases of searching information and knowledge in the area of metallurgy, for example with regard to innovation and non-traditional suppliers of materials and equipment.

scholarly journals Formalization of Technological Knowledge in the Field of Metallurgy using Document Classification Tools Supported with Semantic Techniques

2017 ◽  
Vol 62 (2) ◽  
pp. 715-720 ◽  
Author(s):  
K. Regulski
Keyword(s):  
Knowledge Base ◽  
Latent Semantic Indexing ◽  
Semantic Knowledge ◽  
Technological Knowledge ◽  
Semantic Integration ◽  
Semantic Indexing ◽  
Text Documents ◽  
Semantic Techniques ◽  
Semantic Knowledge Base

AbstractThe process of knowledge formalization is an essential part of decision support systems development. Creating a technological knowledge base in the field of metallurgy encountered problems in acquisition and codifying reusable computer artifacts based on text documents. The aim of the work was to adapt the algorithms for classification of documents and to develop a method of semantic integration of a created repository. Author used artificial intelligence tools: latent semantic indexing, rough sets, association rules learning and ontologies as a tool for integration. The developed methodology allowed for the creation of semantic knowledge base on the basis of documents in natural language in the field of metallurgy.

scholarly journals Contextualized Latent Semantic Indexing: A New Approach to Automated Chinese Essay Scoring

2017 ◽  
Vol 26 (2) ◽  
pp. 263-285
Author(s):  
Yanyan Xu ◽  
Dengfeng Ke ◽  
Kaile Su
Keyword(s):  
Latent Dirichlet Allocation ◽  
Language Model ◽  
Latent Semantic Indexing ◽  
Context Information ◽  
Semantic Indexing ◽  
Automated Essay Scoring ◽  
New Approach ◽  
Finite State Transducer ◽  
Essay Scoring ◽  
Critical Components

AbstractThe writing part in Chinese language tests is badly in need of a mature automated essay scoring system. In this paper, we propose a new approach applied to automated Chinese essay scoring (ACES), called contextualized latent semantic indexing (CLSI), of which Genuine CLSI and Modified CLSI are two versions. The n-gram language model and the weighted finite-state transducer (WFST), two critical components, are used to extract context information in our ACES system. Not only does CLSI improve conventional latent semantic indexing (LSI), but bridges the gap between latent semantics and their context information, which is absent in LSI. Moreover, CLSI can score essays from the perspectives of language fluency and contents, and address the local overrating and underrating problems caused by LSI. Experimental results show that CLSI outperforms LSI, Regularized LSI, and latent Dirichlet allocation in many aspects, and thus, proves to be an effective approach.

Analyzing Large-Scale Proteomics Projects with Latent Semantic Indexing

2008 ◽  
Vol 7 (1) ◽  
pp. 182-191 ◽  
Author(s):  
Sebastian Klie ◽  
Lennart Martens ◽  
Juan Antonio Vizcaíno ◽  
Richard Côté ◽  
Phil Jones ◽  
...  
Keyword(s):  
Large Scale ◽  
Latent Semantic Indexing ◽  
Semantic Indexing

A Method Based on Support Vector Machine for Feature Selection of Latent Semantic Features

2011 ◽  
Vol 181-182 ◽  
pp. 830-835
Author(s):  
Min Song Li
Keyword(s):  
Support Vector Machine ◽  
Text Categorization ◽  
Latent Semantic Indexing ◽  
Classification Performance ◽  
Compact Representation ◽  
Support Vector ◽  
Semantic Features ◽  
Semantic Indexing ◽  
Feature Extraction Method ◽  
Feature Subspace

Latent Semantic Indexing(LSI) is an effective feature extraction method which can capture the underlying latent semantic structure between words in documents. However, it is probably not the most appropriate for text categorization to use the method to select feature subspace, since the method orders extracted features according to their variance,not the classification power. We proposed a method based on support vector machine to extract features and select a Latent Semantic Indexing that be suited for classification. Experimental results indicate that the method improves classification performance with more compact representation.

Biomedical Document Clustering Based on Accelerated Symbiotic Organisms Search Algorithm

2021 ◽  
Vol 12 (4) ◽  
pp. 169-185
Author(s):  
Saida Ishak Boushaki ◽  
Omar Bendjeghaba ◽  
Nadjet Kamel
Keyword(s):  
Clustering Algorithm ◽  
Search Algorithm ◽  
Clustering Algorithms ◽  
Document Clustering ◽  
Latent Semantic Indexing ◽  
Research Area ◽  
Semantic Indexing ◽  
Local Optima ◽  
Symbiotic Organisms Search ◽  
Symbiotic Organisms

Clustering is an important unsupervised analysis technique for big data mining. It finds its application in several domains including biomedical documents of the MEDLINE database. Document clustering algorithms based on metaheuristics is an active research area. However, these algorithms suffer from the problems of getting trapped in local optima, need many parameters to adjust, and the documents should be indexed by a high dimensionality matrix using the traditional vector space model. In order to overcome these limitations, in this paper a new documents clustering algorithm (ASOS-LSI) with no parameters is proposed. It is based on the recent symbiotic organisms search metaheuristic (SOS) and enhanced by an acceleration technique. Furthermore, the documents are represented by semantic indexing based on the famous latent semantic indexing (LSI). Conducted experiments on well-known biomedical documents datasets show the significant superiority of ASOS-LSI over five famous algorithms in terms of compactness, f-measure, purity, misclassified documents, entropy, and runtime.

Sign in / Sign up

Export Citation Format

Share Document