Clustering Textual Data by Latent Dirichlet Allocation: Applications and Extensions to Hierarchical Data

2009 ◽  
pp. 241-248
Author(s):  
Matteo Dimai ◽  
Nicola Torelli
Keyword(s):  
Latent Dirichlet Allocation ◽  
Hierarchical Data ◽  
Textual Data ◽  
Dirichlet Allocation

scholarly journals Topic Modelling on Pharmaceutical Incident Data

2021 ◽  
Vol 2 (3) ◽  
pp. 92-96
Author(s):  
Deepu Dileep ◽  
Soumya Rudraraju ◽  
V. V. HaraGopal
Keyword(s):  
Pharmaceutical Industry ◽  
Key Words ◽  
Latent Dirichlet Allocation ◽  
Topic Modelling ◽  
Probability Of Occurrence ◽  
Proposed Model ◽  
Textual Data ◽  
Incident Data ◽  
Dirichlet Allocation

Focus of the current study is to explore and analyse textual data in the form of incidents in pharmaceutical industry using topic modelling. Topic modelling applied in the current study is based on Latent Dirichlet Allocation. The proposed model is applied on a corpus containing 190 incidents to retrieve key words with highest probability of occurrence. It is used to form informative topics related to incidents.

scholarly journals Estimating News Coverage Patterns using Latent Dirichlet Allocation (LDA)

2018 ◽  
Vol 1 (1) ◽  
pp. 51-56
Author(s):  
Naeem Ahmed Mahoto
Keyword(s):  
Knowledge Discovery ◽  
Probabilistic Model ◽  
Data Model ◽  
Latent Dirichlet Allocation ◽  
News Coverage ◽  
Multidimensional Data ◽  
Large Collection ◽  
Allocation Pattern ◽  
Textual Data ◽  
Dirichlet Allocation

The growing rate of unstructured textual data has made an open challenge for the knowledge discovery, which aims extracting desired information from large collection of data. This study presents a system to derive news coverage patterns with the help of probabilistic model – Latent Dirichlet Allocation. Pattern is an arrangement of words within collected data that more likely appear together in certain context. The news coverage patterns have been computed as number function of news articles comprising of such patterns. A prototype, as a proof, has been developed to estimate the news coverage patterns for a newspaper – The Dawn. Analyzing the news coverage patterns from different aspects has been carried out using multidimensional data model. Further, the extracted news coverage patterns are illustrated by visual graphs to yield in-depth understanding of the topics, which have been covered in the news. The results also assist in identification of schema related to newspaper and journalists’ articles.

scholarly journals A Latent-Dirichlet-Allocation Based Extension for Domain Ontology of Enterprise’s Technological Innovation

2019 ◽  
Vol 14 (1) ◽  
pp. 107-123 ◽  
Author(s):  
Qianqian Zhang ◽  
Shifeng Liu ◽  
Daqing Gong ◽  
Qun Tu
Keyword(s):  
Technological Innovation ◽  
Language Processing ◽  
Latent Dirichlet Allocation ◽  
Domain Ontology ◽  
Document Collections ◽  
Plain Text ◽  
Domain Specific ◽  
Textual Data ◽  
Initial Seed ◽  
Dirichlet Allocation

This paper proposed a method for building enterprise's technological innovation domain ontology automatically from plain text corpus based on Latent Dirichlet Allocation (LDA). The proposed method consisted of four modules: 1) introducing the seed ontology for domain of enterprise's technological innovation, 2) using Natural Language Processing (NLP) technique to preprocess the collected textual data, 3) mining domain specific terms from document collections based on LDA, 4) obtaining the relationship between the terms through the defined relevant rules. The experiments have been carried out to demonstrate the effectiveness of this method and the results indicated that many terms in domain of enterprise's technological innovation and the semantic relations between terms are discovered. The proposed method is a process of continuously cycles and iterations, that is the obtained objective ontology can be re-iterated as initial seed ontology. The constant knowledge acquisition in the domain of enterprise's technological innovation to update and perfect the initial seed ontology.

Similarity Detection Using Latent Semantic Analysis Algorithm

2018 ◽  
Vol 6 (8) ◽  
pp. 102
Author(s):  
Priyanka R. Patil ◽  
Shital A. Patil
Keyword(s):  
Latent Semantic Analysis ◽  
Latent Dirichlet Allocation ◽  
Semantic Analysis ◽  
Mining Method ◽  
Research Papers ◽  
Information Measures ◽  
Automated Software ◽  
Day By Day ◽  
Ways Of Life ◽  
Dirichlet Allocation

Similarity View is an application for visually comparing and exploring multiple models of text and collection of document. Friendbook finds ways of life of clients from client driven sensor information, measures the closeness of ways of life amongst clients, and prescribes companions to clients if their ways of life have high likeness. Roused by demonstrate a clients day by day life as life records, from their ways of life are separated by utilizing the Latent Dirichlet Allocation Algorithm. Manual techniques can't be utilized for checking research papers, as the doled out commentator may have lacking learning in the exploration disciplines. For different subjective views, causing possible misinterpretations. An urgent need for an effective and feasible approach to check the submitted research papers with support of automated software. A method like text mining method come to solve the problem of automatically checking the research papers semantically. The proposed method to finding the proper similarity of text from the collection of documents by using Latent Dirichlet Allocation (LDA) algorithm and Latent Semantic Analysis (LSA) with synonym algorithm which is used to find synonyms of text index wise by using the English wordnet dictionary, another algorithm is LSA without synonym used to find the similarity of text based on index. LSA with synonym rate of accuracy is greater when the synonym are consider for matching.

scholarly journals Coherent structure identification in turbulent channel flow using latent Dirichlet allocation

2021 ◽  
Vol 920 ◽  
Author(s):  
Mohamed Frihat ◽  
Bérengère Podvin ◽  
Lionel Mathelin ◽  
Yann Fraigneau ◽  
François Yvon
Keyword(s):  
Channel Flow ◽  
Coherent Structure ◽  
Latent Dirichlet Allocation ◽  
Turbulent Channel Flow ◽  
Structure Identification ◽  
Dirichlet Allocation

Abstract

A guided latent Dirichlet allocation approach to investigate real-time latent topics of Twitter data during Hurricane Laura

2021 ◽  
pp. 016555152110077
Author(s):  
Sulong Zhou ◽  
Pengyu Kan ◽  
Qunying Huang ◽  
Janet Silbernagel
Keyword(s):  
Social Media ◽  
Real Time ◽  
Language Processing ◽  
Disaster Response ◽  
Domain Knowledge ◽  
Latent Dirichlet Allocation ◽  
Situational Awareness ◽  
High Performing ◽  
Latent Topics ◽  
Dirichlet Allocation

Natural disasters cause significant damage, casualties and economical losses. Twitter has been used to support prompt disaster response and management because people tend to communicate and spread information on public social media platforms during disaster events. To retrieve real-time situational awareness (SA) information from tweets, the most effective way to mine text is using natural language processing (NLP). Among the advanced NLP models, the supervised approach can classify tweets into different categories to gain insight and leverage useful SA information from social media data. However, high-performing supervised models require domain knowledge to specify categories and involve costly labelling tasks. This research proposes a guided latent Dirichlet allocation (LDA) workflow to investigate temporal latent topics from tweets during a recent disaster event, the 2020 Hurricane Laura. With integration of prior knowledge, a coherence model, LDA topics visualisation and validation from official reports, our guided approach reveals that most tweets contain several latent topics during the 10-day period of Hurricane Laura. This result indicates that state-of-the-art supervised models have not fully utilised tweet information because they only assign each tweet a single label. In contrast, our model can not only identify emerging topics during different disaster events but also provides multilabel references to the classification schema. In addition, our results can help to quickly identify and extract SA information to responders, stakeholders and the general public so that they can adopt timely responsive strategies and wisely allocate resource during Hurricane events.

Sign in / Sign up

Export Citation Format

Share Document