scholarly journals Neural Text Classification and Stacked Heterogeneous Embeddings for Named Entity Recognition in SMM4H 2021

2021 ◽  
Author(s):  
Usama Yaseen ◽  
Stefan Langer
Keyword(s):  
Text Classification ◽  
Named Entity Recognition ◽  
Entity Recognition ◽  
Named Entity

scholarly journals A Perspective on Text Classification, Clustering, and Named-entity Recognition in Social Media

2019 ◽  
Vol 06 & 06h (2) ◽  
Author(s):  
Kia Jahanbin ◽  
◽  
Fereshte Rahmanian ◽  
Vahid Rahmanian ◽  
Masihollah Shakeri ◽  
...  
Keyword(s):  
Social Media ◽  
Text Classification ◽  
Named Entity Recognition ◽  
Entity Recognition ◽  
Named Entity

scholarly journals An ERNIE-Based Joint Model for Chinese Named Entity Recognition

2020 ◽  
Vol 10 (16) ◽  
pp. 5711
Author(s):  
Yu Wang ◽  
Yining Sun ◽  
Zuchang Ma ◽  
Lisheng Gao ◽  
Yang Xu
Keyword(s):  
Language Processing ◽  
Text Classification ◽  
Knowledge Integration ◽  
Named Entity Recognition ◽  
Training Model ◽  
Joint Model ◽  
Entity Recognition ◽  
Named Entity ◽  
Sentence Level ◽  
Joint Training

Named Entity Recognition (NER) is the fundamental task for Natural Language Processing (NLP) and the initial step in building a Knowledge Graph (KG). Recently, BERT (Bidirectional Encoder Representations from Transformers), which is a pre-training model, has achieved state-of-the-art (SOTA) results in various NLP tasks, including the NER. However, Chinese NER is still a more challenging task for BERT because there are no physical separations between Chinese words, and BERT can only obtain the representations of Chinese characters. Nevertheless, the Chinese NER cannot be well handled with character-level representations, because the meaning of a Chinese word is quite different from that of the characters, which make up the word. ERNIE (Enhanced Representation through kNowledge IntEgration), which is an improved pre-training model of BERT, is more suitable for Chinese NER because it is designed to learn language representations enhanced by the knowledge masking strategy. However, the potential of ERNIE has not been fully explored. ERNIE only utilizes the token-level features and ignores the sentence-level feature when performing the NER task. In this paper, we propose the ERNIE-Joint, which is a joint model based on ERNIE. The ERNIE-Joint can utilize both the sentence-level and token-level features by joint training the NER and text classification tasks. In order to use the raw NER datasets for joint training and avoid additional annotations, we perform the text classification task according to the number of entities in the sentences. The experiments are conducted on two datasets: MSRA-NER and Weibo. These datasets contain Chinese news data and Chinese social media data, respectively. The results demonstrate that the ERNIE-Joint not only outperforms BERT and ERNIE but also achieves the SOTA results on both datasets.

Arabic named entity recognition using optimized feature sets

2008 ◽  
Author(s):  
Yassine Benajiba ◽  
Mona Diab ◽  
Paolo Rosso
Keyword(s):  
Named Entity Recognition ◽  
Entity Recognition ◽  
Feature Sets ◽  
Named Entity

Open-Source Tools for Morphology, Lemmatization, POS Tagging and Named Entity Recognition

2014 ◽  
Author(s):  
Jana Straková ◽  
Milan Straka ◽  
Jan Hajič
Keyword(s):  
Open Source ◽  
Named Entity Recognition ◽  
Entity Recognition ◽  
Named Entity ◽  
Pos Tagging

Developing a RadLex-based Named Entity Recognition Tool for Mining Textual Radiology Reports (Preprint)

2020 ◽  
Author(s):  
Shintaro Tsuji ◽  
Andrew Wen ◽  
Naoki Takahashi ◽  
Hongjian Zhang ◽  
Katsuhiko Ogasawara ◽  
...  
Keyword(s):  
Named Entity Recognition ◽  
Noun Phrases ◽  
General Purpose ◽  
Entity Recognition ◽  
Free Text ◽  
Clinical Text ◽  
Named Entity ◽  
Radiology Reports ◽  
Two Measures ◽  
F Measure

BACKGROUND Named entity recognition (NER) plays an important role in extracting the features of descriptions for mining free-text radiology reports. However, the performance of existing NER tools is limited because the number of entities depends on its dictionary lookup. Especially, the recognition of compound terms is very complicated because there are a variety of patterns. OBJECTIVE The objective of the study is to develop and evaluate a NER tool concerned with compound terms using the RadLex for mining free-text radiology reports. METHODS We leveraged the clinical Text Analysis and Knowledge Extraction System (cTAKES) to develop customized pipelines using both RadLex and SentiWordNet (a general-purpose dictionary, GPD). We manually annotated 400 of radiology reports for compound terms (Cts) in noun phrases and used them as the gold standard for the performance evaluation (precision, recall, and F-measure). Additionally, we also created a compound-term-enhanced dictionary (CtED) by analyzing false negatives (FNs) and false positives (FPs), and applied it for another 100 radiology reports for validation. We also evaluated the stem terms of compound terms, through defining two measures: an occurrence ratio (OR) and a matching ratio (MR). RESULTS The F-measure of the cTAKES+RadLex+GPD was 32.2% (Precision 92.1%, Recall 19.6%) and that of combined the CtED was 67.1% (Precision 98.1%, Recall 51.0%). The OR indicated that stem terms of “effusion”, "node", "tube", and "disease" were used frequently, but it still lacks capturing Cts. The MR showed that 71.9% of stem terms matched with that of ontologies and RadLex improved about 22% of the MR from the cTAKES default dictionary. The OR and MR revealed that the characteristics of stem terms would have the potential to help generate synonymous phrases using ontologies. CONCLUSIONS We developed a RadLex-based customized pipeline for parsing radiology reports and demonstrated that CtED and stem term analysis has the potential to improve dictionary-based NER performance toward expanding vocabularies.

Sign in / Sign up

Export Citation Format

Share Document