scholarly journals LTP: A New Active Learning Strategy for CRF-Based Named Entity Recognition

2022 ◽  
Author(s):  
Mingyi Liu ◽  
Zhiying Tu ◽  
Tong Zhang ◽  
Tonghua Su ◽  
Xiaofei Xu ◽  
...  
Keyword(s):  
Active Learning ◽  
Learning Strategy ◽  
Named Entity Recognition ◽  
Entity Recognition ◽  
Named Entity ◽  
Active Learning Strategy

scholarly journals Fine-Grained Mechanical Chinese Named Entity Recognition Based on ALBERT-AttBiLSTM-CRF and Transfer Learning

Symmetry ◽  
2020 ◽  
Vol 12 (12) ◽  
pp. 1986
Author(s):  
Liguo Yao ◽  
Haisong Huang ◽  
Kuan-Wei Wang ◽  
Shih-Huan Chen ◽  
Qiaoqiao Xiong
Keyword(s):  
Active Learning ◽  
Manufacturing Industry ◽  
Learning Strategy ◽  
Named Entity Recognition ◽  
Entity Recognition ◽  
Utilization Rate ◽  
Data Types ◽  
Fine Grained ◽  
Named Entity ◽  
Model Transfer

Manufacturing text often exists as unlabeled data; the entity is fine-grained and the extraction is difficult. The above problems mean that the manufacturing industry knowledge utilization rate is low. This paper proposes a novel Chinese fine-grained NER (named entity recognition) method based on symmetry lightweight deep multinetwork collaboration (ALBERT-AttBiLSTM-CRF) and model transfer considering active learning (MTAL) to research fine-grained named entity recognition of a few labeled Chinese textual data types. The method is divided into two stages. In the first stage, the ALBERT-AttBiLSTM-CRF was applied for verification in the CLUENER2020 dataset (Public dataset) to get a pretrained model; the experiments show that the model obtains an F1 score of 0.8962, which is better than the best baseline algorithm, an improvement of 9.2%. In the second stage, the pretrained model was transferred into the Manufacturing-NER dataset (our dataset), and we used the active learning strategy to optimize the model effect. The final F1 result of Manufacturing-NER was 0.8931 after the model transfer (it was higher than 0.8576 before the model transfer); so, this method represents an improvement of 3.55%. Our method effectively transfers the existing knowledge from public source data to scientific target data, solving the problem of named entity recognition with scarce labeled domain data, and proves its effectiveness.

scholarly journals Text Mining of Hazard and Operability Analysis Reports Based on Active Learning

Processes ◽  
2021 ◽  
Vol 9 (7) ◽  
pp. 1178
Author(s):  
Zhenhua Wang ◽  
Beike Zhang ◽  
Dong Gao
Keyword(s):  
Active Learning ◽  
Named Entity Recognition ◽  
Entity Recognition ◽  
Chemical System ◽  
Chemical Safety ◽  
High Quality ◽  
Data Set ◽  
Final Model ◽  
Named Entity ◽  
Sampling Algorithms

In the field of chemical safety, a named entity recognition (NER) model based on deep learning can mine valuable information from hazard and operability analysis (HAZOP) text, which can guide experts to carry out a new round of HAZOP analysis, help practitioners optimize the hidden dangers in the system, and be of great significance to improve the safety of the whole chemical system. However, due to the standardization and professionalism of chemical safety analysis text, it is difficult to improve the performance of traditional models. To solve this problem, in this study, an improved method based on active learning is proposed, and three novel sampling algorithms are designed, Variation of Token Entropy (VTE), HAZOP Confusion Entropy (HCE) and Amplification of Least Confidence (ALC), which improve the ability of the model to understand HAZOP text. In this method, a part of data is used to establish the initial model. The sampling algorithm is then used to select high-quality samples from the data set. Finally, these high-quality samples are used to retrain the whole model to obtain the final model. The experimental results show that the performance of the VTE, HCE, and ALC algorithms are better than that of random sampling algorithms. In addition, compared with other methods, the performance of the traditional model is improved effectively by the method proposed in this paper, which proves that the method is reliable and advanced.

scholarly journals Using error decay prediction to overcome practical issues of deep active learning for named entity recognition

2020 ◽  
Vol 109 (9-10) ◽  
pp. 1749-1778
Author(s):  
Haw-Shiuan Chang ◽  
Shankar Vembu ◽  
Sunil Mohan ◽  
Rheeya Uppaal ◽  
Andrew McCallum
Keyword(s):  
Active Learning ◽  
Named Entity Recognition ◽  
Entity Recognition ◽  
Named Entity

scholarly journals A Low-Cost Named Entity Recognition Research Based on Active Learning

2018 ◽  
Vol 2018 ◽  
pp. 1-10 ◽  
Author(s):  
Han Huang ◽  
Hongyu Wang ◽  
Dawei Jin
Keyword(s):  
Active Learning ◽  
Language Processing ◽  
Selection Process ◽  
Conditional Random Field ◽  
Low Cost ◽  
Named Entity Recognition ◽  
Entity Recognition ◽  
Training Set ◽  
Processing Technologies ◽  
Named Entity

Named entity recognition (NER) is an indispensable and very important part of many natural language processing technologies, such as information extraction, information retrieval, and intelligent Q & A. This paper describes the development of the AL-CRF model, which is a NER approach based on active learning (AL). The algorithmic sequence of the processes performed by the AL-CRF model is the following: first, the samples are clustered using the k-means approach. Then, stratified sampling is performed on the produced clusters in order to obtain initial samples, which are used to train the basic conditional random field (CRF) classifier. The next step includes the initiation of the selection process which uses the criterion of entropy. More specifically, samples having the highest entropy values are added to the training set. Afterwards, the learning process is repeated, and the CRF classifier is retrained based on the obtained training set. The learning and the selection process of the AL is running iteratively until the harmonic mean F stabilizes and the final NER model is obtained. Several NER experiments are performed on legislative and medical cases in order to validate the AL-CRF performance. The testing data include Chinese judicial documents and Chinese electronic medical records (EMRs). Testing indicates that our proposed algorithm has better recognition accuracy and recall rate compared to the conventional CRF model. Moreover, the main advantage of our approach is that it requires fewer manually labelled training samples, and at the same time, it is more effective. This can result in a more cost effective and more reliable process.

A named entity recognition approach for tweet streams using active learning

2017 ◽  
Vol 32 (2) ◽  
pp. 1277-1287 ◽  
Author(s):  
Van Cuong Tran ◽  
Dinh Tuyen Hoang ◽  
Ngoc Thanh Nguyen ◽  
Dosam Hwang
Keyword(s):  
Active Learning ◽  
Named Entity Recognition ◽  
Entity Recognition ◽  
Named Entity

Combining Self Learning and Active Learning for Chinese Named Entity Recognition

2010 ◽  
Vol 5 (5) ◽  
Author(s):  
Chengjie Sun ◽  
Lin Yao ◽  
Xiaolong Wang ◽  
Xuan Wang
Keyword(s):  
Active Learning ◽  
Named Entity Recognition ◽  
Entity Recognition ◽  
Named Entity ◽  
Self Learning

scholarly journals An active learning-enabled annotation system for clinical named entity recognition

2017 ◽  
Vol 17 (S2) ◽  
Author(s):  
Yukun Chen ◽  
Thomas A. Lask ◽  
Qiaozhu Mei ◽  
Qingxia Chen ◽  
Sungrim Moon ◽  
...  
Keyword(s):  
Active Learning ◽  
Named Entity Recognition ◽  
Entity Recognition ◽  
Named Entity ◽  
Annotation System

Named Entity Recognition and Relation Extraction for COVID-19: Explainable Active Learning with Word2vec Embeddings and Transformer-Based BERT Models

2021 ◽  
pp. 158-163
Author(s):  
M. Arguello-Casteleiro ◽  
N. Maroto ◽  
C. Wroe ◽  
C. Sevillano Torrado ◽  
C. Henson ◽  
...  
Keyword(s):  
Active Learning ◽  
Named Entity Recognition ◽  
Relation Extraction ◽  
Entity Recognition ◽  
Named Entity
Sign in / Sign up

Export Citation Format

Share Document