Corpus and Baseline Model for Domain-Specific Entity Recognition in German

2020 ◽  
Author(s):  
Sunna Torge ◽  
Waldemar Hahn ◽  
Rene Jakel ◽  
Wolfgang E. Nagel
Keyword(s):  
Entity Recognition ◽  
Baseline Model ◽  
Domain Specific

scholarly journals TaxoNERD: deep neural models for the recognition of taxonomic entities in the ecological and evolutionary literature

2021 ◽  
Author(s):  
Nicolas Le Guillarme ◽  
Wilfried Thuiller
Keyword(s):  
Information Extraction ◽  
High Performance ◽  
Named Entity Recognition ◽  
Open Data ◽  
Entity Recognition ◽  
Data Repositories ◽  
Biodiversity Crisis ◽  
Domain Specific ◽  
Ecological Information ◽  
Gold Standard Corpus

1. Given the biodiversity crisis, we more than ever need to access information on multiple taxa (e.g. distribution, traits, diet) in the scientific literature to understand, map and predict all-inclusive biodiversity. Tools are needed to automatically extract useful information from the ever-growing corpus of ecological texts and feed this information to open data repositories. A prerequisite is the ability to recognise mentions of taxa in text, a special case of named entity recognition (NER). In recent years, deep learning-based NER systems have become ubiqutous, yielding state-of-the-art results in the general and biomedical domains. However, no such tool is available to ecologists wishing to extract information from the biodiversity literature. 2. We propose a new tool called TaxoNERD that provides two deep neural network (DNN) models to recognise taxon mentions in ecological documents. To achieve high performance, DNN-based NER models usually need to be trained on a large corpus of manually annotated text. Creating such a gold standard corpus (GSC) is a laborious and costly process, with the result that GSCs in the ecological domain tend to be too small to learn an accurate DNN model from scratch. To address this issue, we leverage existing DNN models pretrained on large biomedical corpora using transfer learning. The performance of our models is evaluated on four GSCs and compared to the most popular taxonomic NER tools. 3. Our experiments suggest that existing taxonomic NER tools are not suited to the extraction of ecological information from text as they performed poorly on ecologically-oriented corpora, either because they do not take account of the variability of taxon naming practices, or because they do not generalise well to the ecological domain. Conversely, a domain-specific DNN-based tool like TaxoNERD outperformed the other approaches on an ecological information extraction task. 4. Efforts are needed in order to raise ecological information extraction to the same level of performance as its biomedical counterpart. One promising direction is to leverage the huge corpus of unlabelled ecological texts to learn a language representation model that could benefit downstream tasks. These efforts could be highly beneficial to ecologists on the long term.

scholarly journals Evaluating Word Similarity Measure of Embeddings Through Binary Classification

2019 ◽  
Vol 1 (3) ◽  
Author(s):  
A. Aziz Altowayan ◽  
Lixin Tao
Keyword(s):  
Similarity Measure ◽  
Binary Classification ◽  
General Purpose ◽  
Feature Representation ◽  
Entity Recognition ◽  
Language Models ◽  
Data Set ◽  
Word Similarity ◽  
Domain Specific ◽  
Retrieval Rate

We consider the following problem: given neural language models (embeddings) each of which is trained on an unknown data set, how can we determine which model would provide a better result when used for feature representation in a downstream task such as text classification or entity recognition? In this paper, we assess the word similarity measure through analyzing its impact on word embeddings learned from various datasets and how they perform in a simple classification task. Word representations were learned and assessed under the same conditions. For training word vectors, we used the implementation of Continuous Bag of Words described in [1]. To assess the quality of the vectors, we applied the analogy questions test for word similarity described in the same paper. Further, to measure the retrieval rate of an embedding model, we introduced a new metric (Average Retrieval Error) which measures the percentage of missing words in the model. We observe that scoring a high accuracy of syntactic and semantic similarities between word pairs is not an indicator of better classification results. This observation can be justified by the fact that a domain-specific corpus contributes to the performance better than a general-purpose corpus. For reproducibility, we release our experiments scripts and results.

scholarly journals A Probability based Classification of Named Entities for Malayalam Language combining Word, Part of Speech and Lexicalized features

2019 ◽  
Vol 8 (2) ◽  
pp. 839-842
Keyword(s):  
Named Entity Recognition ◽  
Entity Recognition ◽  
Supervised Machine Learning ◽  
Named Entities ◽  
Named Entity ◽  
Domain Specific ◽  
Part Of Speech ◽  
Classification Probability ◽  
Malayalam Language

Named Entity Recognition is the process wherein named entities which are designators of a sentence are identified. Designators of a sentence are domain specific. The proposed system identifies named entities in Malayalam language belonging to tourism domain which generally includes names of persons, places, organizations, dates etc. The system uses word, part of speech and lexicalized features to find the probability of a word belonging to a named entity category and to do the appropriate classification. Probability is calculated based on supervised machine learning using word and part of speech features present in a tagged training corpus and using certain rules applied based on lexicalized features.

scholarly journals BioALBERT: A Simple and Effective Pre-trained Language Model for Biomedical Named Entity Recognition

2020 ◽  
Author(s):  
Usman Naseem ◽  
Matloob Khushi ◽  
Vinay Reddy ◽  
Sakthivel Rajendran ◽  
Imran Razzak ◽  
...  
Keyword(s):  
State Of The Art ◽  
Language Model ◽  
Named Entity Recognition ◽  
Training Data ◽  
Entity Recognition ◽  
Future Research ◽  
Named Entity ◽  
Domain Specific ◽  
Context Dependent ◽  
Biomedical Named Entity Recognition

Abstract Background: In recent years, with the growing amount of biomedical documents, coupled with advancement in natural language processing algorithms, the research on biomedical named entity recognition (BioNER) has increased exponentially. However, BioNER research is challenging as NER in the biomedical domain are: (i) often restricted due to limited amount of training data, (ii) an entity can refer to multiple types and concepts depending on its context and, (iii) heavy reliance on acronyms that are sub-domain specific. Existing BioNER approaches often neglect these issues and directly adopt the state-of-the-art (SOTA) models trained in general corpora which often yields unsatisfactory results. Results: We propose biomedical ALBERT (A Lite Bidirectional Encoder Representations from Transformers for Biomedical Text Mining) - bioALBERT - an effective domain-specific pre-trained language model trained on huge biomedical corpus designed to capture biomedical context-dependent NER. We adopted self-supervised loss function used in ALBERT that targets on modelling inter-sentence coherence to better learn context-dependent representations and incorporated parameter reduction strategies to minimise memory usage and enhance the training time in BioNER. In our experiments, BioALBERT outperformed comparative SOTA BioNER models on eight biomedical NER benchmark datasets with four different entity types. The performance is increased for; (i) disease type corpora by 7.47% (NCBI-disease) and 10.63% (BC5CDR-disease); (ii) drug-chem type corpora by 4.61% (BC5CDR-Chem) and 3.89 (BC4CHEMD); (iii) gene-protein type corpora by 12.25% (BC2GM) and 6.42% (JNLPBA); and (iv) Species type corpora by 6.19% (LINNAEUS) and 23.71% (Species-800) is observed which leads to a state-of-the-art results. Conclusions: The performance of proposed model on four different biomedical entity types shows that our model is robust and generalizable in recognizing biomedical entities in text. We trained four different variants of BioALBERT models which are available for the research community to be used in future research.

Named Entity Recognition for Ontology Population using Background Knowledge from Wikipedia

2011 ◽  
pp. 79-104 ◽  
Author(s):  
Ziqi Zhang ◽  
Fabio Ciravegna
Keyword(s):  
Knowledge Acquisition ◽  
Research Work ◽  
Named Entity Recognition ◽  
Background Knowledge ◽  
Entity Recognition ◽  
Web Resources ◽  
Named Entity ◽  
Domain Specific ◽  
Ontology Population ◽  
Complex Knowledge

Named Entity Recognition (NER) deals with identifying and classifying atomic texts into pre-defined ontological classes. It is the enabling technique to many complex knowledge acquisition tasks. The recent flourish of Web resources has opened new opportunities and challenges for knowledge acquisition. In the domain of NER and its application in ontology population, considerable research work has been dedicated to exploiting background knowledge from Web resources to enhance the accuracy of the system. This chapter gives a review of existing literature in this domain with an emphasis on using background knowledge extracted from the Web resources. The authors discuss the benefits of using background knowledge and the inadequacies of existing work. They then propose a novel method that automatically creates domain-specific background knowledge by exploring the Wikipedia knowledge base in a domain- and language-independent way. The authors empirically show that the method can be adapted to ontology population, and generates high quality background knowledge that improves the accuracy of domain-specific NER.

Techniques for Named Entity Recognition

2012 ◽  
pp. 191-217 ◽  
Author(s):  
Girish Keshav Palshikar
Keyword(s):  
Semantic Processing ◽  
Named Entity Recognition ◽  
Entity Recognition ◽  
Named Entities ◽  
Named Entity ◽  
Domain Specific ◽  
Number Of Factors ◽  
Web Contents ◽  
Biological Domain

While building and using a fully semantic understanding of Web contents is a distant goal, named entities (NEs) provide a small, tractable set of elements carrying a well-defined semantics. Generic named entities are names of persons, locations, organizations, phone numbers, and dates, while domain-specific named entities includes names of for example, proteins, enzymes, organisms, genes, cells, et cetera, in the biological domain. An ability to automatically perform named entity recognition (NER) – i.e., identify occurrences of NE in Web contents – can have multiple benefits, such as improving the expressiveness of queries and also improving the quality of the search results. A number of factors make building highly accurate NER a challenging task. Given the importance of NER in semantic processing of text, this chapter presents a detailed survey of NER techniques for English text.

Techniques for Named Entity Recognition

2013 ◽  
pp. 400-426 ◽  
Author(s):  
Girish Keshav Palshikar
Keyword(s):  
Semantic Processing ◽  
Named Entity Recognition ◽  
Entity Recognition ◽  
Named Entities ◽  
Named Entity ◽  
Domain Specific ◽  
Number Of Factors ◽  
Web Contents ◽  
Biological Domain

While building and using a fully semantic understanding of Web contents is a distant goal, named entities (NEs) provide a small, tractable set of elements carrying a well-defined semantics. Generic named entities are names of persons, locations, organizations, phone numbers, and dates, while domain-specific named entities includes names of for example, proteins, enzymes, organisms, genes, cells, et cetera, in the biological domain. An ability to automatically perform named entity recognition (NER) – i.e., identify occurrences of NE in Web contents – can have multiple benefits, such as improving the expressiveness of queries and also improving the quality of the search results. A number of factors make building highly accurate NER a challenging task. Given the importance of NER in semantic processing of text, this chapter presents a detailed survey of NER techniques for English text.

The Impact of Domain-Specific Pre-Training on Named Entity Recognition Tasks in Materials Science

2021 ◽  
Author(s):  
Nicholas Walker ◽  
Amalie Trewartha ◽  
Haoyan Huo ◽  
Sanghoon Lee ◽  
Kevin Cruse ◽  
...  
Keyword(s):  
Materials Science ◽  
Named Entity Recognition ◽  
Entity Recognition ◽  
Named Entity ◽  
Domain Specific ◽  
The Impact
Sign in / Sign up

Export Citation Format

Share Document