scholarly journals Using Named Entities for Recognizing Family Relationships

2021 ◽  
Author(s):  
E. Oliveira ◽  
G. Dias ◽  
J. Lima ◽  
J. P. C. Pirovani
Keyword(s):  
Language Processing ◽  
Family Relationships ◽  
Named Entity Recognition ◽  
Entity Recognition ◽  
Hard Problem ◽  
Named Entities ◽  
Named Entity ◽  
Hybrid Approaches ◽  
Local Grammar ◽  
F Measure

Named Entity Recognition problem’s objective is to automatically identify and classify entities like persons, places,organizations, and so forth. That is an area in Natural Language Processing and Information Extraction. NamedEntity Recognition is important because it is a fundamental step of preprocessing for several applications like relationextraction. However, it is a hard problem to solve as several categories of named entities are written similarly andthey appear in similar contexts. To accomplish it, we can use some hybrid approaches. Nevertheless, in this presentstudy, we use linguistic flavor by applying Local Grammar and Cascade of Transducers. Local Grammars are used torepresent the rules of a particular linguistic structure. They are often built manually to describe the entities we aimto recognize. In our study, we adapted a Local Grammar to improve the Recognition of Named Entities. The resultsshow an improvement of up to 7% on the F-measure metric in relation to the previous Local Grammar. Also, we builtanother Local Grammar to recognize family relationships from the improved Local Grammar. We present a practicalapplication for the extracted relationships using Prolog.

scholarly journals An Annotated Corpus of Crime-Related Portuguese Documents for NLP and Machine Learning Processing

Data ◽  
2021 ◽  
Vol 6 (7) ◽  
pp. 71
Author(s):  
Gonçalo Carnaz ◽  
Mário Antunes ◽  
Vitor Beires Nogueira
Keyword(s):  
Machine Learning ◽  
Language Processing ◽  
Named Entity Recognition ◽  
Entity Recognition ◽  
Automatic Identification ◽  
Named Entities ◽  
Related Data ◽  
Named Entity ◽  
Chain Of Custody ◽  
Evidence Collection

Criminal investigations collect and analyze the facts related to a crime, from which the investigators can deduce evidence to be used in court. It is a multidisciplinary and applied science, which includes interviews, interrogations, evidence collection, preservation of the chain of custody, and other methods and techniques of investigation. These techniques produce both digital and paper documents that have to be carefully analyzed to identify correlations and interactions among suspects, places, license plates, and other entities that are mentioned in the investigation. The computerized processing of these documents is a helping hand to the criminal investigation, as it allows the automatic identification of entities and their relations, being some of which difficult to identify manually. There exists a wide set of dedicated tools, but they have a major limitation: they are unable to process criminal reports in the Portuguese language, as an annotated corpus for that purpose does not exist. This paper presents an annotated corpus, composed of a collection of anonymized crime-related documents, which were extracted from official and open sources. The dataset was produced as the result of an exploratory initiative to collect crime-related data from websites and conditioned-access police reports. The dataset was evaluated and a mean precision of 0.808, recall of 0.722, and F1-score of 0.733 were obtained with the classification of the annotated named-entities present in the crime-related documents. This corpus can be employed to benchmark Machine Learning (ML) and Natural Language Processing (NLP) methods and tools to detect and correlate entities in the documents. Some examples are sentence detection, named-entity recognition, and identification of terms related to the criminal domain.

scholarly journals A Survey of Arabic Named Entity Recognition and Classification

2014 ◽  
Vol 40 (2) ◽  
pp. 469-510 ◽  
Author(s):  
Khaled Shaalan
Keyword(s):  
Language Processing ◽  
Named Entity Recognition ◽  
Relevant Information ◽  
Arabic Language ◽  
Entity Recognition ◽  
Named Entities ◽  
Linguistic Resources ◽  
Named Entity ◽  
To Receive ◽  
Made In

As more and more Arabic textual information becomes available through the Web in homes and businesses, via Internet and Intranet services, there is an urgent need for technologies and tools to process the relevant information. Named Entity Recognition (NER) is an Information Extraction task that has become an integral part of many other Natural Language Processing (NLP) tasks, such as Machine Translation and Information Retrieval. Arabic NER has begun to receive attention in recent years. The characteristics and peculiarities of Arabic, a member of the Semitic languages family, make dealing with NER a challenge. The performance of an Arabic NER component affects the overall performance of the NLP system in a positive manner. This article attempts to describe and detail the recent increase in interest and progress made in Arabic NER research. The importance of the NER task is demonstrated, the main characteristics of the Arabic language are highlighted, and the aspects of standardization in annotating named entities are illustrated. Moreover, the different Arabic linguistic resources are presented and the approaches used in Arabic NER field are explained. The features of common tools used in Arabic NER are described, and standard evaluation metrics are illustrated. In addition, a review of the state of the art of Arabic NER research is discussed. Finally, we present our conclusions. Throughout the presentation, illustrative examples are used for clarification.

scholarly journals Evaluating named entity recognition tools for extracting social networks from novels

2019 ◽  
Vol 5 ◽  
pp. e189 ◽  
Author(s):  
Niels Dekker ◽  
Tobias Kuhn ◽  
Marieke van Erp
Keyword(s):  
Social Networks ◽  
Social Interactions ◽  
Language Processing ◽  
Named Entity Recognition ◽  
Entity Recognition ◽  
Computer Assisted ◽  
Early 20Th Century ◽  
Automatic Extraction ◽  
Named Entities ◽  
Named Entity

The analysis of literary works has experienced a surge in computer-assisted processing. To obtain insights into the community structures and social interactions portrayed in novels, the creation of social networks from novels has gained popularity. Many methods rely on identifying named entities and relations for the construction of these networks, but many of these tools are not specifically created for the literary domain. Furthermore, many of the studies on information extraction from literature typically focus on 19th and early 20th century source material. Because of this, it is unclear if these techniques are as suitable to modern-day literature as they are to those older novels. We present a study in which we evaluate natural language processing tools for the automatic extraction of social networks from novels as well as their network structure. We find that there are no significant differences between old and modern novels but that both are subject to a large amount of variance. Furthermore, we identify several issues that complicate named entity recognition in our set of novels and we present methods to remedy these. We see this work as a step in creating more culturally-aware AI systems.

scholarly journals Statistical Method for Named Entity Recognition in Telugu, an Indian Language

2019 ◽  
Vol 8 (2) ◽  
pp. 4211-4216
Keyword(s):  
Language Processing ◽  
Conditional Random Fields ◽  
Named Entity Recognition ◽  
Entity Recognition ◽  
Semantic Features ◽  
Indian Language ◽  
Named Entities ◽  
Maximum Entropy Models ◽  
Named Entity ◽  
Proper Nouns

One of the important tasks of Natural Language Processing (NLP) is Named Entity Recognition (NER). The primary operation of NER is to identify proper nouns i.e. to locate all the named entities in the text and tag them as certain named entity categories such as Entity, Time expression and Numeric expression. In the previous works, NER for Telugu language is addressed with Conditional Random Fields (CRF) and Maximum Entropy models however they failed to handle ambiguous named entity tags for the same named entity. This paper presents a hybrid statistical system for Named Entity Recognition in Telugu language in which named entities are identified by both dictionary-based approach and statistical Hidden Markov Model (HMM). The proposed method uses Lexicon-lookup dictionary and contexts based on semantic features for predicting named entity tags. Further HMM is used to resolve the named entity ambiguities in predicted named entity tags. The present work reports an average accuracy of 86.3% for finding the named entities

scholarly journals Evaluating social network extraction for classic and modern fiction literature

2018 ◽  
Author(s):  
Niels Dekker ◽  
Tobias Kuhn ◽  
Marieke van Erp
Keyword(s):  
Social Networks ◽  
Science Fiction ◽  
19Th Century ◽  
Language Processing ◽  
Named Entity Recognition ◽  
Entity Recognition ◽  
Computer Assisted ◽  
Named Entities ◽  
Named Entity ◽  
Modern Fiction

The analysis of literary works has experienced a surge in computer-assisted processing. To obtain insights into the community structures and social interactions portrayed in novels the creation of social networks from novels has gained popularity. Many methods rely on identifying named entities and relations for the construction of these networks, but many of these tools are not specifically created for the literary domain. Furthermore, many of the studies on information extraction from literature typically focus on 19th century source material. Because of this, it is unclear if these techniques are as suitable to modern-day science fiction and fantasy literature as they are to those 19th century classics. We present a study to compare classic literature to modern literature in terms of performance of natural language processing tools for the automatic extraction of social networks as well as their network structure. We find that there are no significant differences between the two sets of novels but that both are subject to a high amount of variance. Furthermore, we identify several issues that complicate named entity recognition in modern novels and we present methods to remedy these.

Location Named-Entity Recognition using Rule-Based Approach for Balinese Texts

2021 ◽  
Vol 9 (3) ◽  
pp. 435
Author(s):  
Ni Putu Ayu Sherly Anggita S ◽  
Ngurah Agus Sanjaya ER
Keyword(s):  
Language Processing ◽  
Named Entity Recognition ◽  
Entity Recognition ◽  
Main Task ◽  
Rule Based ◽  
Personal Names ◽  
Named Entity ◽  
Proposed Model ◽  
Rule Based Approach ◽  
F Measure

In Natural Language Processing (NLP), Named Recognition Entity (NER) is a sub-discussion widely used for research. The NER’s main task is to help identify and detect the entity-named in the sentence, such as personal names, locations, organizations, and many other entities. In this paper, we present a Location NER system for Balinese texts using a rule-based approach. NER in the Balinese document is an essential and challenging task because there is no research on this. The rule-based approach using human-made rules to extract entity name is one of the most famous ways to extract entity names as well as machine learning. The system aims to identify proper names in the corpus and classify them into locations class. Precision, recall, and F-measure used for the evaluation. Our results show that our proposed model is trustworthy enough, having average recall, precision, and f-measure values for the specific location entity, respectively, 0.935, 0.936, and 0.92. These results prove that our system is capable of recognizing named-entities of Balinese texts.

Techniques for Named Entity Recognition on Arabic-English Code-Mixed Data

2019 ◽  
pp. 44-63
Author(s):  
Caroline Sabty ◽  
Ahmed Sherif ◽  
Mohamed Elmahdy ◽  
Slim Abdennadher
Keyword(s):  
Language Processing ◽  
Named Entity Recognition ◽  
Arab Countries ◽  
Entity Recognition ◽  
Mixed Data ◽  
Word Embeddings ◽  
Named Entities ◽  
Named Entity ◽  
Code Mixing ◽  
Social Media Platforms

As a result of globalization and better quality of education, a signifcant percentage of the population in Arab countries have become bilingual/multilingual. This has raised the frequency of code-switching and code-mixing among Arabs in daily communication. Consequently, huge amount of Code-Mixed (CM) content can be found on different social media platforms. Such data could be analyzed and used in different Natural Language Processing (NLP) tasks to tackle the challenges emerging due to this multilingual phenomenon. Named-Entity Recognition (NER) is one of the major tasks for several NLP systems. It is the process of identifying named entities in text. However, there is a lack of annotated CM data and resources for such task. This work aims at collecting and building the first annotated CM Arabic-English corpus for NER. Furthermore, we constructed a baseline NER system using deep neural networks and word embeddings for Arabic-English CM text. Moreover, we investigated the usage of different types of classical and contextual pre-trained word embeddings on our system. The highest NER system achieved an F1-score of 77.69% by combining classical and contextual word embeddings.

scholarly journals Domain-Transferable Method for Named Entity Recognition Task

2020 ◽  
Author(s):  
Vladislav Mikhailov ◽  
Tatiana Shavrina
Keyword(s):  
Language Processing ◽  
Question Answering ◽  
Named Entity Recognition ◽  
Recognition Task ◽  
Entity Recognition ◽  
Neural Models ◽  
Named Entities ◽  
Named Entity ◽  
Domain Specific ◽  
Human Effort

Named Entity Recognition (NER) is a fundamental task in the fields of natural language processing and information extraction. NER has been widely used as a standalone tool or an essential component in a variety of applications such as question answering, dialogue assistants and knowledge graphs development. However, training reliable NER models requires a large amount of labelled data which is expensive to obtain, particularly in specialized domains. This paper describes a method to learn a domain-specific NER model for an arbitrary set of named entities when domain-specific supervision is not available. We assume that the supervision can be obtained with no human effort, and neural models can learn from each other. The code, data and models are publicly available.

scholarly journals Towards the Construction of a Gold Standard Biomedical Corpus for the Romanian Language

Data ◽  
2018 ◽  
Vol 3 (4) ◽  
pp. 53 ◽  
Author(s):  
Maria Mitrofan ◽  
Verginica Barbu Mititelu ◽  
Grigorina Mitrofan
Keyword(s):  
Language Processing ◽  
Gold Standard ◽  
Named Entity Recognition ◽  
Entity Recognition ◽  
Language Resources ◽  
Named Entities ◽  
Named Entity ◽  
Pos Tagging ◽  
Part Of Speech ◽  
Biomedical Named Entity Recognition

Gold standard corpora (GSCs) are essential for the supervised training and evaluation of systems that perform natural language processing (NLP) tasks. Currently, most of the resources used in biomedical NLP tasks are mainly in English. Little effort has been reported for other languages including Romanian and, thus, access to such language resources is poor. In this paper, we present the construction of the first morphologically and terminologically annotated biomedical corpus of the Romanian language (MoNERo), meant to serve as a gold standard for biomedical part-of-speech (POS) tagging and biomedical named entity recognition (bioNER). It contains 14,012 tokens distributed in three medical subdomains: cardiology, diabetes and endocrinology, extracted from books, journals and blogposts. In order to automatically annotate the corpus with POS tags, we used a Romanian tag set which has 715 labels, while diseases, anatomy, procedures and chemicals and drugs labels were manually annotated for bioNER with a Cohen Kappa coefficient of 92.8% and revealed the occurrence of 1877 medical named entities. The automatic annotation of the corpus has been manually checked. The corpus is publicly available and can be used to facilitate the development of NLP algorithms for the Romanian language.

NERA 2.0: Improving coverage and performance of rule-based named entity recognition for Arabic

2016 ◽  
Vol 23 (3) ◽  
pp. 441-472 ◽  
Author(s):  
MAI OUDAH ◽  
KHALED SHAALAN
Keyword(s):  
Language Processing ◽  
Hybrid Approach ◽  
Named Entity Recognition ◽  
Entity Recognition ◽  
Rule Base ◽  
Named Entities ◽  
Rule Based ◽  
Named Entity ◽  
Linguistic Rules ◽  
Person Location

AbstractNamed Entity Recognition (NER) is an essential task for many natural language processing systems, which makes use of various linguistic resources. NER becomes more complicated when the language in use is morphologically rich and structurally complex, such as Arabic. This language has a set of characteristics that makes it particularly challenging to handle. In a previous work, we have proposed an Arabic NER system that follows the hybrid approach, i.e. integrates both rule-based and machine learning-based NER approaches. Our hybrid NER system is the state-of-the-art in Arabic NER according to its performance on standard evaluation datasets. In this article, we discuss a novel methodology for overcoming the coverage drawback of rule-based NER systems in order to improve their performance and allow for automated rule update. The presented mechanism utilizes the recognition decisions made by the hybrid NER system in order to identify the weaknesses of the rule-based component and derive new linguistic rules aiming at enhancing the rule base, which will help in achieving more reliable and accurate results. We used ACE 2004 Newswire standard dataset as a resource for extracting and analyzing new linguistic rules for person, location and organization names recognition. We formulate each new rule based on two distinctive feature groups, i.e. Gazetteers of each type of named entities and Part-of-Speech tags, in particular noun and proper noun. Fourteen new patterns are derived, formulated as grammar rules, and evaluated in terms of coverage. The conducted experiments exploit a POS tagged version of the ACE 2004 NW dataset. The empirical results show that the performance of the enhanced rule-based system, i.e. NERA 2.0, improves the coverage of the previously misclassified person, location and organization named entities types by 69.93 per cent, 57.09 per cent and 54.28 per cent, respectively.

Sign in / Sign up

Export Citation Format

Share Document