Statistical Features for Extractive Automatic Text Summarization

2020 ◽  
pp. 619-637
Author(s):  
Yogesh Kumar Meena ◽  
Dinesh Gopalani
Keyword(s):  
Big Data ◽  
Performance Measures ◽  
Relevant Information ◽  
Text Summarization ◽  
Statistical Features ◽  
Information Need ◽  
Evaluation Measures ◽  
Large Size ◽  
Automatic Text Summarization ◽  
Automatic Text

Automatic Text Summarization (ATS) enables users to save their precious time to retrieve their relevant information need while searching voluminous big data. Text summaries are sensitive to scoring methods, as most of the methods requires to weight features for sentence scoring. In this chapter, various statistical features proposed by researchers for extractive automatic text summarization are explored. Features that perform well are termed as best features using ROUGE evaluation measures and used for creating feature combinations. After that, best performing feature combinations are identified. Performance evaluation of best performing feature combinations on short, medium and large size documents is also conducted using same ROUGE performance measures.

Statistical Features for Extractive Automatic Text Summarization

2016 ◽  
pp. 126-144
Author(s):  
Yogesh Kumar Meena ◽  
Dinesh Gopalani
Keyword(s):  
Big Data ◽  
Performance Measures ◽  
Relevant Information ◽  
Text Summarization ◽  
Statistical Features ◽  
Information Need ◽  
Evaluation Measures ◽  
Large Size ◽  
Automatic Text Summarization ◽  
Automatic Text

Automatic Text Summarization (ATS) enables users to save their precious time to retrieve their relevant information need while searching voluminous big data. Text summaries are sensitive to scoring methods, as most of the methods requires to weight features for sentence scoring. In this chapter, various statistical features proposed by researchers for extractive automatic text summarization are explored. Features that perform well are termed as best features using ROUGE evaluation measures and used for creating feature combinations. After that, best performing feature combinations are identified. Performance evaluation of best performing feature combinations on short, medium and large size documents is also conducted using same ROUGE performance measures.

scholarly journals Prediction and Analysis of Extracting Relations using Spacy Model

2020 ◽  
Vol 8 (6) ◽  
pp. 3281-3287
Keyword(s):  
Natural Language ◽  
Information Extraction ◽  
Performance Measures ◽  
Text Summarization ◽  
Language Understanding ◽  
Language Generation ◽  
Automatic Text Summarization ◽  
Structured Information ◽  
Automatic Text ◽  
F Measure

Text is an extremely rich resources of information. Each and every second, minutes, peoples are sending or receiving hundreds of millions of data. There are various tasks involved in NLP are machine learning, information extraction, information retrieval, automatic text summarization, question-answered system, parsing, sentiment analysis, natural language understanding and natural language generation. The information extraction is an important task which is used to find the structured information from unstructured or semi-structured text. The paper presents a methodology for extracting the relations of biomedical entities using spacy. The framework consists of following phases such as data creation, load and converting the data into spacy object, preprocessing, define the pattern and extract the relations. The dataset is downloaded from NCBI database which contains only the sentences. The created model evaluated with performance measures like precision, recall and f-measure. The model achieved 87% of accuracy in retrieving of entities relation.

scholarly journals Text Summarization

2020 ◽  
Vol 9 (2) ◽  
pp. 24940-24945
Author(s):  
A. Vikas ◽  
Pradyumna G.V.N ◽  
Tahir Ahmed Shaik
Keyword(s):  
Relevant Information ◽  
Text Summarization ◽  
The Internet ◽  
Human Beings ◽  
New Era ◽  
Meaningful Information ◽  
Automatic Text Summarization ◽  
Automatic Text

In this new era, where tremendous information is available on the internet, it is most important to provide the improved mechanism to extract the information quickly and most efficiently. It is very difficult for human beings to manually extract the summary of a large documents of text. There are plenty of text material available on the internet. So, there is a problem of searching for relevant documents from the number of documents available and absorbing relevant information from it. In order to solve the above two problems, the automatic text summarization is very much necessary. Text summarization is the process of identifying the most important meaningful information in a document or set of related documents and compressing them into a shorter version preserving its overall meanings.

scholarly journals A Multi-document Summarization System for News Articles in Portuguese using Integer Linear Programming

2019 ◽  
Author(s):  
Laerth Gomes ◽  
Hilário Oliveira
Keyword(s):  
Linear Programming ◽  
Integer Linear Programming ◽  
Relevant Information ◽  
Brazilian Portuguese ◽  
Text Summarization ◽  
Document Summarization ◽  
Automatic Text Summarization ◽  
Summarization System ◽  
Automatic Text ◽  
Intense Research

Automatic Text Summarization (ATS) has been demanding intense research in recent years. Its importance is given the fact that ATS systems can aid in the processing of large amounts of textual documents. The ATS task aims to create a summary of one or more documents by extracting their most relevant information. Despite the existence of several works, researches involving the development of ATS systems for documents written in Brazilian Portuguese are still a few. In this paper, we propose a multi-document summarization system following a concept-based approach using Integer Linear Programming for the generation of summaries from news articles written in Portuguese. Experiments using the CSTNews corpus were performed to evaluate different aspects of the proposed system. The experimental results obtained regarding the ROUGE measures demonstrate that the developed system presents encourage results, outperforming other works of the literature.

Novel Text Summarization Techniques for Contextual Advertising

2014 ◽  
pp. 185-204
Author(s):  
Giuliano Armano ◽  
Alessandro Giuliani
Keyword(s):  
Information Overload ◽  
Relevant Information ◽  
Text Summarization ◽  
Experimental Results ◽  
The Internet ◽  
Continuous Growth ◽  
Automatic Text Summarization ◽  
Contextual Advertising ◽  
Stored Information ◽  
Automatic Text

Recently, there has been a renewed interest on automatic text summarization techniques. The Internet has caused a continuous growth of information overload, focusing the attention on retrieval and filtering needs. Since digitally stored information is more and more available, users need suitable tools able to select, filter, and extract only relevant information. This chapter concentrates on studying and developing techniques for summarizing Webpages. In particular, the focus is the field of contextual advertising, the task of automatically suggesting ads within the content of a generic Webpage. Several novel text summarization techniques are proposed, comparing them with state of the art techniques and assessing whether the proposed techniques can be successfully applied to contextual advertising. Comparative experimental results are also reported and discussed. Results highlight the improvements of the proposals with respect to well-known text summarization techniques.

Novel Text Summarization Techniques for Contextual Advertising

2018 ◽  
pp. 883-903
Author(s):  
Giuliano Armano ◽  
Alessandro Giuliani
Keyword(s):  
Information Overload ◽  
Relevant Information ◽  
Text Summarization ◽  
Experimental Results ◽  
The Internet ◽  
Continuous Growth ◽  
Automatic Text Summarization ◽  
Contextual Advertising ◽  
Stored Information ◽  
Automatic Text

Recently, there has been a renewed interest on automatic text summarization techniques. The Internet has caused a continuous growth of information overload, focusing the attention on retrieval and filtering needs. Since digitally stored information is more and more available, users need suitable tools able to select, filter, and extract only relevant information. This chapter concentrates on studying and developing techniques for summarizing Webpages. In particular, the focus is the field of contextual advertising, the task of automatically suggesting ads within the content of a generic Webpage. Several novel text summarization techniques are proposed, comparing them with state of the art techniques and assessing whether the proposed techniques can be successfully applied to contextual advertising. Comparative experimental results are also reported and discussed. Results highlight the improvements of the proposals with respect to well-known text summarization techniques.

A Quantum-Inspired Genetic Algorithm for Extractive Text Summarization

2021 ◽  
Vol 10 (2) ◽  
pp. 42-60
Author(s):  
Khadidja Chettah ◽  
Amer Draa
Keyword(s):  
Genetic Algorithm ◽  
State Of The Art ◽  
Text Summarization ◽  
Automated System ◽  
Evaluation Metrics ◽  
Document Summarization ◽  
Automatic Text Summarization ◽  
Reference Methods ◽  
Textual Data ◽  
Automatic Text

Automatic text summarization has recently become a key instrument for reducing the huge quantity of textual data. In this paper, the authors propose a quantum-inspired genetic algorithm (QGA) for extractive single-document summarization. The QGA is used inside a totally automated system as an optimizer to search for the best combination of sentences to be put in the final summary. The presented approach is compared with 11 reference methods including supervised and unsupervised summarization techniques. They have evaluated the performances of the proposed approach on the DUC 2001 and DUC 2002 datasets using the ROUGE-1 and ROUGE-2 evaluation metrics. The obtained results show that the proposal can compete with other state-of-the-art methods. It is ranked first out of 12, outperforming all other algorithms.

Sign in / Sign up

Export Citation Format

Share Document