Research on Abstractive Automatic Summarization Technology Based on Deep Learning

Abstract Automatic summarization of natural language is a widely studied area in computer science, one that is broadly applicable to anyone who needs to understand large quantities of information. In the medical domain, automatic summarization has the potential to make health information more accessible to people without medical expertise. However, to evaluate the quality of summaries generated by summarization algorithms, researchers first require gold standard, human generated summaries. Unfortunately there is no available data for the purpose of assessing summaries that help consumers of health information answer their questions. To address this issue, we present the MEDIQA-Answer Summarization dataset, the first dataset designed for question-driven, consumer-focused summarization. It contains 156 health questions asked by consumers, answers to these questions, and manually generated summaries of these answers. The dataset’s unique structure allows it to be used for at least eight different types of summarization evaluations. We also benchmark the performance of baseline and state-of-the-art deep learning approaches on the dataset, demonstrating how it can be used to evaluate automatically generated summaries.

Download Full-text

A Reinforced Topic-Aware Convolutional Sequence-to-Sequence Model for Abstractive Text Summarization

Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence ◽

10.24963/ijcai.2018/619 ◽

2018 ◽

Cited By ~ 17

Author(s):

Li Wang ◽

Junlin Yao ◽

Yunzhe Tao ◽

Li Zhong ◽

Wei Liu ◽

...

Keyword(s):

Deep Learning ◽

Experimental Evaluation ◽

State Of The Art ◽

Text Summarization ◽

The Other ◽

Learning Approach ◽

Automatic Summarization ◽

Word Level ◽

Proposed Model ◽

Abstractive Summarization

In this paper, we propose a deep learning approach to tackle the automatic summarization tasks by incorporating topic information into the convolutional sequence-to-sequence (ConvS2S) model and using self-critical sequence training (SCST) for optimization. Through jointly attending to topics and word-level alignment, our approach can improve coherence, diversity, and informativeness of generated summaries via a biased probability generation mechanism. On the other hand, reinforcement training, like SCST, directly optimizes the proposed model with respect to the non-differentiable metric ROUGE, which also avoids the exposure bias during inference. We carry out the experimental evaluation with state-of-the-art methods over the Gigaword, DUC-2004, and LCSTS datasets. The empirical results demonstrate the superiority of our proposed method in the abstractive summarization.

Download Full-text

Using Unsupervised Deep Learning for Automatic Summarization of Arabic Documents

Arabian Journal for Science and Engineering ◽

10.1007/s13369-018-3198-y ◽

2018 ◽

Vol 43 (12) ◽

pp. 7803-7815 ◽

Cited By ~ 5

Author(s):

Nabil Alami ◽

Noureddine En-nahnahi ◽

Said Alaoui Ouatik ◽

Mohammed Meknassi

Keyword(s):

Deep Learning ◽

Automatic Summarization ◽

Unsupervised Deep Learning

Download Full-text

Deep Learning

10.1017/cbo9780511780295 ◽

2009 ◽

Cited By ~ 94

Author(s):

Stellan Ohlsson

Keyword(s):

Deep Learning

Download Full-text

Intelligence artificielle : le futur de l’Orthodontie ?

Revue d Orthopédie Dento-Faciale ◽

10.1051/odf/2019026 ◽

2019 ◽

Vol 53 (3) ◽

pp. 281-294

Author(s):

Jean-Michel Foucart ◽

Augustin Chavanne ◽

Jérôme Bourriau

Keyword(s):

Big Data ◽

Deep Learning ◽

Intelligence Artificielle ◽

Set Up

Nombreux sont les apports envisagés de l’Intelligence Artificielle (IA) en médecine. En orthodontie, plusieurs solutions automatisées sont disponibles depuis quelques années en imagerie par rayons X (analyse céphalométrique automatisée, analyse automatisée des voies aériennes) ou depuis quelques mois (analyse automatique des modèles numériques, set-up automatisé; CS Model +, Carestream Dental™). L’objectif de cette étude, en deux parties, est d’évaluer la fiabilité de l’analyse automatisée des modèles tant au niveau de leur numérisation que de leur segmentation. La comparaison des résultats d’analyse des modèles obtenus automatiquement et par l’intermédiaire de plusieurs orthodontistes démontre la fiabilité de l’analyse automatique; l’erreur de mesure oscillant, in fine, entre 0,08 et 1,04 mm, ce qui est non significatif et comparable avec les erreurs de mesures inter-observateurs rapportées dans la littérature. Ces résultats ouvrent ainsi de nouvelles perspectives quand à l’apport de l’IA en Orthodontie qui, basée sur le deep learning et le big data, devrait permettre, à moyen terme, d’évoluer vers une orthodontie plus préventive et plus prédictive.

Download Full-text