scholarly journals Low Level Linguistic Controls for Style Transfer and Content Preservation

2019 ◽  
Author(s):  
Katy Gero ◽  
Chris Kedzie ◽  
Jonathan Reeve ◽  
Lydia Chilton
Keyword(s):  
Style Transfer ◽  
Low Level ◽  
Content Preservation

scholarly journals Mask Transformer: Unpaired Text Style Transfer Based on Masked Language

2020 ◽  
Vol 10 (18) ◽  
pp. 6196
Author(s):  
Chunhua Wu ◽  
Xiaolong Chen ◽  
Xingbiao Li
Keyword(s):  
Target Sentence ◽  
Explicit Representation ◽  
Experimental Results ◽  
Current Work ◽  
Semantic Meaning ◽  
Style Transfer ◽  
Original Sentence ◽  
Generation Structure ◽  
Content Preservation ◽  
Transfer Accuracy

Currently, most text style transfer methods encode the text into a style-independent latent representation and decode it into new sentences with the target style. Due to the limitation of the latent representation, previous works can hardly get satisfactory target style sentence especially in terms of semantic remaining of the original sentence. We propose a “Mask and Generation” structure, which can obtain an explicit representation of the content of original sentence and generate the target sentence with a transformer. This explicit representation is a masked text that masks the words with the strong style attribute in the sentence. Therefore, it can preserve most of the semantic meaning of the original sentence. In addition, as it is the input of the generator, it also simplified this process compared to the current work who generate the target sentence from scratch. As the explicit representation is readable and the model has better interpretability, we can clearly know which words changed and why the words changed. We evaluate our model on two review datasets with quantitative, qualitative, and human evaluations. The experimental results show that our model generally outperform other methods in terms of transfer accuracy and content preservation.

scholarly journals A Dual Reinforcement Learning Framework for Unsupervised Text Style Transfer

2019 ◽  
Author(s):  
Fuli Luo ◽  
Peng Li ◽  
Jie Zhou ◽  
Pengcheng Yang ◽  
Baobao Chang ◽  
...  
Keyword(s):  
Reinforcement Learning ◽  
State Of The Art ◽  
Style Transfer ◽  
Mapping Model ◽  
Learning Framework ◽  
Parallel Data ◽  
Benchmark Datasets ◽  
One Step ◽  
Content Preservation ◽  
Mapping Models

Unsupervised text style transfer aims to transfer the underlying style of text but keep its main content unchanged without parallel data. Most existing methods typically follow two steps: first separating the content from the original style, and then fusing the content with the desired style. However, the separation in the first step is challenging because the content and style interact in subtle ways in natural language. Therefore, in this paper, we propose a dual reinforcement learning framework to directly transfer the style of the text via a one-step mapping model, without any separation of content and style. Specifically, we consider the learning of the source-to-target and target-to-source mappings as a dual task, and two rewards are designed based on such a dual structure to reflect the style accuracy and content preservation, respectively. In this way, the two one-step mapping models can be trained via reinforcement learning, without any use of parallel data. Automatic evaluations show that our model outperforms the state-of-the-art systems by a large margin, especially with more than 10 BLEU points improvement averaged on two benchmark datasets. Human evaluations also validate the effectiveness of our model in terms of style accuracy, content preservation and fluency. Our code and data, including outputs of all baselines and our model are available at https://github.com/luofuli/DualRL.

scholarly journals Text Style Transfer via Learning Style Instance Supported Latent Space

2020 ◽  
Author(s):  
Xiaoyuan Yi ◽  
Zhenghao Liu ◽  
Wenhao Li ◽  
Maosong Sun
Keyword(s):  
Recent Work ◽  
Learning Style ◽  
Latent Variables ◽  
Paired Data ◽  
Style Transfer ◽  
Parallel Corpora ◽  
Latent Space ◽  
Content Preservation ◽  
Transfer Tasks ◽  
Transfer Accuracy

Text style transfer pursues altering the style of a sentence while remaining its main content unchanged. Due to the lack of parallel corpora, most recent work focuses on unsupervised methods and has achieved noticeable progress. Nonetheless, the intractability of completely disentangling content from style for text leads to a contradiction of content preservation and style transfer accuracy. To address this problem, we propose a style instance supported method, StyIns. Instead of representing styles with embeddings or latent variables learned from single sentences, our model leverages the generative flow technique to extract underlying stylistic properties from multiple instances of each style, which form a more discriminative and expressive latent style space. By combining such a space with the attention-based structure, our model can better maintain the content and simultaneously achieve high transfer accuracy. Furthermore, the proposed method can be flexibly extended to semi-supervised learning so as to utilize available limited paired data. Experiments on three transfer tasks, sentiment modification, formality rephrasing, and poeticness generation, show that StyIns obtains a better balance between content and style, outperforming several recent baselines.

scholarly journals Utilizing Non-Parallel Text for Style Transfer by Making Partial Comparisons

2019 ◽  
Author(s):  
Di Yin ◽  
Shujian Huang ◽  
Xin-Yu Dai ◽  
Jiajun Chen
Keyword(s):  
Data Augmentation ◽  
State Of The Art ◽  
Language Models ◽  
Style Transfer ◽  
Parallel Corpora ◽  
Parallel Data ◽  
Distributional Information ◽  
Parallel Text ◽  
Using Data ◽  
Content Preservation

Text style transfer aims to rephrase a given sentence into a different style without changing its original content. Since parallel corpora (i.e. sentence pairs with the same content but different styles) are usually unavailable, most previous works solely guide the transfer process with distributional information, i.e. using style-related classifiers or language models, which neglect the correspondence of instances, leading to poor transfer performance, especially for the content preservation. In this paper, we propose making partial comparisons to explicitly model the content and style correspondence of instances, respectively. To train the partial comparators, we propose methods to extract partial-parallel training instances automatically from the non-parallel data, and to further enhance the training process by using data augmentation. We perform experiments that compare our method to other existing approaches on two review datasets. Both automatic and manual evaluations show that our approach can significantly improve the performance of existing adversarial methods, and outperforms most state-of-the-art models. Our code and data will be available on Github.

scholarly journals GTAE: Graph Transformer–Based Auto-Encoders for Linguistic-Constrained Text Style Transfer

2021 ◽  
Vol 12 (3) ◽  
pp. 1-16
Author(s):  
Yukai Shi ◽  
Sen Zhang ◽  
Chenxing Zhou ◽  
Xiaodan Liang ◽  
Xiaojun Yang ◽  
...  
Keyword(s):  
Deep Neural Networks ◽  
Model Space ◽  
Style Transfer ◽  
Unconstrained Model ◽  
Linguistic Rules ◽  
Comparable Performance ◽  
Parallel Text ◽  
Content Preservation ◽  
Transfer Tasks ◽  
Transfer Accuracy

Non-parallel text style transfer has attracted increasing research interests in recent years. Despite successes in transferring the style based on the encoder-decoder framework, current approaches still lack the ability to preserve the content and even logic of original sentences, mainly due to the large unconstrained model space or too simplified assumptions on latent embedding space. Since language itself is an intelligent product of humans with certain grammars and has a limited rule-based model space by its nature, relieving this problem requires reconciling the model capacity of deep neural networks with the intrinsic model constraints from human linguistic rules. To this end, we propose a method called Graph Transformer–based Auto-Encoder, which models a sentence as a linguistic graph and performs feature extraction and style transfer at the graph level, to maximally retain the content and the linguistic structure of original sentences. Quantitative experiment results on three non-parallel text style transfer tasks show that our model outperforms state-of-the-art methods in content preservation, while achieving comparable performance on transfer accuracy and sentence naturalness.

Tryptophan-Niacin Metabolism in Rat with Puromycin Aminonucleoside-Induced Nephrosis

2006 ◽  
Vol 76 (1) ◽  
pp. 28-33 ◽  
Author(s):  
Yukari Egashira ◽  
Shin Nagaki ◽  
Hiroo Sanada
Keyword(s):  
Body Weight ◽  
Urinary Excretion ◽  
Enzyme Activities ◽  
Treated Group ◽  
Control Group ◽  
Puromycin Aminonucleoside ◽  
Low Level ◽  
Key Enzyme

We investigated the change of tryptophan-niacin metabolism in rats with puromycin aminonucleoside PAN-induced nephrosis, the mechanisms responsible for their change of urinary excretion of nicotinamide and its metabolites, and the role of the kidney in tryptophan-niacin conversion. PAN-treated rats were intraperitoneally injected once with a 1.0% (w/v) solution of PAN at a dose of 100 mg/kg body weight. The collection of 24-hour urine was conducted 8 days after PAN injection. Daily urinary excretion of nicotinamide and its metabolites, liver and blood NAD, and key enzyme activities of tryptophan-niacin metabolism were determined. In PAN-treated rats, the sum of urinary excretion of nicotinamide and its metabolites was significantly lower compared with controls. The kidneyα-amino-β-carboxymuconate-ε-semialdehyde decarboxylase (ACMSD) activity in the PAN-treated group was significantly decreased by 50%, compared with the control group. Although kidney ACMSD activity was reduced, the conversion of tryptophan to niacin tended to be lower in the PAN-treated rats. A decrease in urinary excretion of niacin and the conversion of tryptophan to niacin in nephrotic rats may contribute to a low level of blood tryptophan. The role of kidney ACMSD activity may be minimal concerning tryptophan-niacin conversion under this experimental condition.

Low-level lead exposure: Are there harmful effects?

1983 ◽  
Vol 28 (1) ◽  
pp. 79-79
Author(s):  
Claire B. Ernhart
Keyword(s):  
Lead Exposure ◽  
Low Level ◽  
Harmful Effects
Sign in / Sign up

Export Citation Format

Share Document