scholarly journals Integrating Relation Constraints with Neural Relation Extractors

2020 ◽  
Vol 34 (05) ◽  
pp. 9442-9449
Author(s):  
Yuan Ye ◽  
Yansong Feng ◽  
Bingfeng Luo ◽  
Yuxuan Lai ◽  
Dongyan Zhao
Keyword(s):  
Neural Networks ◽  
Source Code ◽  
Relation Extraction ◽  
Rapid Progress ◽  
Post Processing ◽  
Unified Framework ◽  
Loss Term

Recent years have seen rapid progress in identifying predefined relationship between entity pairs using neural networks (NNs). However, such models often make predictions for each entity pair individually, thus often fail to solve the inconsistency among different predictions, which can be characterized by discrete relation constraints. These constraints are often defined over combinations of entity-relation-entity triples, since there often lack of explicitly well-defined type and cardinality requirements for the relations. In this paper, we propose a unified framework to integrate relation constraints with NNs by introducing a new loss term, Constraint Loss. Particularly, we develop two efficient methods to capture how well the local predictions from multiple instance pairs satisfy the relation constraints. Experiments on both English and Chinese datasets show that our approach can help NNs learn from discrete relation constraints to reduce inconsistency among local predictions, and outperform popular neural relation extraction (NRE) models even enhanced with extra post-processing. Our source code and datasets will be released at https://github.com/PKUYeYuan/Constraint-Loss-AAAI-2020.

scholarly journals Robust and fast post-processing of single-shot spin qubit detection events with a neural network

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Tom Struck ◽  
Javed Lindner ◽  
Arne Hollmann ◽  
Floyd Schauer ◽  
Andreas Schmidbauer ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Bayesian Inference ◽  
Rabi Oscillation ◽  
Detection Methods ◽  
Measured Signal ◽  
Single Shot ◽  
Post Processing ◽  
Readout Signal ◽  
Spin Qubit

AbstractEstablishing low-error and fast detection methods for qubit readout is crucial for efficient quantum error correction. Here, we test neural networks to classify a collection of single-shot spin detection events, which are the readout signal of our qubit measurements. This readout signal contains a stochastic peak, for which a Bayesian inference filter including Gaussian noise is theoretically optimal. Hence, we benchmark our neural networks trained by various strategies versus this latter algorithm. Training of the network with 106 experimentally recorded single-shot readout traces does not improve the post-processing performance. A network trained by synthetically generated measurement traces performs similar in terms of the detection error and the post-processing speed compared to the Bayesian inference filter. This neural network turns out to be more robust to fluctuations in the signal offset, length and delay as well as in the signal-to-noise ratio. Notably, we find an increase of 7% in the visibility of the Rabi oscillation when we employ a network trained by synthetic readout traces combined with measured signal noise of our setup. Our contribution thus represents an example of the beneficial role which software and hardware implementation of neural networks may play in scalable spin qubit processor architectures.

Copy-Move Forgery Localization Using Convolutional Neural Networks and CFA Features

2018 ◽  
Vol 10 (4) ◽  
pp. 140-155 ◽  
Author(s):  
Lu Liu ◽  
Yao Zhao ◽  
Rongrong Ni ◽  
Qi Tian
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Image Processing ◽  
Color Filter ◽  
Interpolation Algorithm ◽  
Post Processing ◽  
Classification Result ◽  
Filter Array ◽  
Cfa Interpolation ◽  
Learned Features

This article describes how images could be forged using different techniques, and the most common forgery is copy-move forgery, in which a part of an image is duplicated and placed elsewhere in the same image. This article describes a convolutional neural network (CNN)-based method to accurately localize the tampered regions, which combines color filter array (CFA) features. The CFA interpolation algorithm introduces the correlation and consistency among the pixels, which can be easily destroyed by most image processing operations. The proposed CNN method can effectively distinguish the traces caused by copy-move forgeries and some post-processing operations. Additionally, it can utilize the classification result to guide the feature extraction, which can enhance the robustness of the learned features. This article, per the authors, tests the proposed method in several experiments. The results demonstrate the efficiency of the method on different forgeries and quantifies its robustness and sensitivity.

scholarly journals A Green Prospective for Learned Post-processing in Sparse-view Tomographic Reconstruction

2021 ◽  
Author(s):  
Elena Morotti ◽  
Davide Evangelista ◽  
Elena Loli Piccolomini
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Tomographic Reconstruction ◽  
Research Field ◽  
Filtered Backprojection ◽  
Post Processing ◽  
Training Set ◽  
Imaging Reconstruction ◽  
Active Research

Deep Learning is developing interesting tools which are of great interest for inverse imaging applications. In this work, we consider a medical imaging reconstruction task from subsampled measurements, which is an active research field where Convolutional Neural Networks have already revealed their great potential. However, the commonly used architectures are very deep and, hence, prone to overfitting and unfeasible for clinical usages. Inspired by the ideas of the green-AI literature, we here propose a shallow neural network to perform an efficient Learned Post-Processing on images roughly reconstructed by the filtered backprojection algorithm. The results obtained on images from the training set and on unseen images, using both the non-expensive network and the widely used very deep ResUNet show that the proposed network computes images of comparable or higher quality in about one fourth of time.

A Unified Framework for Improving Misclassifications in Modern Deep Neural Networks for Sentiment Analysis

2021 ◽  
Author(s):  
Ahoud Alhazmi ◽  
Abdulwahab Aljubairy ◽  
Wei Emma Zhang ◽  
Quan Z Sheng ◽  
Elaf Alhazmi
Keyword(s):  
Neural Networks ◽  
Sentiment Analysis ◽  
Deep Neural Networks ◽  
Unified Framework

scholarly journals Prediction Skill of Extended Range 2-m Maximum Air Temperature Probabilistic Forecasts Using Machine Learning Post-Processing Methods

Atmosphere ◽  
2020 ◽  
Vol 11 (8) ◽  
pp. 823
Author(s):  
Ting Peng ◽  
Xiefei Zhi ◽  
Yan Ji ◽  
Luying Ji ◽  
Ye Tian
Keyword(s):  
Machine Learning ◽  
Neural Networks ◽  
Air Temperature ◽  
Post Processing ◽  
Learning Methods ◽  
Processing Methods ◽  
Machine Learning Methods ◽  
Extended Range ◽  
The Neural Networks ◽  
Maximum Air Temperature

The extended range temperature prediction is of great importance for public health, energy and agriculture. The two machine learning methods, namely, the neural networks and natural gradient boosting (NGBoost), are applied to improve the prediction skills of the 2-m maximum air temperature with lead times of 1–35 days over East Asia based on the Environmental Modeling Center, Global Ensemble Forecast System (EMC-GEFS), under the Subseasonal Experiment (SubX) of the National Centers for Environmental Prediction (NCEP). The ensemble model output statistics (EMOS) method is conducted as the benchmark for comparison. The results show that all the post-processing methods can efficiently reduce the prediction biases and uncertainties, especially in the lead week 1–2. The two machine learning methods outperform EMOS by approximately 0.2 in terms of the continuous ranked probability score (CRPS) overall. The neural networks and NGBoost behave as the best models in more than 90% of the study area over the validation period. In our study, CRPS, which is not a common loss function in machine learning, is introduced to make probabilistic forecasting possible for traditional neural networks. Moreover, we extend the NGBoost model to atmospheric sciences of probabilistic temperature forecasting which obtains satisfying performances.

Sign in / Sign up

Export Citation Format

Share Document