Gradient Based Algorithms with Loss Functions and Kernels for Improved On-Policy Control

2012 ◽  
pp. 30-41
Author(s):  
Matthew Robards ◽  
Peter Sunehag
Keyword(s):  
Loss Functions ◽  
Policy Control ◽  
Gradient Based

scholarly journals Inference-Masked Loss for Deep Structured Output Learning

2020 ◽  
Author(s):  
Quan Guo ◽  
Hossein Rajaby Faghihi ◽  
Yue Zhang ◽  
Andrzej Uszok ◽  
Parisa Kordjamshidi
Keyword(s):  
Domain Knowledge ◽  
Deep Neural Networks ◽  
Loss Functions ◽  
Structured Learning ◽  
Local Error ◽  
Structured Output Learning ◽  
Output Constraints ◽  
Log Likelihood ◽  
Gradient Based ◽  
Structured Output

Structured learning algorithms usually involve an inference phase that selects the best global output variables assignments based on the local scores of all possible assignments. We extend deep neural networks with structured learning to combine the power of learning representations and leveraging the use of domain knowledge in the form of output constraints during training. Introducing a non-differentiable inference module to gradient-based training is a critical challenge. Compared to using conventional loss functions that penalize every local error independently, we propose an inference-masked loss that takes into account the effect of inference and does not penalize the local errors that can be corrected by the inference. We empirically show the inference-masked loss combined with the negative log-likelihood loss improves the performance on different tasks, namely entity relation recognition on CoNLL04 and ACE2005 corpora, and spatial role labeling on CLEF 2017 mSpRL dataset. We show the proposed approach helps to achieve better generalizability, particularly in the low-data regime.

Valence electron spectroscopy of inhomogeneous media

1992 ◽  
Vol 50 (2) ◽  
pp. 1150-1151
Author(s):  
A. Howie ◽  
D.W. McComb
Keyword(s):  
Specific Gravity ◽  
Loss Function ◽  
Electron Spectroscopy ◽  
Valence Electron ◽  
Peak Height ◽  
Loss Functions ◽  
Loss Peak ◽  
High Energies ◽  
Valence Electron Density ◽  
Electron Microscopist

The bulk loss function Im(-l/ε (ω)), a well established tool for the interpretation of valence loss spectra, is being progressively adapted to the wide variety of inhomogeneous samples of interest to the electron microscopist. Proportionality between n, the local valence electron density, and ε-1 (Sellmeyer's equation) has sometimes been assumed but may not be valid even in homogeneous samples. Figs. 1 and 2 show the experimentally measured bulk loss functions for three pure silicates of different specific gravity ρ - quartz (ρ = 2.66), coesite (ρ = 2.93) and a zeolite (ρ = 1.79). Clearly, despite the substantial differences in density, the shift of the prominent loss peak is very small and far less than that predicted by scaling e for quartz with Sellmeyer's equation or even the somewhat smaller shift given by the Clausius-Mossotti (CM) relation which assumes proportionality between n (or ρ in this case) and (ε - 1)/(ε + 2). Both theories overestimate the rise in the peak height for coesite and underestimate the increase at high energies.

Gradient based system-level diagnosis

2007 ◽  
Vol 51 (1-2) ◽  
pp. 43
Author(s):  
Balázs Polgár ◽  
Endre Selényi
Keyword(s):  
System Level ◽  
Gradient Based

An Efficient Multiple Description Coding for Multi-View Video Based on the Correlation of Spatial Polyphase Transformed Subsequences

2019 ◽  
Vol 63 (5) ◽  
pp. 50401-1-50401-7 ◽  
Author(s):  
Jing Chen ◽  
Jie Liao ◽  
Huanqiang Zeng ◽  
Canhui Cai ◽  
Kai-Kuang Ma
Keyword(s):  
Video Transmission ◽  
Video Sequence ◽  
Three Dimensional ◽  
The Other ◽  
Multiple Description Coding ◽  
Multiple Description ◽  
Prediction Mode ◽  
Gradient Based ◽  
Directional Interpolation ◽  
Description Coding

Abstract For a robust three-dimensional video transmission through error prone channels, an efficient multiple description coding for multi-view video based on the correlation of spatial polyphase transformed subsequences (CSPT_MDC_MVC) is proposed in this article. The input multi-view video sequence is first separated into four subsequences by spatial polyphase transform and then grouped into two descriptions. With the correlation of macroblocks in corresponding subsequence positions, these subsequences should not be coded in completely the same way. In each description, one subsequence is directly coded by the Joint Multi-view Video Coding (JMVC) encoder and the other subsequence is classified into four sets. According to the classification, the indirectly coding subsequence selectively employed the prediction mode and the prediction vector of the counter directly coding subsequence, which reduces the bitrate consumption and the coding complexity of multiple description coding for multi-view video. On the decoder side, the gradient-based directional interpolation is employed to improve the side reconstructed quality. The effectiveness and robustness of the proposed algorithm is verified by experiments in the JMVC coding platform.

Stable and Supported Semantics in Continuous Vector Spaces

2020 ◽  
Author(s):  
Yaniv Aspis ◽  
Krysia Broda ◽  
Alessandra Russo ◽  
Jorge Lobo
Keyword(s):  
Logic Program ◽  
Matrix Multiplication ◽  
Vector Spaces ◽  
Continuous Space ◽  
Continuous Vector ◽  
Novel Approach ◽  
Gradient Based ◽  
Normal Logic ◽  
Parameter Values ◽  
Normal Logic Program

We introduce a novel approach for the computation of stable and supported models of normal logic programs in continuous vector spaces by a gradient-based search method. Specifically, the application of the immediate consequence operator of a program reduct can be computed in a vector space. To do this, Herbrand interpretations of a propositional program are embedded as 0-1 vectors in $\mathbb{R}^N$ and program reducts are represented as matrices in $\mathbb{R}^{N \times N}$. Using these representations we prove that the underlying semantics of a normal logic program is captured through matrix multiplication and a differentiable operation. As supported and stable models of a normal logic program can now be seen as fixed points in a continuous space, non-monotonic deduction can be performed using an optimisation process such as Newton's method. We report the results of several experiments using synthetically generated programs that demonstrate the feasibility of the approach and highlight how different parameter values can affect the behaviour of the system.

A Comprehensive Investigation of Ensembles of Gaussian-Based and Gradient-Based Transformed Reliability Analyses: When and How to Use Them

2016 ◽  
Author(s):  
Po Ting Lin ◽  
Wei-Hao Lu ◽  
Shu-Ping Lin
Keyword(s):  
Design Optimization ◽  
Design Space ◽  
Optimization Problems ◽  
Nonlinear Problems ◽  
Kernel Functions ◽  
Sensitivity Analyses ◽  
Normal Space ◽  
Highly Nonlinear ◽  
Standard Normal ◽  
Gradient Based

In the past few years, researchers have begun to investigate the existence of arbitrary uncertainties in the design optimization problems. Most traditional reliability-based design optimization (RBDO) methods transform the design space to the standard normal space for reliability analysis but may not work well when the random variables are arbitrarily distributed. It is because that the transformation to the standard normal space cannot be determined or the distribution type is unknown. The methods of Ensemble of Gaussian-based Reliability Analyses (EoGRA) and Ensemble of Gradient-based Transformed Reliability Analyses (EGTRA) have been developed to estimate the joint probability density function using the ensemble of kernel functions. EoGRA performs a series of Gaussian-based kernel reliability analyses and merged them together to compute the reliability of the design point. EGTRA transforms the design space to the single-variate design space toward the constraint gradient, where the kernel reliability analyses become much less costly. In this paper, a series of comprehensive investigations were performed to study the similarities and differences between EoGRA and EGTRA. The results showed that EGTRA performs accurate and effective reliability analyses for both linear and nonlinear problems. When the constraints are highly nonlinear, EGTRA may have little problem but still can be effective in terms of starting from deterministic optimal points. On the other hands, the sensitivity analyses of EoGRA may be ineffective when the random distribution is completely inside the feasible space or infeasible space. However, EoGRA can find acceptable design points when starting from deterministic optimal points. Moreover, EoGRA is capable of delivering estimated failure probability of each constraint during the optimization processes, which may be convenient for some applications.

A CLASS OF LORENZ CURVES BASED ON LINEAR EXPONENTIAL LOSS FUNCTIONS

2002 ◽  
Vol 31 (6) ◽  
pp. 925-942 ◽  
Author(s):  
José María Sarabia ◽  
Marta Pascual
Keyword(s):  
Loss Functions ◽  
Lorenz Curves
Sign in / Sign up

Export Citation Format

Share Document