Hilbert maps: Scalable continuous occupancy mapping with stochastic gradient descent

2016 ◽  
Vol 35 (14) ◽  
pp. 1717-1730 ◽  
Author(s):  
Fabio Ramos ◽  
Lionel Ott

The vast amount of data robots can capture today motivates the development of fast and scalable statistical tools to model the space the robot operates in. We devise a new technique for environment representation through continuous occupancy mapping that improves on the popular occupancy grip maps in two fundamental aspects: (1) it does not assume an a priori discrimination of the world into grid cells and therefore can provide maps at an arbitrary resolution; (2) it captures spatial relationships between measurements naturally, thus being more robust to outliers and possessing better generalization performance. The technique, named Hilbert maps, is based on the computation of fast kernel approximations that project the data in a Hilbert space where a logistic regression classifier is learnt. We show that this approach allows for efficient stochastic gradient optimization where each measurement is only processed once during learning in an online manner. We present results with three types of approximations: random Fourier; Nyström; and a novel sparse projection. We also extend the approach to accept probability distributions as inputs, for example, due to uncertainty over the position of laser scans due to sensor or localization errors. In this extended version, experiments were conducted in two dimensions and three dimensions, using popular benchmark datasets. Furthermore, an analysis of the adaptive capabilities of the technique to handle large changes in the data, such as trajectory update before and after loop closure during simultaneous localization and mapping, is also included.

2019 ◽  
Vol 33 (2) ◽  
pp. 148-159 ◽  
Author(s):  
Rosemary Polegato ◽  
Rune Bjerke

Purpose This paper aims to explore the nature and relationships among the dimensions that constitute expectations, anticipation and post-experience assessment of cultural events, before and after an aesthetic experience, namely, a live Norwegian opera or ballet performance. Design/methodology/approach A triangulation approach is used to combine qualitative and quantitative analyses. Quantitative data collection was conducted at the site before and after a performance experience. Findings Expectations, anticipation and post-experience assessment are found to be multi-dimensional. Expectations and anticipation are identified as distinct constructs. Three dimensions of expectations of quality are extrinsic cues: building and functional attributes, available services and level of employee service. In addition, two dimensions of pre-experience anticipation are identified: anticipation of information gathering activities and anticipation of the event. Post-experience assessment has two dimensions: satisfaction and pride in the building. Two post-experience associations are enthusiasm and inclusiveness. Anticipation of the event and enthusiasm, not expectations, are found to be predictors of satisfaction. Research limitations/implications An understanding of the role of anticipation in consumer engagement and satisfaction with aesthetic experiences could be broadened and enriched by studies that include other service or arts disciplines and within a more complex model of consumer engagement. Originality/value Anticipation is a significant pre-experience phenomenon. Enthusiasm is identified as a post-experience association.


Author(s):  
Beitong Zhou ◽  
Jun Liu ◽  
Weigao Sun ◽  
Ruijuan Chen ◽  
Claire Tomlin ◽  
...  

We propose a novel technique for improving the stochastic gradient descent (SGD) method to train deep networks, which we term pbSGD. The proposed pbSGD method simply raises the stochastic gradient to a certain power elementwise during iterations and introduces only one additional parameter, namely, the power exponent (when it equals to 1, pbSGD reduces to SGD). We further propose pbSGD with momentum, which we term pbSGDM. The main results of this paper present comprehensive experiments on popular deep learning models and benchmark datasets. Empirical results show that the proposed pbSGD and pbSGDM obtain faster initial training speed than adaptive gradient methods, comparable generalization ability with SGD, and improved robustness to hyper-parameter selection and vanishing gradients. pbSGD is essentially a gradient modifier via a nonlinear transformation. As such, it is orthogonal and complementary to other techniques for accelerating gradient-based optimization such as learning rate schedules. Finally, we show convergence rate analysis for both pbSGD and pbSGDM methods. The theoretical rates of convergence match the best known theoretical rates of convergence for SGD and SGDM methods on nonconvex functions.


2018 ◽  
Vol 16 (05) ◽  
pp. 717-739
Author(s):  
Leevan Ling ◽  
Qi Ye

We combine techniques in meshfree methods and Gaussian process regressions to construct kernel-based estimators for numerical derivatives from noisy data. Specially, we construct meshfree estimators from normal random variables, which are defined by kernel-based probability measures induced from symmetric positive definite kernels, to reconstruct the unknown partial derivatives from scattered noisy data. Our developed theories give rise to Tikhonov regularization methods with a priori parameter, but the shape parameters of the kernels remain tunable. For that, we propose an error measure that is computable without the exact values of the derivative. This allows users to obtain a quasi-optimal kernel-based estimator by comparing the approximation quality of kernel-based estimators. Numerical examples in two dimensions and three dimensions are included to demonstrate the convergence behavior and effectiveness of the proposed numerical differentiation scheme.


2014 ◽  
Vol 24 (10) ◽  
pp. 2009-2041 ◽  
Author(s):  
Andrea Cangiani ◽  
Emmanuil H. Georgoulis ◽  
Paul Houston

An hp-version interior penalty discontinuous Galerkin method (DGFEM) for the numerical solution of second-order elliptic partial differential equations on general computational meshes consisting of polygonal/polyhedral elements is presented and analyzed. Utilizing a bounding box concept, the method employs elemental polynomial bases of total degree p (𝒫p-basis) defined on the physical space, without the need to map from a given reference or canonical frame. This, together with a new specific choice of the interior penalty parameter which allows for face-degeneration, ensures that optimal a priori bounds may be established, for general meshes including polygonal elements with degenerating edges in two dimensions and polyhedral elements with degenerating faces and/or edges in three dimensions. Numerical experiments highlighting the performance of the proposed method are presented. Moreover, the competitiveness of the p-version DGFEM employing a 𝒫p-basis in comparison to the conforming p-version finite element method on tensor-product elements is studied numerically for a simple test problem.


2019 ◽  
Vol 23 ◽  
pp. 310-337 ◽  
Author(s):  
Stephan Clémençon ◽  
Patrice Bertail ◽  
Emilie Chautru ◽  
Guillaume Papa

Iterative stochastic approximation methods are widely used to solve M-estimation problems, in the context of predictive learning in particular. In certain situations that shall be undoubtedly more and more common in the Big Data era, the datasets available are so massive that computing statistics over the full sample is hardly feasible, if not unfeasible. A natural and popular approach to gradient descent in this context consists in substituting the “full data” statistics with their counterparts based on subsamples picked at random of manageable size. It is the main purpose of this paper to investigate the impact of survey sampling with unequal inclusion probabilities on stochastic gradient descent-based M-estimation methods. Precisely, we prove that, in presence of some a priori information, one may significantly increase statistical accuracy in terms of limit variance, when choosing appropriate first order inclusion probabilities. These results are described by asymptotic theorems and are also supported by illustrative numerical experiments.


2021 ◽  
Author(s):  
Hao Yuan ◽  
Qi Luo ◽  
Cong Shi

We consider a periodic-review single-product inventory system with fixed cost under censored demand. Under full demand distributional information, it is well known that the celebrated (s, S) policy is optimal. In this paper, we assume the firm does not know the demand distribution a priori and makes adaptive inventory ordering decisions in each period based only on the past sales (a.k.a. censored demand). Our performance measure is regret, which is the cost difference between a feasible learning algorithm and the clairvoyant (full-information) benchmark. Compared with prior literature, the key difficulty of this problem lies in the loss of joint convexity of the objective function as a result of the presence of fixed cost. We develop the first learning algorithm, termed the [Formula: see text] policy, that combines the power of stochastic gradient descent, bandit controls, and simulation-based methods in a seamless and nontrivial fashion. We prove that the cumulative regret is [Formula: see text], which is provably tight up to a logarithmic factor. We also develop several technical results that are of independent interest. We believe that the developed framework could be widely applied to learning other important stochastic systems with partial convexity in the objectives. This paper was accepted by Chung Piaw Teo, optimization.


2011 ◽  
Vol 403-408 ◽  
pp. 4411-4415
Author(s):  
Ryohei Fujieda ◽  
Ming Yang

In the conventional sensor using localized surface Plasmon resonance (LSPR), metallic particle has been only allocated on substrate in two dimensions. We attempt to allocate metal particles in three dimensions to improve sensitivity than a conventional LSPR sensor, and aim at two points of the establishment of a new LSPR sensor and the detection of the antigen of the low density. As study process, CNTswere synthesized on the Si substrate as support by the CVD method, and modifying gold nanoparticles on surface of CNTs by the PVD method. Evaluation of applicability to bio-sensor was carried out by using protein absorption. BSA of 100mg/l as a protein was applied to the absorption test. Absorption spectra of before and after were compared by the LSPR analysis. Especially, to improve the sensitivity of LSPR,CNTs was patterned by the lithography. After BSA adhesion, in patterned CNTs substrate,it was seen that wavelength shifted by about 7 nm. Therefore, we were able to confirm thatthe substrate which was allocated metal particles in three dimensions had the function as the sensor, and had a potential to improve sensitivity of LSPR.


2019 ◽  
Vol 4 (5) ◽  
pp. 878-892
Author(s):  
Joseph A. Napoli ◽  
Linda D. Vallino

Purpose The 2 most commonly used operations to treat velopharyngeal inadequacy (VPI) are superiorly based pharyngeal flap and sphincter pharyngoplasty, both of which may result in hyponasal speech and airway obstruction. The purpose of this article is to (a) describe the bilateral buccal flap revision palatoplasty (BBFRP) as an alternative technique to manage VPI while minimizing these risks and (b) conduct a systematic review of the evidence of BBFRP on speech and other clinical outcomes. A report comparing the speech of a child with hypernasality before and after BBFRP is presented. Method A review of databases was conducted for studies of buccal flaps to treat VPI. Using the principles of a systematic review, the articles were read, and data were abstracted for study characteristics that were developed a priori. With respect to the case report, speech and instrumental data from a child with repaired cleft lip and palate and hypernasal speech were collected and analyzed before and after surgery. Results Eight articles were included in the analysis. The results were positive, and the evidence is in favor of BBFRP in improving velopharyngeal function, while minimizing the risk of hyponasal speech and obstructive sleep apnea. Before surgery, the child's speech was characterized by moderate hypernasality, and after surgery, it was judged to be within normal limits. Conclusion Based on clinical experience and results from the systematic review, there is sufficient evidence that the buccal flap is effective in improving resonance and minimizing obstructive sleep apnea. We recommend BBFRP as another approach in selected patients to manage VPI. Supplemental Material https://doi.org/10.23641/asha.9919352


Sign in / Sign up

Export Citation Format

Share Document