Communication-Efficient Decentralized Zeroth-order Method on Heterogeneous Data

Author(s):  
Zan Li ◽  
Li Chen
Author(s):  
V. Kungurtsev ◽  
F. Rinaldi

AbstractIn this paper, we consider stochastic weakly convex optimization problems, however without the existence of a stochastic subgradient oracle. We present a derivative free algorithm that uses a two point approximation for computing a gradient estimate of the smoothed function. We prove convergence at a similar rate as state of the art methods, however with a larger constant, and report some numerical results showing the effectiveness of the approach.


2003 ◽  
Vol 780 ◽  
Author(s):  
P. Thomas ◽  
E. Nabighian ◽  
M.C. Bartelt ◽  
C.Y. Fong ◽  
X.D. Zhu

AbstractWe studied adsorption, growth and desorption of Xe on Nb(110) using an in-situ obliqueincidence reflectivity difference (OI-RD) technique and low energy electron diffraction (LEED) from 32 K to 100 K. The results show that Xe grows a (111)-oriented film after a transition layer is formed on Nb(110). The transition layer consists of three layers. The first two layers are disordered with Xe-Xe separation significantly larger than the bulk value. The third monolayer forms a close packed (111) structure on top of the tensile-strained double layer and serves as a template for subsequent homoepitaxy. The adsorption of the first and the second layers are zeroth order with sticking coefficient close to one. Growth of the Xe(111) film on the transition layer proceeds in a step flow mode from 54K to 40K. At 40K, an incomplete layer-by-layer growth is observed while below 35K the growth proceeds in a multilayer mode.


Author(s):  
Jaya Pratha Sebastiyar ◽  
Martin Sahayaraj Joseph

Distributed joint congestion control and routing optimization has received a significant amount of attention recently. To date, however, most of the existing schemes follow a key idea called the back-pressure algorithm. Despite having many salient features, the first-order sub gradient nature of the back-pressure based schemes results in slow convergence and poor delay performance. To overcome these limitations, the present study was made as first attempt at developing a second-order joint congestion control and routing optimization framework that offers utility-optimality, queue-stability, fast convergence, and low delay.  Contributions in this project are three-fold. The present study propose a new second-order joint congestion control and routing framework based on a primal-dual interior-point approach and established utility-optimality and queue-stability of the proposed second-order method. The results of present study showed that how to implement the proposed second-order method in a distributed fashion.


2020 ◽  
Vol 4 ◽  
pp. 97-100
Author(s):  
A.P. Pronichev ◽  

The article discusses the architecture of a system for collecting and analyzing heterogeneous data from social networks. This architecture is a distributed system of subsystem modules, each of which is responsible for a separate task. The system also allows you to use external systems for data analysis, providing the necessary interface abstraction for connection. This allows for more flexible customization of the data analysis process and reduces development, implementation and support costs.


2010 ◽  
Vol 12 (2) ◽  
pp. 194-199 ◽  
Author(s):  
Shaochun DONG ◽  
Hongwei YIN ◽  
Gang XU

Sign in / Sign up

Export Citation Format

Share Document