scholarly journals Large Scale Synchronous/Asynchronous Collaborative Distributed Learning In A Graduate Level Computer Engineering Course

2020 ◽  
Author(s):  
Luiz DaSilva
2019 ◽  
Vol 17 (06) ◽  
pp. 947-975 ◽  
Author(s):  
Lei Shi

We investigate the distributed learning with coefficient-based regularization scheme under the framework of kernel regression methods. Compared with the classical kernel ridge regression (KRR), the algorithm under consideration does not require the kernel function to be positive semi-definite and hence provides a simple paradigm for designing indefinite kernel methods. The distributed learning approach partitions a massive data set into several disjoint data subsets, and then produces a global estimator by taking an average of the local estimator on each data subset. Easy exercisable partitions and performing algorithm on each subset in parallel lead to a substantial reduction in computation time versus the standard approach of performing the original algorithm on the entire samples. We establish the first mini-max optimal rates of convergence for distributed coefficient-based regularization scheme with indefinite kernels. We thus demonstrate that compared with distributed KRR, the concerned algorithm is more flexible and effective in regression problem for large-scale data sets.


Entropy ◽  
2020 ◽  
Vol 22 (5) ◽  
pp. 544 ◽  
Author(s):  
Emre Ozfatura ◽  
Sennur Ulukus ◽  
Deniz Gündüz

When gradient descent (GD) is scaled to many parallel workers for large-scale machine learning applications, its per-iteration computation time is limited by straggling workers. Straggling workers can be tolerated by assigning redundant computations and/or coding across data and computations, but in most existing schemes, each non-straggling worker transmits one message per iteration to the parameter server (PS) after completing all its computations. Imposing such a limitation results in two drawbacks: over-computation due to inaccurate prediction of the straggling behavior, and under-utilization due to discarding partial computations carried out by stragglers. To overcome these drawbacks, we consider multi-message communication (MMC) by allowing multiple computations to be conveyed from each worker per iteration, and propose novel straggler avoidance techniques for both coded computation and coded communication with MMC. We analyze how the proposed designs can be employed efficiently to seek a balance between the computation and communication latency. Furthermore, we identify the advantages and disadvantages of these designs in different settings through extensive simulations, both model-based and real implementation on Amazon EC2 servers, and demonstrate that proposed schemes with MMC can help improve upon existing straggler avoidance schemes.


Author(s):  
Stefan Bosse

Ubiquitous computing and The Internet-of-Things (IoT) grow rapidly in today's life and evolving to Self-organizing systems (SoS). A unified and scalable information processing and communication methodology is required. In this work, mobile agents are used to merge the IoT with Mobile and Cloud environments seamless. A portable and scalable Agent Processing Platform (APP) provides an enabling technology that is central for the deployment of Multi-Agent Systems (MAS) in strong heterogeneous networks including the Internet. A large-scale use-case deploying Multi-agent systems in a distributed heterogeneous seismic sensor and geodetic network is used to demonstrate the suitability of the MAS and platform approach. The MAS is used for earthquake monitoring based on a new incremental distributed learning algorithm applied to seismic station data, which can be extended by ubiquitous sensing devices like smart phones. Different (mobile) agents perform sensor sensing, aggregation, local learning and prediction, global voting and decision making, and the application.


2019 ◽  
Vol 3 (1) ◽  
pp. 1-5
Author(s):  
Rzgar Sirwan ◽  
Muzhir Ani

Facilitating large-scale load-efficient Internet of things (IoT) connectivity is a vital step toward realizing the networked society. Although legacy wide-area wireless systems are heavily based on network-side coordination, such centralized methods will become infeasible in the future, by the unbalanced signaling level and the expected increment in the number of IoT devices. In the present work, this problem is represented through self-coordinating for IoT networks and learning from past communications. In this regard, first, we assessed low-complexity distributed learning methods that can be applied to IoT communications. We presented a learning solution then, for adapting devices’ communication parameters to the environment to maximize the reliability and load balancing efficiency in data transmissions. Moreover, we used leveraging instruments from stochastic geometry to assess the behavior of the presented distributed learning solution against centralized coordinations. Ultimately, we analyzed the interplay amongst traffic efficiency, communications’ reliability against interference and noise over data channel, as well as reliability versus adversarial interference over feedback and data channels. The presented learning approach enhanced both reliability and traffic efficiency within IoT communications considerably. By such promising findings obtained via lightweight learning, our solution becomes promising in numerous low-power low-cost IoT uses.


2018 ◽  
Vol 5 (4) ◽  
pp. 223-232
Author(s):  
Bikash Joshi ◽  
Franck Iutzeler ◽  
Massih-Reza Amini

Author(s):  
Stefan Bosse

Ubiquitous computing and The Internet-of-Things (IoT) grow rapidly in today's life and evolving to Self-organizing systems (SoS). A unified and scalable information processing and communication methodology is required. In this work, mobile agents are used to merge the IoT with Mobile and Cloud environments seamless. A portable and scalable Agent Processing Platform (APP) provides an enabling technology that is central for the deployment of Multi-Agent Systems (MAS) in strong heterogeneous networks including the Internet. A large-scale use-case deploying Multi-agent systems in a distributed heterogeneous seismic sensor and geodetic network is used to demonstrate the suitability of the MAS and platform approach. The MAS is used for earthquake monitoring based on a new incremental distributed learning algorithm applied to seismic station data, which can be extended by ubiquitous sensing devices like smart phones. Different (mobile) agents perform sensor sensing, aggregation, local learning and prediction, global voting and decision making, and the application.


2019 ◽  
Vol 2019 ◽  
pp. 1-10
Author(s):  
Iury S. Batalha ◽  
Andréia V. R. Lopes ◽  
Jasmine P. L. Araújo ◽  
Fabrício J. B. Barros ◽  
Bruno L. S. Castro ◽  
...  

With the advent of 5G mobile communication and researches into the propagation of large-scale channel modeling for frequencies above 6 GHz, measurement investigation was performed at 10 GHz with horn-type directional antennas in a corridor and a computer room within the Electrical and Computer Engineering Laboratories’ first floor, at Federal University of Pará (UFPA), Brazil. This paper presents data obtained through experimental work, channel modeling with co-polarization V-V and H-H and cross-polarization V-H in line-of-sight (LOS) or non-line-of-sight (NLOS) conditions. The large-scale close-in reference is sustained by a comprehensive analysis, considering propagation mechanisms such as reflection and diffraction. Results demonstrate that the established model had inferior standard deviation in relation to measured data, proving itself more significant to propagation in indoor environments.


Sign in / Sign up

Export Citation Format

Share Document