Machine Learning-based Prediction for Dynamic, Runtime Architectural Optimizations of Embedded Systems

2019 ◽  
Author(s):  
Ruben Vazquez ◽  
Ann Gordon-Ross ◽  
Greg Stitt
Keyword(s):  
Machine Learning ◽  
Embedded Systems

scholarly journals MODES: model-based optimization on distributed embedded systems

2021 ◽  
Author(s):  
Junjie Shi ◽  
Jiang Bian ◽  
Jakob Richter ◽  
Kuan-Hsun Chen ◽  
Jörg Rahnenführer ◽  
...  
Keyword(s):  
Machine Learning ◽  
Embedded Systems ◽  
Learning Model ◽  
Black Box ◽  
Distributed Embedded Systems ◽  
Data Set ◽  
Individual Model ◽  
Model Based ◽  
Machine Learning Model ◽  
Distributed Machine Learning

AbstractThe predictive performance of a machine learning model highly depends on the corresponding hyper-parameter setting. Hence, hyper-parameter tuning is often indispensable. Normally such tuning requires the dedicated machine learning model to be trained and evaluated on centralized data to obtain a performance estimate. However, in a distributed machine learning scenario, it is not always possible to collect all the data from all nodes due to privacy concerns or storage limitations. Moreover, if data has to be transferred through low bandwidth connections it reduces the time available for tuning. Model-Based Optimization (MBO) is one state-of-the-art method for tuning hyper-parameters but the application on distributed machine learning models or federated learning lacks research. This work proposes a framework $$\textit{MODES}$$ MODES that allows to deploy MBO on resource-constrained distributed embedded systems. Each node trains an individual model based on its local data. The goal is to optimize the combined prediction accuracy. The presented framework offers two optimization modes: (1) $$\textit{MODES}$$ MODES -B considers the whole ensemble as a single black box and optimizes the hyper-parameters of each individual model jointly, and (2) $$\textit{MODES}$$ MODES -I considers all models as clones of the same black box which allows it to efficiently parallelize the optimization in a distributed setting. We evaluate $$\textit{MODES}$$ MODES by conducting experiments on the optimization for the hyper-parameters of a random forest and a multi-layer perceptron. The experimental results demonstrate that, with an improvement in terms of mean accuracy ($$\textit{MODES}$$ MODES -B), run-time efficiency ($$\textit{MODES}$$ MODES -I), and statistical stability for both modes, $$\textit{MODES}$$ MODES outperforms the baseline, i.e., carry out tuning with MBO on each node individually with its local sub-data set.

scholarly journals Controlling Embedded Systems Remotely via Internet-of-Things Based on Emotional Recognition

2020 ◽  
Vol 2020 ◽  
pp. 1-10
Author(s):  
Mohammad J. M. Zedan ◽  
Ali I. Abduljabbar ◽  
Fahad Layth Malallah ◽  
Mustafa Ghanem Saeed
Keyword(s):  
Machine Learning ◽  
Feature Extraction ◽  
Remote Control ◽  
Embedded Systems ◽  
Embedded System ◽  
Electronic Devices ◽  
Recognition Rate ◽  
Disabled People ◽  
Research Attention ◽  
Image Preprocessing

Nowadays, much research attention is focused on human–computer interaction (HCI), specifically in terms of biosignal, which has been recently used for the remote controlling to offer benefits especially for disabled people or protecting against contagions, such as coronavirus. In this paper, a biosignal type, namely, facial emotional signal, is proposed to control electronic devices remotely via emotional vision recognition. The objective is converting only two facial emotions: a smiling or nonsmiling vision signal captured by the camera into a remote control signal. The methodology is achieved by combining machine learning (for smiling recognition) and embedded systems (for remote control IoT) fields. In terms of the smiling recognition, GENKl-4K database is exploited to train a model, which is built in the following sequenced steps: real-time video, snapshot image, preprocessing, face detection, feature extraction using HOG, and then finally SVM for the classification. The achieved recognition rate is up to 89% for the training and testing with 10-fold validation of SVM. In terms of IoT, the Arduino and MCU (Tx and Rx) nodes are exploited for transferring the resulting biosignal remotely as a server and client via the HTTP protocol. Promising experimental results are achieved by conducting experiments on 40 individuals who participated in controlling their emotional biosignals on several devices such as closing and opening a door and also turning the alarm on or off through Wi-Fi. The system implementing this research is developed in Matlab. It connects a webcam to Arduino and a MCU node as an embedded system.

scholarly journals Evaluation of Classical Machine Learning Techniques towards Urban Sound Recognitionon Embedded Systems

2019 ◽  
Vol 9 (18) ◽  
pp. 3885 ◽  
Author(s):  
Bruno da Silva ◽  
Axel W. Happi ◽  
An Braeken ◽  
Abdellah Touhafi
Keyword(s):  
Machine Learning ◽  
Embedded Systems ◽  
Real Time ◽  
Urban Environments ◽  
Machine Learning Techniques ◽  
Embedded Devices ◽  
Sound Classification ◽  
Learning Techniques ◽  
Urban Monitoring ◽  
Constrained Devices

Automatic urban sound classification is a desirable capability for urban monitoring systems, allowing real-time monitoring of urban environments and recognition of events. Current embedded systems provide enough computational power to perform real-time urban audio recognition. Using such devices for the edge computation when acting as nodes of Wireless Sensor Networks (WSN) drastically alleviates the required bandwidth consumption. In this paper, we evaluate classical Machine Learning (ML) techniques for urban sound classification on embedded devices with respect to accuracy and execution time. This evaluation provides a real estimation of what can be expected when performing urban sound classification on such constrained devices. In addition, a cascade approach is also proposed to combine ML techniques by exploiting embedded characteristics such as pipeline or multi-thread execution present in current embedded devices. The accuracy of this approach is similar to the traditional solutions, but provides in addition more flexibility to prioritize accuracy or timing.

scholarly journals Machine Learning in Resource-Scarce Embedded Systems, FPGAs, and End-Devices: A Survey

Electronics ◽  
2019 ◽  
Vol 8 (11) ◽  
pp. 1289 ◽  
Author(s):  
Sérgio Branco ◽  
André G. Ferreira ◽  
Jorge Cabral
Keyword(s):  
Machine Learning ◽  
Embedded Systems ◽  
Complex Systems ◽  
21St Century ◽  
Silk Road ◽  
The Internet ◽  
Learning Models ◽  
Future Directions ◽  
Machine Learning Models ◽  
Constrained Devices

The number of devices connected to the Internet is increasing, exchanging large amounts of data, and turning the Internet into the 21st-century silk road for data. This road has taken machine learning to new areas of applications. However, machine learning models are not yet seen as complex systems that must run in powerful computers (i.e., Cloud). As technology, techniques, and algorithms advance, these models are implemented into more computational constrained devices. The following paper presents a study about the optimizations, algorithms, and platforms used to implement such models into the network’s end, where highly resource-scarce microcontroller units (MCUs) are found. The paper aims to provide guidelines, taxonomies, concepts, and future directions to help decentralize the network’s intelligence.

Sign in / Sign up

Export Citation Format

Share Document