scholarly journals Efficient Deep Learning in Network Compression and Acceleration

2018 ◽  
Author(s):  
Shiming Ge
Keyword(s):  
Deep Learning ◽  
Network Compression

scholarly journals Self-Adaptive Approximate Mobile Deep Learning

Electronics ◽  
2021 ◽  
Vol 10 (23) ◽  
pp. 2958
Author(s):  
Timotej Knez ◽  
Octavian Machidon ◽  
Veljko Pejović
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Real World ◽  
Edge Computing ◽  
Major Drawback ◽  
High Resource ◽  
Average Accuracy ◽  
Resource Requirements ◽  
And Performance ◽  
Network Compression

Edge intelligence is currently facing several important challenges hindering its performance, with the major drawback being meeting the high resource requirements of deep learning by the resource-constrained edge computing devices. The most recent adaptive neural network compression techniques demonstrated, in theory, the potential to facilitate the flexible deployment of deep learning models in real-world applications. However, their actual suitability and performance in ubiquitous or edge computing applications has not, to this date, been evaluated. In this context, our work aims to bridge the gap between the theoretical resource savings promised by such approaches and the requirements of a real-world mobile application by introducing algorithms that dynamically guide the compression rate of a neural network according to the continuously changing context in which the mobile computation is taking place. Through an in-depth trace-based investigation, we confirm the feasibility of our adaptation algorithms in offering a scalable trade-off between the inference accuracy and resource usage. We then implement our approach on real-world edge devices and, through a human activity recognition application, confirm that it offers efficient neural network compression adaptation in highly dynamic environments. The results of our experiment with 21 participants show that, compared to using static network compression, our approach uses 2.18× less energy with only a 1.5% drop in the average accuracy of the classification.

scholarly journals Literature Review of Deep Network Compression

Informatics ◽  
2021 ◽  
Vol 8 (4) ◽  
pp. 77
Author(s):  
Ali Alqahtani ◽  
Xianghua Xie ◽  
Mark W. Jones
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Deep Neural Networks ◽  
Low Rank ◽  
Vast Number ◽  
Deep Networks ◽  
Factorization Methods ◽  
Network Compression ◽  
Rank Factorization ◽  
Pruning Methods

Deep networks often possess a vast number of parameters, and their significant redundancy in parameterization has become a widely-recognized property. This presents significant challenges and restricts many deep learning applications, making the focus on reducing the complexity of models while maintaining their powerful performance. In this paper, we present an overview of popular methods and review recent works on compressing and accelerating deep neural networks. We consider not only pruning methods but also quantization methods, and low-rank factorization methods. This review also intends to clarify these major concepts, and highlights their characteristics, advantages, and shortcomings.

Deep Learning

2009 ◽  
Author(s):  
Stellan Ohlsson
Keyword(s):  
Deep Learning

Intelligence artificielle : le futur de l’Orthodontie ?

2019 ◽  
Vol 53 (3) ◽  
pp. 281-294
Author(s):  
Jean-Michel Foucart ◽  
Augustin Chavanne ◽  
Jérôme Bourriau
Keyword(s):  
Big Data ◽  
Deep Learning ◽  
Intelligence Artificielle ◽  
Set Up

Nombreux sont les apports envisagés de l’Intelligence Artificielle (IA) en médecine. En orthodontie, plusieurs solutions automatisées sont disponibles depuis quelques années en imagerie par rayons X (analyse céphalométrique automatisée, analyse automatisée des voies aériennes) ou depuis quelques mois (analyse automatique des modèles numériques, set-up automatisé; CS Model +, Carestream Dental™). L’objectif de cette étude, en deux parties, est d’évaluer la fiabilité de l’analyse automatisée des modèles tant au niveau de leur numérisation que de leur segmentation. La comparaison des résultats d’analyse des modèles obtenus automatiquement et par l’intermédiaire de plusieurs orthodontistes démontre la fiabilité de l’analyse automatique; l’erreur de mesure oscillant, in fine, entre 0,08 et 1,04 mm, ce qui est non significatif et comparable avec les erreurs de mesures inter-observateurs rapportées dans la littérature. Ces résultats ouvrent ainsi de nouvelles perspectives quand à l’apport de l’IA en Orthodontie qui, basée sur le deep learning et le big data, devrait permettre, à moyen terme, d’évoluer vers une orthodontie plus préventive et plus prédictive.

EFFECTIVENESS OF ARTIFICIAL INTELLIGENCE USING DEEP LEARNING FOR DETECTING GASTRIC CANCER IN ENDOSCOPIC IMAGES

2018 ◽  
Author(s):  
T Hirasawa ◽  
K Aoyama ◽  
J Fujisaki ◽  
T Tada
Keyword(s):  
Artificial Intelligence ◽  
Gastric Cancer ◽  
Deep Learning ◽  
Endoscopic Images

Vollautomatische Quantifizierung der Volumina und Funktion des linken Ventrikels in der kardialen MRT: Evaluation eines Deep-Learning basierten Algorithmus

2020 ◽  
Author(s):  
B Böttcher ◽  
E Beller ◽  
A Busse ◽  
F Streckenbach ◽  
M Weber ◽  
...  
Keyword(s):  
Deep Learning

Primäre ZNS-Lymphome: Vollautomatisierte Detektion und Segmentierung auf multiparametrischen MRT-Datensätzen mittels Deep-Learning

2020 ◽  
Author(s):  
L Pennig ◽  
L Lourenco Caldeira ◽  
C Hoyer ◽  
L Görtz ◽  
R Shahzad ◽  
...  
Keyword(s):  
Deep Learning

Computertomografie: Bildrekonstruktion mit Deep Learning in der klinischen Routine

2020 ◽  
Author(s):  
A Heinrich ◽  
M Engler ◽  
D Dachoua ◽  
U Teichgräber ◽  
F Güttler
Keyword(s):  
Deep Learning

AUTOMATED POLYP SIZE ESTIMATION WITH DEEP LEARNING REDUCES OVERESTIMATION BIAS

2020 ◽  
Author(s):  
J Suykens ◽  
T Eelbode ◽  
J Daenen ◽  
P Suetens ◽  
F Maes ◽  
...  
Keyword(s):  
Deep Learning ◽  
Size Estimation ◽  
Polyp Size
Sign in / Sign up

Export Citation Format

Share Document