Mixed Precision Quantization Scheme for Re-configurable ReRAM Crossbars Targeting Different Energy Harvesting Scenarios

Author(s):  
Md Fahim Faysal Khan ◽  
Nicholas Anton Jao ◽  
Changchi Shuai ◽  
Keni Qiu ◽  
Mehrdad Mahdavi ◽  
...  
2021 ◽  
Vol 14 (4) ◽  
pp. 1-28
Author(s):  
Tao Yang ◽  
Zhezhi He ◽  
Tengchuan Kou ◽  
Qingzheng Li ◽  
Qi Han ◽  
...  

Field-programmable Gate Array (FPGA) is a high-performance computing platform for Convolution Neural Networks (CNNs) inference. Winograd algorithm, weight pruning, and quantization are widely adopted to reduce the storage and arithmetic overhead of CNNs on FPGAs. Recent studies strive to prune the weights in the Winograd domain, however, resulting in irregular sparse patterns and leading to low parallelism and reduced utilization of resources. Besides, there are few works to discuss a suitable quantization scheme for Winograd. In this article, we propose a regular sparse pruning pattern in the Winograd-based CNN, namely, Sub-row-balanced Sparsity (SRBS) pattern, to overcome the challenge of the irregular sparse pattern. Then, we develop a two-step hardware co-optimization approach to improve the model accuracy using the SRBS pattern. Based on the pruned model, we implement a mixed precision quantization to further reduce the computational complexity of bit operations. Finally, we design an FPGA accelerator that takes both the advantage of the SRBS pattern to eliminate low-parallelism computation and the irregular memory accesses, as well as the mixed precision quantization to get a layer-wise bit width. Experimental results on VGG16/VGG-nagadomi with CIFAR-10 and ResNet-18/34/50 with ImageNet show up to 11.8×/8.67× and 8.17×/8.31×/10.6× speedup, 12.74×/9.19× and 8.75×/8.81×/11.1× energy efficiency improvement, respectively, compared with the state-of-the-art dense Winograd accelerator [20] with negligible loss of model accuracy. We also show that our design has 4.11× speedup compared with the state-of-the-art sparse Winograd accelerator [19] on VGG16.


2020 ◽  
Vol 64 (1-4) ◽  
pp. 439-446
Author(s):  
Gildas Diguet ◽  
Gael Sebald ◽  
Masami Nakano ◽  
Mickaël Lallart ◽  
Jean-Yves Cavaillé

Magneto Rheological Elastomers (MREs) are composite materials based on an elastomer filled by magnetic particles. Anisotropic MRE can be easily manufactured by curing the material under homogeneous magnetic field which creates column of particles. The magnetic and elastic properties are actually coupled making these MREs suitable for energy conversion. From these remarkable properties, an energy harvesting device is considered through the application of a DC bias magnetic induction on two MREs as a metal piece is applying an AC shear strain on them. Such strain therefore changes the permeabilities of the elastomers, hence generating an AC magnetic induction which can be converted into AC electrical signal with the help of a coil. The device is simulated with a Finite Element Method software to examine the effect of the MRE parameters, the DC bias magnetic induction and applied shear strain (amplitude and frequency) on the resulting electrical signal.


2020 ◽  
Vol 64 (1-4) ◽  
pp. 201-210
Author(s):  
Yoshikazu Tanaka ◽  
Satoru Odake ◽  
Jun Miyake ◽  
Hidemi Mutsuda ◽  
Atanas A. Popov ◽  
...  

Energy harvesting methods that use functional materials have attracted interest because they can take advantage of an abundant but underutilized energy source. Most vibration energy harvester designs operate most effectively around their resonant frequency. However, in practice, the frequency band for ambient vibrational energy is typically broad. The development of technologies for broadband energy harvesting is therefore desirable. The authors previously proposed an energy harvester, called a flexible piezoelectric device (FPED), that consists of a piezoelectric film (polyvinylidene difluoride) and a soft material, such as silicon rubber or polyethylene terephthalate. The authors also proposed a system based on FPEDs for broadband energy harvesting. The system consisted of cantilevered FPEDs, with each FPED connected via a spring. Simply supported FPEDs also have potential for broadband energy harvesting, and here, a theoretical evaluation method is proposed for such a system. Experiments are conducted to validate the derived model.


2012 ◽  
Vol 2 (5) ◽  
pp. 252-255
Author(s):  
Rudresha K J Rudresha K J ◽  
◽  
Girisha G K Girisha G K

Author(s):  
Mohamed El Zoghbi ◽  
Valdemar Abou Hamad ◽  
Rony Ibrahim ◽  
Arnaud Bréard ◽  
Charbel Zgheib ◽  
...  

2016 ◽  
Vol 10 (3) ◽  
pp. 147 ◽  
Author(s):  
Rodrigo Tumolin Rocha ◽  
Jose Manoel Balthazar ◽  
Angelo Marcelo Tusset ◽  
Vinicius Piccirillo ◽  
Jorge Luis Palacios Felix

Sign in / Sign up

Export Citation Format

Share Document