scholarly journals Energy-efficient memcapacitor devices for neuromorphic computing

2021 ◽  
Author(s):  
Kai-Uwe Demasius ◽  
Aron Kirschen ◽  
Stuart Parkin
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Neural Networks ◽  
Energy Efficiency ◽  
High Precision ◽  
Energy Efficient ◽  
Lateral Size ◽  
Data Intensive Computing ◽  
Data Intensive ◽  
Specialized Hardware

AbstractData-intensive computing operations, such as training neural networks, are essential for applications in artificial intelligence but are energy intensive. One solution is to develop specialized hardware onto which neural networks can be directly mapped, and arrays of memristive devices can, for example, be trained to enable parallel multiply–accumulate operations. Here we show that memcapacitive devices that exploit the principle of charge shielding can offer a highly energy-efficient approach for implementing parallel multiply–accumulate operations. We fabricate a crossbar array of 156 microscale memcapacitor devices and use it to train a neural network that could distinguish the letters ‘M’, ‘P’ and ‘I’. Modelling these arrays suggests that this approach could offer an energy efficiency of 29,600 tera-operations per second per watt, while ensuring high precision (6–8 bits). Simulations also show that the devices could potentially be scaled down to a lateral size of around 45 nm.

scholarly journals An Approximate GEMM Unit for Energy-Efficient Object Detection

Sensors ◽  
2021 ◽  
Vol 21 (12) ◽  
pp. 4195
Author(s):  
Ratko Pilipović ◽  
Vladimir Risojević ◽  
Janko Božič ◽  
Patricio Bulić ◽  
Uroš Lotrič
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Neural Networks ◽  
Convolutional Neural Network ◽  
Convolutional Neural Networks ◽  
Energy Efficient ◽  
Graphics Processing Units ◽  
Matrix Multiplication ◽  
Approximate Computing ◽  
General Matrix

Edge computing brings artificial intelligence algorithms and graphics processing units closer to data sources, making autonomy and energy-efficient processing vital for their design. Approximate computing has emerged as a popular strategy for energy-efficient circuit design, where the challenge is to achieve the best tradeoff between design efficiency and accuracy. The essential operation in artificial intelligence algorithms is the general matrix multiplication (GEMM) operation comprised of matrix multiplication and accumulation. This paper presents an approximate general matrix multiplication (AGEMM) unit that employs approximate multipliers to perform matrix–matrix operations on four-by-four matrices given in sixteen-bit signed fixed-point format. The synthesis of the proposed AGEMM unit to the 45 nm Nangate Open Cell Library revealed that it consumed only up to 36% of the area and 25% of the energy required by the exact general matrix multiplication unit. The AGEMM unit is ideally suited to convolutional neural networks, which can adapt to the error induced in the computation. We evaluated the AGEMM units’ usability for honeybee detection with the YOLOv4-tiny convolutional neural network. The results implied that we can deploy the AGEMM units in convolutional neural networks without noticeable performance degradation. Moreover, the AGEMM unit’s employment can lead to more area- and energy-efficient convolutional neural network processing, which in turn could prolong sensors’ and edge nodes’ autonomy.

Energy efficient biomorphic pulse information coding in electronic neurons for the entrance unit of the neuroprocessor

2019 ◽  
Vol 5 (3) ◽  
pp. 186-212 ◽  
Author(s):  
Alexander D. Pisarev
Keyword(s):  
Neural Networks ◽  
Energy Efficiency ◽  
Energy Efficient ◽  
Information Transfer ◽  
Biological Systems ◽  
Technological Parameters ◽  
Input Unit ◽  
Efficient Operation ◽  
Electric Circuits ◽  
Electronic Neuron

This article studies the implementation of some well-known principles of information work of biological systems in the input unit of the neuroprocessor, including spike coding of information used in models of neural networks of the latest generation.<br> The development of modern neural network IT gives rise to a number of urgent tasks at the junction of several scientific disciplines. One of them is to create a hardware platform&nbsp;— a neuroprocessor for energy-efficient operation of neural networks. Recently, the development of nanotechnology of the main units of the neuroprocessor relies on combined memristor super-large logical and storage matrices. The matrix topology is built on the principle of maximum integration of programmable links between nodes. This article describes a method for implementing biomorphic neural functionality based on programmable links of a highly integrated 3D logic matrix.<br> This paper focuses on the problem of achieving energy efficiency of the hardware used to model neural networks. The main part analyzes the known facts of the principles of information transfer and processing in biological systems from the point of view of their implementation in the input unit of the neuroprocessor. The author deals with the scheme of an electronic neuron implemented based on elements of a 3D logical matrix. A pulsed method of encoding input information is presented, which most realistically reflects the principle of operation of a sensory biological neural system. The model of an electronic neuron for selecting ranges of technological parameters in a real 3D logic matrix scheme is analyzed. The implementation of disjunctively normal forms is shown, using the logic function in the input unit of a neuroprocessor as an example. The results of modeling fragments of electric circuits with memristors of a 3D logical matrix in programming mode are presented.<br> The author concludes that biomorphic pulse coding of standard digital signals allows achieving a high degree of energy efficiency of the logic elements of the neuroprocessor by reducing the number of valve operations. Energy efficiency makes it possible to overcome the thermal limitation of the scalable technology of three-dimensional layout of elements in memristor crossbars.

scholarly journals Artificial Intelligence Techniques for Phishing Detection

2019 ◽  
Vol 8 (11) ◽  
pp. 2330-2335
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Neural Networks ◽  
Neural Systems ◽  
Element Determination ◽  
Artificial Intelligence Techniques ◽  
The Neural Network ◽  
Proper Number ◽  
Phishing Detection

The objective of this undertaking is to apply neural systems to phishing email recognition and assess the adequacy of this methodology. We structure the list of capabilities, process the phishing dataset, and execute the Neural Network frameworks. we analyze its exhibition against that of other real Artificial Intelligence Techniques – DT , K-nearest , NB and SVM machine.. The equivalent dataset and list of capabilities are utilized in the correlation. From the factual examination, we infer that Neural Networks with a proper number of concealed units can accomplish acceptable precision notwithstanding when the preparation models are rare. Additionally, our element determination is compelling in catching the qualities of phishing messages, as most AI calculations can yield sensible outcomes with it.

scholarly journals Prediksi Pemakaian Listrik Kelompok Tarif Menggunakan Jaringan Syaraf Tiruan dan ARIMA

2013 ◽  
Vol 7 (2) ◽  
pp. 189
Author(s):  
Silviani E Rumagit ◽  
Azhari SN
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Neural Networks ◽  
Statistical Method ◽  
Moving Average ◽  
Electric Energy ◽  
Backpropagation Neural Network ◽  
The Difference ◽  
The Government ◽  
Increasing Demand

AbstrakLatar Belakang penelitian ini dibuat dimana semakin meningkatnya kebutuhan listrik di setiap kelompok tarif. Yang dimaksud dengan kelompok tarif dalam penelitian ini adalah kelompok tarif sosial, kelompok tarif rumah tangga, kelompok tarif bisnis, kelompok tarif industri dan kelompok tarif pemerintah. Prediksi merupakan kebutuhan penting bagi penyedia tenaga listrik dalam mengambil keputusan berkaitan dengan ketersediaan energi listik. Dalam melakukan prediksi dapat dilakukan dengan metode statistik maupun kecerdasan buatan.            ARIMA merupakan salah satu metode statistik yang banyak digunakan untuk prediksi dimana ARIMA mengikuti model autoregressive (AR) moving average (MA). Syarat dari ARIMA adalah data harus stasioner, data yang tidak stasioner harus distasionerkan dengan differencing. Selain metode statistik, prediksi juga dapat dilakukan dengan teknik kecerdasan buatan, dimana dalam penelitian ini jaringan syaraf tiruan backpropagation dipilih untuk melakukan prediksi. Dari hasil pengujian yang dilakukan selisih MSE ARIMA, JST dan penggabungan ARIMA, jaringan syaraf tiruan tidak berbeda secara signifikan. Kata Kunci— ARIMA, jaringan syaraf tiruan, kelompok tarif.  AbstractBackground this research was made where the increasing demand for electricity in each group. The meaning this group is social, the household, business, industry groups and the government fare. Prediction is an important requirement for electricity providers in making decisions related to the availability of electric energy. In doing predictions can be made by statistical methods and artificial intelligence.            ARIMA is a statistical method that is widely used to predict where the ARIMA modeled autoregressive (AR) moving average (MA). Terms of ARIMA is the data must be stationary, the data is not stationary should be stationary  use differencing. In addition to the statistical method, predictions can also be done by artificial intelligence techniques, which in this study selected Backpropagation neural network to predict. From the results of tests made the difference in MSE ARIMA, ANN and merging ARIMA, artificial neural networks are not significantly different. Keyword—ARIMA, neural network, tarif groups

scholarly journals Demand Modelling in Telecommunications

10.14311/1121 ◽  
2009 ◽  
Vol 49 (2) ◽  
Author(s):  
M. Chvalina
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Neural Networks ◽  
Network Models ◽  
Short Term ◽  
Neural Network Models ◽  
Term Forecast ◽  
Artificial Intelligence Methods ◽  
Demand Modelling

This article analyses the existing possibilities for using Standard Statistical Methods and Artificial Intelligence Methods for a short-term forecast and simulation of demand in the field of telecommunications. The most widespread methods are based on Time Series Analysis. Nowadays, approaches based on Artificial Intelligence Methods, including Neural Networks, are booming. Separate approaches will be used in the study of Demand Modelling in Telecommunications, and the results of these models will be compared with actual guaranteed values. Then we will examine the quality of Neural Network models. 

Introduction

2013 ◽  
pp. 1-5
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Neural Networks ◽  
Computational Intelligence ◽  
Evolutionary Computing ◽  
Historical Background ◽  
Intelligent Computing ◽  
Biometric Security ◽  
Introductory Overview ◽  
Over Time

This chapter presents an introductory overview of the application of computational intelligence in biometrics. Starting with the historical background on artificial intelligence, the chapter proceeds to the evolutionary computing and neural networks. Evolutionary computing is an ability of a computer system to learn and evolve over time in a manner similar to humans. The chapter discusses swarm intelligence, which is an example of evolutionary computing, as well as chaotic neural network, which is another aspect of intelligent computing. At the end, special concentration is given to a particular application of computational intelligence—biometric security.

Comprehensive Overview of Neural Networks and Its Applications in Autonomous Vehicles

2019 ◽  
pp. 159-173
Author(s):  
Jay Rodge ◽  
Swati Jaiswal
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Neural Networks ◽  
Deep Learning ◽  
Autonomous Vehicles ◽  
Autonomous Vehicle ◽  
Learning Algorithms ◽  
Activation Functions ◽  
Comprehensive Overview ◽  
Unit Component

Deep learning and Artificial intelligence (AI) have been trending these days due to the capability and state-of-the-art results that they provide. They have replaced some highly skilled professionals with neural network-powered AI, also known as deep learning algorithms. Deep learning majorly works on neural networks. This chapter discusses about the working of a neuron, which is a unit component of neural network. There are numerous techniques that can be incorporated while designing a neural network, such as activation functions, training, etc. to improve its features, which will be explained in detail. It has some challenges such as overfitting, which are difficult to neglect but can be overcome using proper techniques and steps that have been discussed. The chapter will help the academician, researchers, and practitioners to further investigate the associated area of deep learning and its applications in the autonomous vehicle industry.

scholarly journals Optimization of control program for CNC machines with regarding dynamic stability of cutting process and optimum modes of treatment in conditions of digital production

2018 ◽  
Vol 226 ◽  
pp. 04016
Author(s):  
Yuri G. Kabaldin ◽  
Dmitrii A. Shatagin ◽  
Pavel V. Kolchin
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Neural Networks ◽  
Dynamic Stability ◽  
Control Program ◽  
Cutting Process ◽  
Cnc Machines ◽  
Control Programs ◽  
Digital Production ◽  
Optimizing Control

The method for optimizing control programs for CNC machines based on artificial intelligence approaches, in particular, the apparatus of artificial neural networks, is outlined. A neural network model of the dynamic stability of the cutting process is proposed, which makes it possible to simulate the dynamics of the cutting process using the CAM system.

An artificial intelligence algorithm that differentiates anterior ethmoidal artery location on sinus computed tomography scans

2019 ◽  
Vol 134 (1) ◽  
pp. 52-55 ◽  
Author(s):  
J Huang ◽  
A-R Habib ◽  
D Mendis ◽  
J Chong ◽  
M Smith ◽  
...  
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Computed Tomography ◽  
Neural Networks ◽  
Convolutional Neural Network ◽  
Convolutional Neural Networks ◽  
Sinus Surgery ◽  
Computed Tomography Scans ◽  
Ethmoidal Artery ◽  
Anterior Ethmoidal Artery

AbstractObjectiveDeep learning using convolutional neural networks represents a form of artificial intelligence where computers recognise patterns and make predictions based upon provided datasets. This study aimed to determine if a convolutional neural network could be trained to differentiate the location of the anterior ethmoidal artery as either adhered to the skull base or within a bone ‘mesentery’ on sinus computed tomography scans.MethodsCoronal sinus computed tomography scans were reviewed by two otolaryngology residents for anterior ethmoidal artery location and used as data for the Google Inception-V3 convolutional neural network base. The classification layer of Inception-V3 was retrained in Python (programming language software) using a transfer learning method to interpret the computed tomography images.ResultsA total of 675 images from 388 patients were used to train the convolutional neural network. A further 197 unique images were used to test the algorithm; this yielded a total accuracy of 82.7 per cent (95 per cent confidence interval = 77.7–87.8), kappa statistic of 0.62 and area under the curve of 0.86.ConclusionConvolutional neural networks demonstrate promise in identifying clinically important structures in functional endoscopic sinus surgery, such as anterior ethmoidal artery location on pre-operative sinus computed tomography.

scholarly journals Energy-Efficient Gabor Kernels in Neural Networks with Genetic Algorithm Training Method

Electronics ◽  
2019 ◽  
Vol 8 (1) ◽  
pp. 105 ◽  
Author(s):  
Fanjie Meng ◽  
Xinqing Wang ◽  
Faming Shao ◽  
Dong Wang ◽  
Xia Hua
Keyword(s):  
Neural Network ◽  
Genetic Algorithm ◽  
Neural Networks ◽  
Energy Efficient ◽  
Experimental Result ◽  
Training Method ◽  
Traffic Sign Recognition ◽  
Traffic Sign ◽  
Sign Recognition ◽  
Deep Model

Deep-learning convolutional neural networks (CNNs) have proven to be successful in various cognitive applications with a multilayer structure. The high computational energy and time requirements hinder the practical application of CNNs; hence, the realization of a highly energy-efficient and fast-learning neural network has aroused interest. In this work, we address the computing-resource-saving problem by developing a deep model, termed the Gabor convolutional neural network (Gabor CNN), which incorporates highly expression-efficient Gabor kernels into CNNs. In order to effectively imitate the structural characteristics of traditional weight kernels, we improve upon the traditional Gabor filters, having stronger frequency and orientation representations. In addition, we propose a procedure to train Gabor CNNs, termed the fast training method (FTM). In FTM, we design a new training method based on the multipopulation genetic algorithm (MPGA) and evaluation structure to optimize improved Gabor kernels, but train the rest of the Gabor CNN parameters with back-propagation. The training of improved Gabor kernels with MPGA is much more energy-efficient with less samples and iterations. Simple tasks, like character recognition on the Mixed National Institute of Standards and Technology database (MNIST), traffic sign recognition on the German Traffic Sign Recognition Benchmark (GTSRB), and face detection on the Olivetti Research Laboratory database (ORL), are implemented using LeNet architecture. The experimental result of the Gabor CNN and MPGA training method shows a 17–19% reduction in computational energy and time and an 18–21% reduction in storage requirements with a less than 1% accuracy decrease. We eliminated a significant fraction of the computation-hungry components in the training process by incorporating highly expression-efficient Gabor kernels into CNNs.

Sign in / Sign up

Export Citation Format

Share Document