Efficiency testing of artificial neural networks in predicting the properties of carbon nanomaterials as potential systems for nervous tissue stimulation and regeneration

2017 ◽  
Vol 13 (1) ◽  
Author(s):  
Martyna Sasiada ◽  
Aneta Fraczek-Szczypta ◽  
Ryszard Tadeusiewicz
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Nervous Tissue ◽  
Carbon Nanomaterials ◽  
Real Life ◽  
Neural Model ◽  
Carbon Nanomaterial ◽  
Neural Models ◽  
Predictive Learning ◽  
The Many

AbstractA new method of predicting the properties of carbon nanomaterials from carbon nanotubes and graphene oxide, using electrophoretic deposition (EPD) on a metal surface, was investigated. The main goal is to obtain the basis for nervous tissue stimulation and regeneration. Because of the many variations of the EPD method, costly and time-consuming experiments are necessary for optimization of the produced systems. To limit such costs and workload, we propose a neural network-based model that can predict the properties of selected carbon nanomaterial systems before they are produced. The choice of neural networks as predictive learning models is based on many studies in the literature that report neural models as good interpretations of real-life processes. The use of a neural network model can reduce experimentation with unpromising methods of systems processing and preparation. Instead, it allows a focus on experiments with these systems, which are promising according to the prediction given by the neural model. The performed tests showed that the proposed method of predictive learning of carbon nanomaterial properties is easy and effective. The experiments showed that the prediction results were consistent with those obtained in the real system.

scholarly journals Semiotic Aggregation in Deep Learning

Entropy ◽  
2020 ◽  
Vol 22 (12) ◽  
pp. 1365
Author(s):  
Bogdan Muşat ◽  
Răzvan Andonie
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Decision Model ◽  
Deep Neural Networks ◽  
Neural Model ◽  
Network Layers ◽  
Saliency Maps ◽  
Spatial Entropy ◽  
Insight Into

Convolutional neural networks utilize a hierarchy of neural network layers. The statistical aspects of information concentration in successive layers can bring an insight into the feature abstraction process. We analyze the saliency maps of these layers from the perspective of semiotics, also known as the study of signs and sign-using behavior. In computational semiotics, this aggregation operation (known as superization) is accompanied by a decrease of spatial entropy: signs are aggregated into supersign. Using spatial entropy, we compute the information content of the saliency maps and study the superization processes which take place between successive layers of the network. In our experiments, we visualize the superization process and show how the obtained knowledge can be used to explain the neural decision model. In addition, we attempt to optimize the architecture of the neural model employing a semiotic greedy technique. To the extent of our knowledge, this is the first application of computational semiotics in the analysis and interpretation of deep neural networks.

MREM, Discrete Recurrent Network for Optimization

2011 ◽  
pp. 1112-1120
Author(s):  
Enrique Mérida-Casermeiro ◽  
Domingo López-Rodríguez ◽  
Juan M. Ortiz-de-Lazcano-Lobato
Keyword(s):  
Neural Networks ◽  
Combinatorial Optimization ◽  
Image Recognition ◽  
Single Neuron ◽  
Optimization Problems ◽  
Neural Model ◽  
Recurrent Network ◽  
Neural Models ◽  
Seminal Work ◽  
Combinatorial Optimization Problems

Since McCulloch and Pitts’ seminal work (McCulloch & Pitts, 1943), several models of discrete neural networks have been proposed, many of them presenting the ability of assigning a discrete value (other than unipolar or bipolar) to the output of a single neuron. These models have focused on a wide variety of applications. One of the most important models was developed by J. Hopfield in (Hopfield, 1982), which has been successfully applied in fields such as pattern and image recognition and reconstruction (Sun et al., 1995), design of analogdigital circuits (Tank & Hopfield, 1986), and, above all, in combinatorial optimization (Hopfield & Tank, 1985) (Takefuji, 1992) (Takefuji & Wang, 1996), among others. The purpose of this work is to review some applications of multivalued neural models to combinatorial optimization problems, focusing specifically on the neural model MREM, since it includes many of the multivalued models in the specialized literature.

scholarly journals Analyzing and interpreting neural networks for NLP: A report on the first BlackboxNLP workshop

2019 ◽  
Vol 25 (4) ◽  
pp. 543-557 ◽  
Author(s):  
Afra Alishahi ◽  
Grzegorz Chrupała ◽  
Tal Linzen
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Natural Language Processing ◽  
Language Processing ◽  
Performance Testing ◽  
Network Architectures ◽  
Empirical Methods ◽  
Neural Models ◽  
The Impact ◽  
Systematic Manipulation

AbstractThe Empirical Methods in Natural Language Processing (EMNLP) 2018 workshop BlackboxNLP was dedicated to resources and techniques specifically developed for analyzing and understanding the inner-workings and representations acquired by neural models of language. Approaches included: systematic manipulation of input to neural networks and investigating the impact on their performance, testing whether interpretable knowledge can be decoded from intermediate representations acquired by neural networks, proposing modifications to neural network architectures to make their knowledge state or generated output more explainable, and examining the performance of networks on simplified or formal languages. Here we review a number of representative studies in each category.

Synergistic Neural Models of a Robot Sensor for Part Orientation Detection

1996 ◽  
Vol 210 (1) ◽  
pp. 69-76 ◽  
Author(s):  
D T Pham ◽  
S Sagiroglu
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Inertial Sensor ◽  
Neural Models ◽  
Combined System ◽  
Number Of Components ◽  
Inertial Parameters ◽  
Orientation Detection ◽  
Part Orientation

This paper describes the use of neural networks to compute the orientation of a part from the output signals of an inertial sensor which is a device for determining the location of parts by measuring their inertial parameters. The paper investigates an approach for increasing the accuracy of the computed orientation. This involves employing a group of neural networks and combining their outputs. The paper presents the results obtained for several neural network combinations. These show that the accuracy achieved in a combined system is higher than that of its individual components provided the number of components is not too large.

scholarly journals Fuzzy Matrix Game: A Fast Approach using Artificial Hybrid Neural-Net Logic-Gate Switching Circuit

2022 ◽  
Author(s):  
Ankan Bhaumik ◽  
Sankar Kumar Roy
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Decision Making ◽  
Artificial Neural Network ◽  
Logic Gate ◽  
Real Life ◽  
Neural Nets ◽  
Matrix Game ◽  
Switching Circuit ◽  
Artificial Neural

Abstract Introducing neuro -fuzzy concept in decision making problems, makes a new way in artificial intelligence and expert systems. Sometimes, neural networks are used to optimize certain performances. In general, knowledge acquisition becomes difficult when problem's variables, constraints, environment, decision maker's attitude and complex behavior are encountered with. A sense of fuzziness prevails in these situations; sometimes numerically and sometimes linguistically. Neural networks (or neural nets) help to overcome this problem. Neural networks are explicitly and implicitly hyped to draw out fuzzy rules from numerical information and linguistic information. Logic-gate and switching circuit mobilize the fuzzy data in crisp environment and can be used in artificial neural network, also. Game theory has a tremendous scope in decision making; and consequently decision makers' hesitant characters play an important role in it. In this paper, a game situation is clarified under artificial neural network through logic-gate switching circuit in hesitant fuzzy environment with a suitable example; and this concept can be applied in future for real-life situations.

scholarly journals Understanding memories of the Holocaust—A new approach to neural networks in the digital humanities

2019 ◽  
Vol 35 (1) ◽  
pp. 17-33
Author(s):  
Tobias Blanke ◽  
Michael Bryant ◽  
Mark Hedges
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Sentiment Analysis ◽  
Digital Humanities ◽  
Research Question ◽  
Real Life ◽  
Computational Modelling ◽  
The United States ◽  
New Approach ◽  
Distant Supervision

Abstract This article addresses an important challenge in artificial intelligence research in the humanities, which has impeded progress with supervised methods. It introduces a novel method to creating test collections from smaller subsets. This method is based on what we will introduce as distant supervision’ and will allow us to improve computational modelling in the digital humanities by including new methods of supervised learning. Using recurrent neural networks, we generated a training corpus and were able to train a highly accurate model that qualitatively and quantitatively improved a baseline model. To demonstrate our new approach experimentally, we employ a real-life research question based on existing humanities collections. We use neural network based sentiment analysis to decode Holocaust memories and present a methodology to combine supervised and unsupervised sentiment analysis to analyse the oral history interviews of the United States Holocaust Memorial Museum. Finally, we employed three advanced methods of computational semantics. These helped us decipher the decisions by the neural network and understand, for instance, the complex sentiments around family memories in the testimonies.

NEURAL NETWORK RULE EXTRACTION BY A NEW ENSEMBLE CONCEPT AND ITS THEORETICAL AND HISTORICAL BACKGROUND: A REVIEW

2013 ◽  
Vol 12 (04) ◽  
pp. 1340006 ◽  
Author(s):  
YOICHI HAYASHI
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
High Performance ◽  
Real Life ◽  
Rule Extraction ◽  
Historical Background ◽  
Neural Network Ensemble ◽  
Extraction Algorithm ◽  
Neural Network Ensembles ◽  
Network Ensembles

This paper presents theoretical and historical backgrounds related to neural network rule extraction. It also investigates approaches for neural network rule extraction by ensemble concepts. Bologna pointed out that although many authors had generated comprehensive models from individual networks, much less work had been done to explain ensembles of neural networks. This paper carefully surveyed the previous work on rule extraction from neural network ensembles since 1988. We are aware of three major research groups i.e., Bologna' group, Zhou' group and Hayashi' group. The reason of these situations is obvious. Since the structures of previous neural network ensembles were quite complicated, the research on the efficient rule extraction algorithm from neural network ensembles was few although their learning capability was extremely high. Thus, these issues make rule extraction algorithm for neural network ensemble difficult task. However, there is a practical need for new ideas for neural network ensembles in order to realize the extremely high-performance needs of various rule extraction problems in real life. This paper successively explain nature of artificial neural networks, origin of neural network rule extraction, incorporating fuzziness in neural network rule extraction, theoretical foundation of neural network rule extraction, computational complexity of neural network rule extraction, neuro-fuzzy hybridization, previous rule extraction from neural network ensembles and difficulties of previous neural network ensembles. Next, this paper address three principles of proposed neural network rule extraction: to increase recognition rates, to extract rules from neural network ensembles, and to minimize the use of computing resources. We also propose an ensemble-recursive-rule extraction (E-Re-RX) by two or three standard backpropagation to train multi-layer perceptrons (MLPs), which enabled extremely high recognition accuracy and the extraction of comprehensible rules. Furthermore, this enabled rule extraction that resulted in fewer rules than those in previously proposed methods. This paper summarizes experimental results of rule extraction using E-Re-RX by multiple standard backpropagation MLPs and provides deep discussions. The results make it possible for the output from a neural network ensemble to be in the form of rules, thus open the "black box" of trained neural networks ensembles. Finally, we provide valuable conclusions and as future work, three open questions on the E-Re-RX algorithm.

scholarly journals Recognition for lateral faces using Neural Networks

2021 ◽  
Vol 12 (3) ◽  
pp. 5589-5595
Author(s):  
Dr.M.Aruna Safali Et. al.
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Neural Networks ◽  
Pattern Recognition ◽  
Face Recognition ◽  
Lateral Face ◽  
Synthetic Dataset ◽  
Recognition Pattern ◽  
The Many

Face recognition is most difficult and complicated technique. Recognition of lateral faces is very difficult compare with normal face recognition. Pattern recognition is mostly used in this system to recognise the lateral face patterns (LFP).  Neural network is used to find the patterns and lateral face recognition can be done by this technique. After the many researches face recognition becomes difficulty for the various techniques based on their parameters. In this paper, the amalgamative lateral face recognition(ALFR) which is merged with machine learning and neural network features can be done by using synthetic dataset consists of 200 lateral faces. Performance shows the improved results of proposed technique.

scholarly journals Deep and Machine Learning Using SEM, FTIR, and Texture Analysis to Detect Polysaccharide in Raspberry Powders

Sensors ◽  
2021 ◽  
Vol 21 (17) ◽  
pp. 5823
Author(s):  
Krzysztof Przybył ◽  
Krzysztof Koszela ◽  
Franciszek Adamski ◽  
Katarzyna Samborska ◽  
Katarzyna Walkowiak ◽  
...  
Keyword(s):  
Neural Network ◽  
Electron Microscopy ◽  
Machine Learning ◽  
Neural Networks ◽  
Scanning Electron Microscopy ◽  
Fourier Transform ◽  
High Efficiency ◽  
Multi Layer Perceptron ◽  
Neural Models ◽  
Scanning Electron

In the paper, an attempt was made to use methods of artificial neural networks (ANN) and Fourier transform infrared spectroscopy (FTIR) to identify raspberry powders that are different from each other in terms of the amount and the type of polysaccharide. Spectra in the absorbance function (FTIR) were prepared as well as training sets, taking into account the structure of microparticles acquired from microscopic images with Scanning Electron Microscopy (SEM). In addition to the above, Multi-Layer Perceptron Networks (MLPNs) with a set of texture descriptors (machine learning) and Convolution Neural Network (CNN) with bitmap (deep learning) were devised, which is an innovative attitude to solving this issue. The aim of the paper was to create MLPN and CNN neural models, which are characterized by a high efficiency of classification. It translates into recognizing microparticles (obtaining their homogeneity) of raspberry powders on the basis of the texture of the image pixel.

Evolutionary Algorithm Training of Higher Order Neural Networks

2010 ◽  
pp. 57-85
Author(s):  
M. G. Epitropakis ◽  
V. P. Plagianakos ◽  
Michael N. Vrahatis
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Real Life ◽  
Higher Order ◽  
Neural Network Training ◽  
Activation Functions ◽  
Swarm Optimization ◽  
Network Training ◽  
Higher Order Neural Networks ◽  
Distributed Evolutionary Algorithms

This chapter aims to further explore the capabilities of the Higher Order Neural Networks class and especially the Pi-Sigma Neural Networks. The performance of Pi-Sigma Networks is evaluated through several well known neural network training benchmarks. In the experiments reported here, Distributed Evolutionary Algorithms are implemented for Pi-Sigma neural networks training. More specifically, the distributed versions of the Differential Evolution and the Particle Swarm Optimization algorithms have been employed. To this end, each processor of a distributed computing environment is assigned a subpopulation of potential solutions. The subpopulations are independently evolved in parallel and occasional migration is allowed to facilitate the cooperation between them. The novelty of the proposed approach is that it is applied to train Pi-Sigma networks using threshold activation functions, while the weights and biases were confined in a narrow band of integers (constrained in the range [-32, 32]). Thus, the trained Pi-Sigma neural networks can be represented by using only 6 bits. Such networks are better suited for hardware implementation than the real weight ones and this property is very important in real-life applications. Experimental results suggest that the proposed training process is fast, stable and reliable and the distributed trained Pi-Sigma networks exhibit good generalization capabilities.

Sign in / Sign up

Export Citation Format

Share Document