Towards minimal network architectures with evolutionary growth networks

2002 ◽  
Author(s):  
S.G. Romaniuk
Keyword(s):  
Network Architectures ◽  
Minimal Network ◽  
Evolutionary Growth

THEORETICAL RESULTS FOR A CLASS OF NEURAL NETWORKS

1995 ◽  
Vol 06 (04) ◽  
pp. 463-472
Author(s):  
STEVE G. ROMANIUK
Keyword(s):  
Neural Networks ◽  
Theoretical Analysis ◽  
General Class ◽  
Simple Algorithm ◽  
Benchmark Problems ◽  
Network Architectures ◽  
Large Set ◽  
Minimal Network ◽  
Theoretical Results

The ability to derive minimal network architectures for neural networks has been at the center of attention for several years now. To this date numerous algorithms have been proposed to automatically construct networks. Unfortunately, these algorithms lack a fundamental theoretical analysis of their capabilities and only empirical evaluations on a few selected benchmark problems exist. Some theoretical results have been provided for small classes of well-known benchmark problems such as parity- and encoder-functions, but these are of little value due to their restrictiveness. In this work we describe a general class of 2-layer networks with 2 hidden units capable of representing a large set of problems. The cardinality of this class grows exponentially with regard to the inputs N. Furthermore, we outline a simple algorithm that allows us to determine, if any function (problem) is a member of this class. The class considered in this paper includes the benchmark problems parity and symmetry. Finally, we expand this class to include an even larger set of functions and point out several interesting properties it exhibits.

Color Space Transformation using Neural Networks

2019 ◽  
Vol 2019 (1) ◽  
pp. 153-158
Author(s):  
Lindsay MacDonald
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Color Space ◽  
Reflectance Spectra ◽  
Network Architectures ◽  
Color Spaces ◽  
Natural Materials ◽  
Space Transformation ◽  
Color Space Transformation

We investigated how well a multilayer neural network could implement the mapping between two trichromatic color spaces, specifically from camera R,G,B to tristimulus X,Y,Z. For training the network, a set of 800,000 synthetic reflectance spectra was generated. For testing the network, a set of 8,714 real reflectance spectra was collated from instrumental measurements on textiles, paints and natural materials. Various network architectures were tested, with both linear and sigmoidal activations. Results show that over 85% of all test samples had color errors of less than 1.0 ΔE2000 units, much more accurate than could be achieved by regression.

Deep Learning Approaches for Whiteboard Image Quality Enhancement

2019 ◽  
Vol 2019 (1) ◽  
pp. 360-368
Author(s):  
Mekides Assefa Abebe ◽  
Jon Yngve Hardeberg
Keyword(s):  
Deep Learning ◽  
Image Quality ◽  
Image Data ◽  
Quality Enhancement ◽  
Network Architectures ◽  
Learning Approaches ◽  
Data Set ◽  
Image Quality Enhancement ◽  
Processing Techniques ◽  
White Balancing

Different whiteboard image degradations highly reduce the legibility of pen-stroke content as well as the overall quality of the images. Consequently, different researchers addressed the problem through different image enhancement techniques. Most of the state-of-the-art approaches applied common image processing techniques such as background foreground segmentation, text extraction, contrast and color enhancements and white balancing. However, such types of conventional enhancement methods are incapable of recovering severely degraded pen-stroke contents and produce artifacts in the presence of complex pen-stroke illustrations. In order to surmount such problems, the authors have proposed a deep learning based solution. They have contributed a new whiteboard image data set and adopted two deep convolutional neural network architectures for whiteboard image quality enhancement applications. Their different evaluations of the trained models demonstrated their superior performances over the conventional methods.

The Table of Grammar: Lqr't as Test Case

2021 ◽  
Vol 29 (2) ◽  
Author(s):  
H. H. Hardy
Keyword(s):  
Biblical Hebrew ◽  
Linguistic Knowledge ◽  
Function Word ◽  
Test Case ◽  
Linguistic Development ◽  
Grammatical Categories ◽  
Evolutionary Growth ◽  
Content Item

Biblical Hebrew lqr't is situated at the intersection of grammatical categories as a content item and a function word. The analysis of any given token is confounded by this diversity and its variously encoded denotations: the infinitive construct “to meet” and the polysemous prepositions, the directional TOWARD and the adversative AGAINST. The usage in Exodus 14:27 (wmsrym nsym lqr'tw) prompts a number of different analyses. Interpretations include: hoi de aigyptioi ephygon hypo to hydor (LXX); wmsry' -'rqyn lqwblh (Peshitta); fugientibusque Ægyptiis occurrerunt aquæ (Vulgate); “the Egyptians fled at its approach” (NJPS); “the Egyptians fled before it” (NRSV); and “the Egyptians were fleeing toward it” (NIV). This study examines lqr't by comparing a range of grammatical methods. These approaches centre evolutionary growth (philology), syntagmatic and paradigmatic features (structuralism), functional usage (eclectic linguistics), and cross-linguistic development (grammaticalisation) in order to explore questions of the origin, development, and usage of lqr't. The combined approaches help to situate and construct an archaeology of linguistic knowledge and a genealogy of philological change of language and text.

Enabling Things To Talk in Heterogeneous Self-Organizing Networks—An Exhaustive Critique For IOT

GIS Business ◽  
2019 ◽  
Vol 14 (6) ◽  
pp. 728-750
Author(s):  
Naeem Z Azeemi ◽  
Saira Khan ◽  
Sharmini Enoch ◽  
Riktesh Srivastava ◽  
Omar al Basheer ◽  
...  
Keyword(s):  
Mobile Networks ◽  
Adaptive Modulation ◽  
Sustainable Growth ◽  
Adaptive Modulation And Coding ◽  
Network Architectures ◽  
Multiple Antenna ◽  
Multiple Access Schemes ◽  
Natural Outcome ◽  
Air Interfaces ◽  
The Internet Of Things

The superstructure network in the Internet of Things (IoT) is an emerging network targeted to enable an ecosystem of smart applications and services. It connectsphysical resources and peopletogether with software, hence contribute to sustainable growth, provided it combines and guarantees trustand security for people and businesses.  In this work we presented smart city viewpoint opt-in to the Firth Generation (5G) mobile networks. Both a framework and deployment are explored rigorously to assist and predicting robustness of IoT technologies and applications as a natural outcome of the Third Generation Partnership Project (3GPP) in general and LTE in particular. These technologies are compared on the basis of Air Interfaces and their Specifications i.e. Adaptive Modulation and Coding, Multiple Access Schemes and Multiple Antenna Techniques along with the evolution and comparison of the Network Architectures.

scholarly journals OutlierNets: Highly Compact Deep Autoencoder Network Architectures for On-Device Acoustic Anomaly Detection

Sensors ◽  
2021 ◽  
Vol 21 (14) ◽  
pp. 4805
Author(s):  
Saad Abbasi ◽  
Mahmoud Famouri ◽  
Mohammad Javad Shafiee ◽  
Alexander Wong
Keyword(s):  
Machine Learning ◽  
Anomaly Detection ◽  
Detection Methods ◽  
Detection Accuracy ◽  
Network Architectures ◽  
Design Exploration ◽  
Convolutional Autoencoder ◽  
Acoustic Anomaly ◽  
Human Operators ◽  
Computational Resources

Human operators often diagnose industrial machinery via anomalous sounds. Given the new advances in the field of machine learning, automated acoustic anomaly detection can lead to reliable maintenance of machinery. However, deep learning-driven anomaly detection methods often require an extensive amount of computational resources prohibiting their deployment in factories. Here we explore a machine-driven design exploration strategy to create OutlierNets, a family of highly compact deep convolutional autoencoder network architectures featuring as few as 686 parameters, model sizes as small as 2.7 KB, and as low as 2.8 million FLOPs, with a detection accuracy matching or exceeding published architectures with as many as 4 million parameters. The architectures are deployed on an Intel Core i5 as well as a ARM Cortex A72 to assess performance on hardware that is likely to be used in industry. Experimental results on the model’s latency show that the OutlierNet architectures can achieve as much as 30x lower latency than published networks.

Sign in / Sign up

Export Citation Format

Share Document