scholarly journals Network Recasting: A Universal Method for Network Architecture Transformation

Author(s):  
Joonsang Yu ◽  
Sungbum Kang ◽  
Kiyoung Choi

This paper proposes network recasting as a general method for network architecture transformation. The primary goal of this method is to accelerate the inference process through the transformation, but there can be many other practical applications. The method is based on block-wise recasting; it recasts each source block in a pre-trained teacher network to a target block in a student network. For the recasting, a target block is trained such that its output activation approximates that of the source block. Such a block-by-block recasting in a sequential manner transforms the network architecture while preserving the accuracy. This method can be used to transform an arbitrary teacher network type to an arbitrary student network type. It can even generate a mixed-architecture network that consists of two or more types of block. The network recasting can generate a network with fewer parameters and/or activations, which reduce the inference time significantly. Naturally, it can be used for network compression by recasting a trained network into a smaller network of the same type. Our experiments show that it outperforms previous compression approaches in terms of actual speedup on a GPU.

2014 ◽  
Vol 687-691 ◽  
pp. 2689-2692
Author(s):  
Zhao Li Wu

NAT (Network Address Translation) is the process of transforming one IP address in the datagram header into another. In practical applications, NAT is mainly used to realize the function of the access of private network to public network. The method of using a small number of public IP addresses representing a large quantity of private IP addresses will help to slow down the depletion of the IP address space available. As the Network Architecture is becoming more complex, the way, under such context, the NAT technology functions is of great importance. This dissertation will mainly analyze the special treatment of NAT in the following aspects like unified address management ,the priority level of address pool ,NAT mapping in PING Operation ,the treatment of ICMP err packet ,the NAT transformation of fragmented packet as well as the infinitive connection of multi –core products.


Author(s):  
WEI HUANG ◽  
K. K. LAI ◽  
Y. NAKAMORI ◽  
SHOUYANG WANG

Forecasting exchange rates is an important financial problem that is receiving increasing attention especially because of its difficulty and practical applications. Artificial neural networks (ANNs) have been widely used as a promising alternative approach for a forecasting task because of several distinguished features. Research efforts on ANNs for forecasting exchange rates are considerable. In this paper, we attempt to provide a survey of research in this area. Several design factors significantly impact the accuracy of neural network forecasts. These factors include the selection of input variables, preparing data, and network architecture. There is no consensus about the factors. In different cases, various decisions have their own effectiveness. We also describe the integration of ANNs with other methods and report the comparison between performances of ANNs and those of other forecasting methods, and finding mixed results. Finally, the future research directions in this area are discussed.


2021 ◽  
Author(s):  
Mark A. Nosiglia ◽  
Nathan D. Colley ◽  
Mark S. Palmquist ◽  
Abigail O. Delawder ◽  
Sheila L. Tran ◽  
...  

Mechanically interlocked molecules (MIMs) possess unique architectures and non-traditional degrees of freedom that arise from well-defined topologies that are achieved through precise mechanical bonding. Incorporation of MIMs into materials can thus provide an avenue to discover new and emergent macroscale properties. Here, the synthesis of a phenanthroline-based [2]catenane crosslinker and its incorporation into polyacrylate organogels is described. Specifically, Cu(I) metalation and de-metalation was used as a post-gelation strategy to tune the mechanical properties of a gel by controlling the conformational motions of integrated MIMs. The organogels were prepared via thermally initiated free radical polymerization, and Cu(I) metal was added in MeOH to pre-treated, swollen gels. De-metalation of the gels was achieved by adding cyanide salts and washing the gels. Changes in Young’s and shear moduli, as well as tensile strength, were quantified through oscillatory shear rheology and tensile testing. The reported approach provides a general method for post-gelation tuning of mechanical properties using metals and well-defined catenane topologies as part of a network architecture.


2021 ◽  
pp. 2150365
Author(s):  
Shu-Jie Chen ◽  
Li-Ming Zhao ◽  
Yun-Song Zhou ◽  
Gong-Min Wei

A general method is proposed to describe the energy levels of the interface states in one-dimensional photonic crystal (PC) heterojunction [Formula: see text] containing dispersive or non-dispersion materials. We found that the finite energy levels of the interface states for the finite configuration can be described totally by the dispersion relation of the PC with a periodic unit [Formula: see text]. It is further found that this method is also applicable for the case of defect modes. We believe our method can be used to guide the practical application.


Nanomaterials ◽  
2021 ◽  
Vol 11 (10) ◽  
pp. 2760
Author(s):  
Naitao Song ◽  
Nianxi Xu ◽  
Dongzhi Shan ◽  
Yuanhang Zhao ◽  
Jinsong Gao ◽  
...  

Longwave infrared (LWIR) optics are essential for several technologies, such as thermal imaging and wireless communication, but their development is hindered by their bulk and high fabrication costs. Metasurfaces have recently emerged as powerful platforms for LWIR integrated optics; however, conventional metasurfaces are highly chromatic, which adversely affects their performance in broadband applications. In this work, the chromatic dispersion properties of metasurfaces are analyzed via ray tracing, and a general method for correcting chromatic aberrations of metasurfaces is presented. By combining the dynamic and geometric phases, the desired group delay and phase profiles are imparted to the metasurfaces simultaneously, resulting in good achromatic performance. Two broadband achromatic metasurfaces based on all-germanium platforms are demonstrated in the LWIR : a broadband achromatic metalens with a numerical aperture of 0.32, an average intensity efficiency of 31%, and a Strehl ratio above 0.8 from 9.6 μm to 11.6 μm, and a broadband achromatic metasurface grating with a constant deflection angle of 30° from 9.6 μm to 11.6 μm. Compared with state-of-the-art chromatic-aberration-restricted LWIR metasurfaces, this work represents a substantial advance and brings the field a step closer to practical applications.


Author(s):  
Mohammed M. Ettouney ◽  
Raymond P. Daddazio ◽  
Najib N. Abboud

Abstract Discrete deterministic methods such as finite elements offer great flexibility in analyzing the dynamic response of vibrating systems. However, these methods can easily grow beyond available computer resources as frequencies of interest grow higher. In this paper we present a new approach for the frequency domain dynamic analysis of structures. A theory is developed for the analysis of systems which are uniform along a single coordinate axis but otherwise arbitrary in geometry and material composition. This approach, termed the Scale Independent Element, is shown to be an accurate, efficient and general method for the analysis of vibrating systems. This technique extends the applicability of discrete deterministic finite element based modeling to higher frequencies and is capable of bridging the gap to frequency regimes where statistical energy methods become applicable.


2020 ◽  
Vol 34 (07) ◽  
pp. 11865-11873 ◽  
Author(s):  
Yongri Piao ◽  
Zhengkun Rong ◽  
Miao Zhang ◽  
Huchuan Lu

Light field saliency detection is becoming of increasing interest in recent years due to the significant improvements in challenging scenes by using abundant light field cues. However, high dimension of light field data poses computation-intensive and memory-intensive challenges, and light field data access is far less ubiquitous as RGB data. These may severely impede practical applications of light field saliency detection. In this paper, we introduce an asymmetrical two-stream architecture inspired by knowledge distillation to confront these challenges. First, we design a teacher network to learn to exploit focal slices for higher requirements on desktop computers and meanwhile transfer comprehensive focusness knowledge to the student network. Our teacher network is achieved relying on two tailor-made modules, namely multi-focusness recruiting module (MFRM) and multi-focusness screening module (MFSM), respectively. Second, we propose two distillation schemes to train a student network towards memory and computation efficiency while ensuring the performance. The proposed distillation schemes ensure better absorption of focusness knowledge and enable the student to replace the focal slices with a single RGB image in an user-friendly way. We conduct the experiments on three benchmark datasets and demonstrate that our teacher network achieves state-of-the-arts performance and student network (ResNet18) achieves Top-1 accuracies on HFUT-LFSD dataset and Top-4 on DUT-LFSD, which tremendously minimizes the model size by 56% and boosts the Frame Per Second (FPS) by 159%, compared with the best performing method.


1998 ◽  
Vol 37 (03) ◽  
pp. 220-225 ◽  
Author(s):  
N. Pendleton ◽  
C. P. Lucas ◽  
S. B. Lucas ◽  
M. A. Horan ◽  
M. F. Jefferson

AbstractArtificial neural networks (ANNs) are compared to standard statistical methods for outcome prediction in biomedical problems. A general method for using genetic algorithms to "evolve" ANN architecture (EANN) is presented. Accuracy of logistic regression, a fully interconnected ANN, and an EANN for predicting depression after mania are examined. All methods showed very good agreement (training set accuracy, chi-square all p <0.01). However, significant differences were found for stability (test set accuracy); logistic regression being the most unstable and EANN being significantly more stable than a fully interconnected ANN (McNemar p <0.01). We conclude that the EANN method enhances ANN stability. This approach may have particular relevance for biomedical prediction problems, such as predicting depression after mania.


2018 ◽  
Vol 2018 ◽  
pp. 1-5 ◽  
Author(s):  
Lei Jiao ◽  
Yuehui Wang ◽  
Yusong Zhi ◽  
Wei Cui ◽  
Zhengwei Chen ◽  
...  

Direct growth of uniform wafer-scale two-dimensional (2D) layered materials using a universal method is of vital importance for utilizing 2D layers into practical applications. Here, we report on the structural and transport properties of large-scale few-layer MoS2 back-gated field effect transistors (FETs), fabricated using conventional pulsed laser deposition (PLD) technique. Raman spectroscopy and transmission electron microscopy results confirmed that the obtained MoS2 layers on SiO2/Si substrate are multilayers. The FETs devices exhibit a relative high on/off ratio of 5 × 102 and mobility of 0.124 cm2V−1S−1. Our results suggest that the PLD would be a suitable pathway to grow 2D layers for future industrial device applications.


2016 ◽  
Author(s):  
John A. P. Sekar ◽  
Jose-Juan Tapia ◽  
James R. Faeder

AbstractRule-based modeling frameworks provide a specification format in which kinetic interactions are modeled as “reaction rules”. These rules are specified on phosphorylation motifs, domains, binding sites and other sub-molecular structures, and have proved useful for modeling signal transduction. Visual representations are necessary to understand individual rules as well as analyze interactions of hundreds of rules, which motivates the need for automated diagramming tools for rule-based models. Here, we present a theoretical framework that unifies the layers of information in a rule-based model and enables automated visualization of (i) the mechanism encoded in a rule, (ii) the regulatory interaction of two or more rules, and (iii) the emergent network architecture of a large rule set. Specifically, we present a compact rule visualization that conveys the action of a rule explicitly (unlike conventional visualizations), a regulatory graph visualization that conveys regulatory interactions between rules, and a set of graph compression methods that synthesize informative pathway diagrams from complex regulatory graphs. These methods enable inference of network motifs (such as feedback and feed-forward loops), automated generation of signal flow diagrams for hundreds of rules, and tunable network compression using heuristics and graph analysis, all of which are advances over the state of the art for rule-based models. These methods also produce more readable diagrams than currently available tools as we show with an empirical comparison across 27 published rule-based models of various sizes. We provide an implementation in the open source and freely available BioNetGen framework, but the underlying methods are applicable to all current rule-based models in BioNetGen, Kappa and Simmune frameworks. We expect that these tools will promote communication and analysis of rule-based models and their eventual integration into whole cell models.Author SummarySignaling in living cells is mediated through a complex network of chemical interactions. Current predictive models of signal pathways have hundreds of reaction rules that specify chemical interactions, and a comprehensive model of a stem cell or cancer cell would be expected to have many more. Visualizations of rules and their interactions are needed to navigate, organize, communicate and analyze large signaling models. In this work, we have developed: (i) a novel visualization for individual rules that compactly conveys what each rule does, (ii) a comprehensive visualization of a set of rules as a network of regulatory interactions called a regulatory graph, and (iii) a set of procedures for compressing the regulatory graph into a pathway diagram that highlights underlying signaling motifs such as feedback and feedforward loops. We show that these visualizations are compact and informative across models of widely varying sizes. The methods developed here not only improve the understandability of current models, but also establish principles for organizing the much larger models of the future.


Sign in / Sign up

Export Citation Format

Share Document