scholarly journals Echo State Networks with Self-Normalizing Activations on the Hyper-Sphere

2019 ◽  
Vol 9 (1) ◽  
Author(s):  
Pietro Verzelli ◽  
Cesare Alippi ◽  
Lorenzo Livi

Abstract Among the various architectures of Recurrent Neural Networks, Echo State Networks (ESNs) emerged due to their simplified and inexpensive training procedure. These networks are known to be sensitive to the setting of hyper-parameters, which critically affect their behavior. Results show that their performance is usually maximized in a narrow region of hyper-parameter space called edge of criticality. Finding such a region requires searching in hyper-parameter space in a sensible way: hyper-parameter configurations marginally outside such a region might yield networks exhibiting fully developed chaos, hence producing unreliable computations. The performance gain due to optimizing hyper-parameters can be studied by considering the memory–nonlinearity trade-off, i.e., the fact that increasing the nonlinear behavior of the network degrades its ability to remember past inputs, and vice-versa. In this paper, we propose a model of ESNs that eliminates critical dependence on hyper-parameters, resulting in networks that provably cannot enter a chaotic regime and, at the same time, denotes nonlinear behavior in phase space characterized by a large memory of past inputs, comparable to the one of linear networks. Our contribution is supported by experiments corroborating our theoretical findings, showing that the proposed model displays dynamics that are rich-enough to approximate many common nonlinear systems used for benchmarking.

2014 ◽  
Vol 6 (1) ◽  
pp. 1032-1035 ◽  
Author(s):  
Ramzi Suleiman

The research on quasi-luminal neutrinos has sparked several experimental studies for testing the "speed of light limit" hypothesis. Until today, the overall evidence favors the "null" hypothesis, stating that there is no significant difference between the observed velocities of light and neutrinos. Despite numerous theoretical models proposed to explain the neutrinos behavior, no attempt has been undertaken to predict the experimentally produced results. This paper presents a simple novel extension of Newton's mechanics to the domain of relativistic velocities. For a typical neutrino-velocity experiment, the proposed model is utilized to derive a general expression for . Comparison of the model's prediction with results of six neutrino-velocity experiments, conducted by five collaborations, reveals that the model predicts all the reported results with striking accuracy. Because in the proposed model, the direction of the neutrino flight matters, the model's impressive success in accounting for all the tested data, indicates a complete collapse of the Lorentz symmetry principle in situation involving quasi-luminal particles, moving in two opposite directions. This conclusion is support by previous findings, showing that an identical Sagnac effect to the one documented for radial motion, occurs also in linear motion.


2020 ◽  
Vol 23 (4) ◽  
pp. 274-284 ◽  
Author(s):  
Jingang Che ◽  
Lei Chen ◽  
Zi-Han Guo ◽  
Shuaiqun Wang ◽  
Aorigele

Background: Identification of drug-target interaction is essential in drug discovery. It is beneficial to predict unexpected therapeutic or adverse side effects of drugs. To date, several computational methods have been proposed to predict drug-target interactions because they are prompt and low-cost compared with traditional wet experiments. Methods: In this study, we investigated this problem in a different way. According to KEGG, drugs were classified into several groups based on their target proteins. A multi-label classification model was presented to assign drugs into correct target groups. To make full use of the known drug properties, five networks were constructed, each of which represented drug associations in one property. A powerful network embedding method, Mashup, was adopted to extract drug features from above-mentioned networks, based on which several machine learning algorithms, including RAndom k-labELsets (RAKEL) algorithm, Label Powerset (LP) algorithm and Support Vector Machine (SVM), were used to build the classification model. Results and Conclusion: Tenfold cross-validation yielded the accuracy of 0.839, exact match of 0.816 and hamming loss of 0.037, indicating good performance of the model. The contribution of each network was also analyzed. Furthermore, the network model with multiple networks was found to be superior to the one with a single network and classic model, indicating the superiority of the proposed model.


Author(s):  
Zihang Wei ◽  
Yunlong Zhang ◽  
Xiaoyu Guo ◽  
Xin Zhang

Through movement capacity is an essential factor used to reflect intersection performance, especially for signalized intersections, where a large proportion of vehicle demand is making through movements. Generally, left-turn spillback is considered a key contributor to affect through movement capacity, and blockage to the left-turn bay is known to decrease left-turn capacity. Previous studies have focused primarily on estimating the through movement capacity under a lagging protected only left-turn (lagging POLT) signal setting, as a left-turn spillback is more likely to happen under such a condition. However, previous studies contained assumptions (e.g., omit spillback), or were dedicated to one specific signal setting. Therefore, in this study, through movement capacity models based on probabilistic modeling of spillback and blockage scenarios are established under four different signal settings (i.e., leading protected only left-turn [leading POLT], lagging left-turn, protected plus permitted left-turn, and permitted plus protected left-turn). Through microscopic simulations, the proposed models are validated, and compared with existing capacity models and the one in the Highway Capacity Manual (HCM). The results of the comparisons demonstrate that the proposed models achieved significant advantages over all the other models and obtained high accuracies in all signal settings. Each proposed model for a given signal setting maintains consistent accuracy across various left-turn bay lengths. The proposed models of this study have the potential to serve as useful tools, for practicing transportation engineers, when determining the appropriate length of a left-turn bay with the consideration of spillback and blockage, and the adequate cycle length with a given bay length.


2021 ◽  
Vol 2021 (6) ◽  
Author(s):  
Ankit Beniwal ◽  
Juan Herrero-García ◽  
Nicholas Leerdam ◽  
Martin White ◽  
Anthony G. Williams

Abstract The Scotogenic Model is one of the most minimal models to account for both neutrino masses and dark matter (DM). In this model, neutrino masses are generated at the one-loop level, and in principle, both the lightest fermion singlet and the lightest neutral component of the scalar doublet can be viable DM candidates. However, the correct DM relic abundance can only be obtained in somewhat small regions of the parameter space, as there are strong constraints stemming from lepton flavour violation, neutrino masses, electroweak precision tests and direct detection. For the case of scalar DM, a sufficiently large lepton-number-violating coupling is required, whereas for fermionic DM, coannihilations are typically necessary. In this work, we study how the new scalar singlet modifies the phenomenology of the Scotogenic Model, particularly in the case of scalar DM. We find that the new singlet modifies both the phenomenology of neutrino masses and scalar DM, and opens up a large portion of the parameter space of the original model.


Mathematics ◽  
2021 ◽  
Vol 9 (15) ◽  
pp. 1815
Author(s):  
Diego I. Gallardo ◽  
Mário de Castro ◽  
Héctor W. Gómez

A cure rate model under the competing risks setup is proposed. For the number of competing causes related to the occurrence of the event of interest, we posit the one-parameter Bell distribution, which accommodates overdispersed counts. The model is parameterized in the cure rate, which is linked to covariates. Parameter estimation is based on the maximum likelihood method. Estimates are computed via the EM algorithm. In order to compare different models, a selection criterion for non-nested models is implemented. Results from simulation studies indicate that the estimation method and the model selection criterion have a good performance. A dataset on melanoma is analyzed using the proposed model as well as some models from the literature.


2017 ◽  
Vol 27 (1) ◽  
pp. 181-194 ◽  
Author(s):  
Yiran Xue ◽  
Peng Liu ◽  
Ye Tao ◽  
Xianglong Tang

Abstract In the field of intelligent crowd video analysis, the prediction of abnormal events in dense crowds is a well-known and challenging problem. By analysing crowd particle collisions and characteristics of individuals in a crowd to follow the general trend of motion, a purpose-driven lattice Boltzmann model (LBM) is proposed. The collision effect in the proposed method is measured according to the variation in crowd particle numbers in the image nodes; characteristics of the crowd following a general trend are incorporated by adjusting the particle directions. The model predicts dense crowd abnormal events in different intervals through iterations of simultaneous streaming and collision steps. Few initial frames of a video are needed to initialize the proposed model and no training procedure is required. Experimental results show that our purpose-driven LBM performs better than most state-of-the-art methods.


1995 ◽  
Vol 85 (6) ◽  
pp. 1821-1834
Author(s):  
Toshimi Satoh ◽  
Toshiaki Sato ◽  
Hiroshi Kawase

Abstract We evaluate the nonlinear behavior of soil sediments during strong ground shaking based on the identification of their S-wave velocities and damping factors for both the weak and strong motions observed on the surface and in a borehole at Kuno in the Ashigara Valley, Japan. First we calculate spectral ratios between the surface station KS2 and the borehole station KD2 at 97.6 m below the surface for the main part of weak and strong motions. The predominant period for the strong motion is apparently longer than those for the weak motions. This fact suggests the nonlinearity of soil during the strong ground shaking. To quantify the nonlinear behavior of soil sediments, we identify their S-wave velocities and damping factors by minimizing the residual between the observed spectral ratio and the theoretical amplification factor calculated from the one-dimensional wave propagation theory. The S-wave velocity and the damping factor h (≈(2Q)−1) of the surface alluvial layer identified from the main part of the strong motion are about 10% smaller and 50% greater, respectively, than those identified from weak motions. The relationships between the effective shear strain (=65% of the maximum shear strain) calculated from the one-dimensional wave propagation theory and the shear modulus reduction ratios or the damping factors estimated by the identification method agree well with the laboratory test results. We also confirm that the soil model identified from a weak motion overestimates the observed strong motion at KS2, while that identified from the strong motion reproduces the observed. Thus, we conclude that the main part of the strong motion, whose maximum acceleration at KS2 is 220 cm/sec2 and whose duration is 3 sec, has the potential of making the surface soil nonlinear at an effective shear strain on the order of 0.1%. The S-wave velocity in the surface alluvial layer identified from the part just after the main part of the strong motion is close to that identified from weak motions. This result suggests that the shear modulus recovers quickly as the shear strain level decreases.


1997 ◽  
Vol 119 (3) ◽  
pp. 478-485 ◽  
Author(s):  
M. Goldfarb ◽  
N. Celanovic

A lumped-parameter model of a piezoelectric stack actuator has been developed to describe actuator behavior for purposes of control system analysis and design, and in particular for control applications requiring accurate position tracking performance. In addition to describing the input-output dynamic behavior, the proposed model explains aspects of nonintuitive behavioral phenomena evinced by piezoelectric actuators, such as the input-output rate-independent hysteresis and the change in mechanical stiffness that results from altering electrical load. Bond graph terminology is incorporated to facilitate the energy-based formulation of the actuator model. The authors propose a new bond graph element, the generalized Maxwell resistive capacitor, as a lumped-parameter causal representation of rate-independent hysteresis. Model formulation is validated by comparing results of numerical simulations to experimental data.


2021 ◽  
Vol 7 ◽  
pp. e505
Author(s):  
Noha Ahmed Bayomy ◽  
Ayman E. Khedr ◽  
Laila A. Abd-Elmegid

The one constant in the world is change. The changing dynamics of business environment enforces the organizations to re-design or reengineer their business processes. The main objective of such reengineering processes is to provide services or produce products with the possible lowest cost, shortest time, and best quality. Accordingly, Business Process Re-engineering (BPR) provides a roadmap of how to efficiently achieve the operational goals in terms of enhanced flexibility and productivity, reduced cost, and improved quality of service or product. In this article, we propose an efficient model for BPR. The model specifies where the breakdowns occur in BPR implementation, justifies why such breakdowns occur, and proposes techniques to prevent their occurrence again. The proposed model has been built based on two main sections. The first section focuses on integrating Critical Success Factors (CSFs) and the performance of business processes during the reengineering processes. Additionally, it implements the association rule mining technique to investigate the relationship between CSFs and different business processes. The second section aims to measure the performance of business processes (intended success of BPR) by process time, cycle time, quality and cost before and after reengineering processes. A case study of the Egyptian Tax Authority (ETA) is used to test the efficiency of the proposed model.


Sign in / Sign up

Export Citation Format

Share Document