Regularity Normalization: Neuroscience-Inspired Unsupervised Attention across Neural Network Layers

Inspired by the adaptation phenomenon of neuronal firing, we propose the regularity normalization (RN) as an unsupervised attention mechanism (UAM) which computes the statistical regularity in the implicit space of neural networks under the Minimum Description Length (MDL) principle. Treating the neural network optimization process as a partially observable model selection problem, the regularity normalization constrains the implicit space by a normalization factor, the universal code length. We compute this universal code incrementally across neural network layers and demonstrate the flexibility to include data priors such as top-down attention and other oracle information. Empirically, our approach outperforms existing normalization methods in tackling limited, imbalanced and non-stationary input distribution in image classification, classic control, procedurally-generated reinforcement learning, generative modeling, handwriting generation and question answering tasks with various neural network architectures. Lastly, the unsupervised attention mechanisms is a useful probing tool for neural networks by tracking the dependency and critical learning stages across layers and recurrent time steps of deep networks.

Area-Efficient Universal Code Generator for GPS L1C and BDS B1C Signals

Recently, multi-frequency multi-constellation receivers have been actively studied, which are single receivers that process multiple global navigation satellite system (GNSS) signals for high accuracy and reliability. However, in order for a single receiver to process multiple GNSS signals, it requires as many code generators as the number of supported GNSS signals, and this is one of the problems that must be solved in implementing an efficient multi-frequency multi-constellation receiver. This paper proposes an area-efficient universal code generator that can support both GPS L1C signals and BDS B1C signals. The proposed architecture alleviates the area problem by sharing common hardware in a time-multiplex mode without degrading the overall system performance. According to the result of the synthesis using the CMOS 65 nm process, the proposed universal code generator has an area reduced by 98%, 93%, and 60% compared to the previous memory-based universal code generator (MB UCG), the Legendre-generation universal code generator (LG UCG), and the Weil-generation universal code generator (WG UCG), respectively. Furthermore, the proposed generator is applicable to all Legendre sequence-based codes.

Area-Efficient Universal Code Generator for Multi-GNSS Receivers

Although conventional global navigation satellite systems (GNSS) receivers were originally designed for single signals, studies on multi-signal receiver design have recently been actively conducted to achieve high accuracy, precision, and reliability. However, in order for a multi-signal receiver to support various codes, the receiver should support the generation of individual codes. Therefore, the resulting problem of increased complexity must be solved. This paper proposes a hardware structure for an area-efficient linear feedback shift register (LFSR)-based multi-frequency universal code generator. Whereas the existing universal code generators were configured so that feedback polynomials, output registers, and initial values can be selected by placing read-only memories (ROMs), multiplexers (MUXs), and exclusive ORs (XORs) by register bit, in the case of the proposed universal code generator; the circuit was implemented by applying the hardwiring technique to those register bits that have fixed values. According to the results of field programmable gate array (FPGA) implementation, the proposed LFSR-based universal code generator can improve look up table (LUT) by up to 37% and register by up to 78% when compared to conventional code generators, and LUT by up to 36% when compared to the previous universal code generator. Therefore, the proposed universal code generator is a good candidate for implementing multi-frequency receivers to achieve high precision and high reliability.

Optimal Evolution of the Standard Genetic Code

The Standard Genetic Code (SGC) exists in every known organism on Earth. SGC evolution via early unique codon assignment, then later wobble, yields coding resembling the near-universal code. Below, later wobble is shown to also create an optimal route to accurate codon assignment. Time of optimal codon assignment matches the previously defined mean time for ordered coding, exhibiting ≥ 90% of SGC order. Accurate evolution is also accessible, sufficiently frequent to appear in populations of 103 to 104 codes. SGC-like coding capacity, code order, and accurate assignments therefore arise together, in one attainable evolutionary intermediate. Examples, which plausibly resemble coding at evolutionary domain separation, are characterized.

Universal Code of Movies and Influence of Traditional Media

The chapter dwells on the need of studying of universality of certain components of audiovisual media (especially movies) as a cause and possible instrument of international political communication. Emphasized is the low level of research of that very problem in the context of political studies, which ensures certain difficulties in formulating political components of the international political communication evident in case of movies. On an example of Movies in Politics by J. Rosenbaum it is shown why film criticism has a poor connection with political science. Examples of such an influence are presented in the chapter both through historical discourse and more specific cases. Proposed is the string of concept terms among which a universal code of movies – a certain informational component of audiovisual productions, understandable without its textual basis.

World of Uncertainty

The chapter dwells upon new media and its roots being in universal codes of media, including abiding by same basic rules as works of fiction known for having cult status, especially cult films. The use of deconstruction and reconstruction are seen and researched as two popular methods of new media which have a rich cultural tradition, explored here through the prism of universal code of media in international political communication. Additional related concern of chapter is decline of relevance of platform, which effectively derails existent hierarchy of media in recent times.

Cultural Code Of Petersburg in the Musical World of Sergey Slonimsky

The article is devoted to the problem of cultural traditions and cultural heritage associated with St. Petersburg and its importance in the culture of Russia. It explores the musical world of the greatest composer of the XX–XXI centuries. Sergei Mikhailovich Slonimsky, a native of St. Petersburg, in whose work and all extensive activities the city on the Neva played a decisive role, becoming a kind of cultural code of his artistic life. These features manifested themselves in the family genetics of the Slonimsky clan, the years of study and work associated with the St. Petersburg Conservatory, in an organic fusion of Westernizing and Slavophil tendencies typical for the culture of St. Petersburg, on the basis of which the musical image of St. Petersburg (Petrograd, Leningrad) was formed in his work. The conclusion is made about the deep national originality of the musical world of Slonimsky, formed by the universal “code of Petersburg” and which has become a precious heritage of Russian, European and world cultures.

Tesla's Hidden Holism

Today, without a doubt one can say that the work of Nikola Tesla has a lot of hidden ideas, as in the time when he created, and in the "postponed time", when later we research the documentations in his professional and scientific legacy. In addition to above, can be presented significant Tesla's records, which testify Tesla's holistic approach to the natural systems, through a higher degree of interdependence of parts within the whole, as well as the interdependence of each part of the whole to which it belongs. By this, the "higher level dependency" can be understood in the sense that a whole is not a simple sum of the parts and the relationships that it (the whole) make, but also for the relation of the parts to the environment, as well as the relation of the whole and connection to the environment, wherein the "environment", among other things, is a series of natural numbers, with its principles and laws; and that "others" are the principles of the organizing the Universal Code of Nature, which code will also be presented.