The Representation Theory of Neural Networks

In this work, we show that neural networks can be represented via the mathematical theory of quiver representations. More specifically, we prove that a neural network is a quiver representation with activation functions, a mathematical object that we represent using a network quiver. Furthermore, we show that network quivers gently adapt to common neural network concepts such as fully connected layers, convolution operations, residual connections, batch normalization, pooling operations and even randomly wired neural networks. We show that this mathematical representation is by no means an approximation of what neural networks are as it exactly matches reality. This interpretation is algebraic and can be studied with algebraic methods. We also provide a quiver representation model to understand how a neural network creates representations from the data. We show that a neural network saves the data as quiver representations, and maps it to a geometrical space called the moduli space, which is given in terms of the underlying oriented graph of the network, i.e., its quiver. This results as a consequence of our defined objects and of understanding how the neural network computes a prediction in a combinatorial and algebraic way. Overall, representing neural networks through the quiver representation theory leads to 9 consequences and 4 inquiries for future research that we believe are of great interest to better understand what neural networks are and how they work.

Weak Hopf Algebra and Its Quiver Representation

This study induced a weak Hopf algebra from the path coalgebra of a weak Hopf quiver. Moreover, it gave a quiver representation of the said algebra which gives rise to the various structures of the so-called weak Hopf algebra through the quiver. Furthermore, it also showed the canonical representation for each weak Hopf quiver. It was further observed that a Cayley digraph of a Clifford monoid can be embedded in its corresponding weak Hopf quiver of a Clifford monoid. This lead to the development of the foundation structures of weak Hopf algebra. Such quiver representation is useful for the classification of its path coalgebra. Additionally, some structures of module theory of algebra were also given. Such algebras can also be applied for obtaining the solutions of “quantum Yang–Baxter equation” that has many applications in the dynamical systems for finding interesting results.

Combinatorics of Nahm sums, quiver resultants and the K-theoretic condition

Algebraic Nahm equations, considered in the paper, are polynomial equations, governing the q → 1 limit of the q-hypergeometric Nahm sums. They make an appearance in various fields: hyperbolic geometry, knot theory, quiver representation theory, topological strings and conformal field theory. In this paper we focus primarily on Nahm sums and Nahm equations that arise in relation with symmetric quivers. For a large class of them, we prove that quiver A-polynomials — specialized resultants of the Nahm equations, are tempered (the so-called K-theoretic condition). This implies that they are quantizable. Moreover, we find that their face polynomials obey a remarkable combinatorial pattern. We use the machinery of initial forms and mixed polyhedral decompositions to investigate the edges of the Newton polytope. We show that this condition holds for the diagonal quivers with adjacency matrix C = diag(α, α, . . . , α), α ≥ 2, and provide several checks for non-diagonal quivers. Our conjecture is that the K-theoretic condition holds for all symmetric quivers.

Instanton sheaves and representations of quivers

We study the moduli space of rank 2 instanton sheaves on ℙ3 in terms of representations of a quiver consisting of three vertices and four arrows between two pairs of vertices. Aiming at an alternative compactification for the moduli space of instanton sheaves, we show that for each rank 2 instanton sheaf, there is a stability parameter θ for which the corresponding quiver representation is θ-stable (in the sense of King), and that the space of stability parameters has a non-trivial wall-and-chamber decomposition. Looking more closely at instantons of low charge, we prove that there are stability parameters with respect to which every representation corresponding to a rank 2 instanton sheaf of charge 2 is stable and provide a complete description of the wall-and-chamber decomposition for representation corresponding to a rank 2 instanton sheaf of charge 1.

Balanced pairs, cotorsion triplets and quiver representations

Balanced pairs appear naturally in the realm of relative homological algebra associated with the balance of right-derived functors of the Hom functor. Cotorsion triplets are a natural source of such pairs. In this paper, we study the connection between balanced pairs and cotorsion triplets by using recent quiver representation techniques. In doing so, we find a new characterization of abelian categories that have enough projectives and injectives in terms of the existence of complete hereditary cotorsion triplets. We also provide a short proof of the lack of balance for derived functors of Hom computed using flat resolutions, which extends the one given by Enochs in the commutative case.

Nori Motives of Curves With Modulus and Laumon 1-motives

Let k be a number field. We describe the category of Laumon 1-isomotives over k as the universal category in the sense of M. Nori associated with a quiver representation built out of smooth proper k-curves with two disjoint effective divisors and a notion of for such “curves with modulus”. This result extends and relies on a theorem of J. Ayoub and L. Barbieri-Viale that describes Deligne's category of 1-isomotives in terms of Nori's Abelian category of motives.