scholarly journals Appearance of random matrix theory in deep learning

Author(s):  
Nicholas P. Baskerville ◽  
Diego Granziol ◽  
Jonathan P. Keating
Author(s):  
Jungang Ge ◽  
Ying-Chang Liang ◽  
Zhidong Bai ◽  
Guangming Pan

Large-dimensional (LD) random matrix theory, RMT for short, which originates from the research field of quantum physics, has shown tremendous capability in providing deep insights into large-dimensional systems. With the fact that we have entered an unprecedented era full of massive amounts of data and large complex systems, RMT is expected to play more important roles in the analysis and design of modern systems. In this paper, we review the key results of RMT and its applications in two emerging fields: wireless communications and deep learning. In wireless communications, we show that RMT can be exploited to design the spectrum sensing algorithms for cognitive radio systems and to perform the design and asymptotic analysis for large communication systems. In deep learning, RMT can be utilized to analyze the Hessian, input–output Jacobian and data covariance matrix of the deep neural networks, thereby to understand and improve the convergence and the learning speed of the neural networks. Finally, we highlight some challenges and opportunities in applying RMT to the practical large-dimensional systems.


Author(s):  
Jan W Dash ◽  
Xipei Yang ◽  
Mario Bondioli ◽  
Harvey J. Stein

Author(s):  
Oriol Bohigas ◽  
Hans A. Weidenmüller

An overview of the history of random matrix theory (RMT) is provided in this chapter. Starting from its inception, the authors sketch the history of RMT until about 1990, focusing their attention on the first four decades of RMT. Later developments are partially covered. In the past 20 years RMT has experienced rapid development and has expanded into a number of areas of physics and mathematics.


Sign in / Sign up

Export Citation Format

Share Document