Phase Transition in Limiting Distributions of Coherence of High-Dimensional Random Matrices
Tony Cai and Tiefeng Jiang
-
Abstract:
The coherence of a random matrix, which is defined to be the largest magnitude of the Pearson correlation coefficients between the columns of the random matrix, is an important quantity for a wide range of applications including high-dimensional statistics and signal processing. Inspired by these applications, this paper studies the limiting laws of the coherence of n × p random matrices for a full range of the dimension p with a special focus on the ultra high-dimensional setting. Assuming the columns of the random matrix are independent random vectors with a common spherical distribution, we give a complete characterization of the behavior of the limiting distributions of the coherence. More specifically, the limiting distributions of the coherence are derived separately for three regimes: log(p)/n → 0, log(p)/n → β ∈ (0, ∞), and log(p)/n → ∞. The results show that the limiting behavior of the coherence differs significantly in different regimes and exhibits interesting phase transition phenomena as the dimension p grows as a function of n. Applications to statistics and compressed sensing in the ultra high-dimensional setting are also discussed.
- Paper:
pdf file.
- Other related papers:
Cai, T. & Jiang, T. (2011).
Limiting laws of coherence of random matrices with applications to testing covariance structure and construction of compressed sensing matrices.
The Annals of Statistics 39, 1496-1525.Cai, T., Wang, L. & Xu, G. (2010).
Stable recovery of sparse signals and an oracle inequality.
IEEE Transactions on Information Theory 56, 3516-3522.