Journal Article

SPIKED SEPARABLE COVARIANCE MATRICES AND PRINCIPAL COMPONENTS

Ding, Xiucai, Yang, Fan

2021

Overview

We study a class of separable sample covariance matrices of the form 𝒬̃1 := à 1/2 X B̃ X* à 1/2. Here, à and B̃ are positive definite matrices whose spectrums consist of bulk spectrums plus several spikes, that is, larger eigenvalues that are separated from the bulks. Conceptually, we call 𝒬̃1 a spiked separable covariance matrix model. On the one hand, this model includes the spiked covariance matrix as a special case with B̃ = I. On the other hand, it allows for more general correlations of datasets. In particular, for spatio-temporal dataset, à and B̃ represent the spatial and temporal correlations, respectively. In this paper, we study the outlier eigenvalues and eigenvectors, that is, the principal components, of the spiked separable covariance model 𝒬̃1. We prove the convergence of the outlier eigenvalues λ̃i and the generalized components (i.e., 〈v, ξ̃i 〉 for any deterministic vector v) of the outlier eigenvectors ξ̃i with optimal convergence rates. Moreover, we also prove the delocalization of the nonoutlier eigenvectors. We state our results in full generality, in the sense that they also hold near the so-called BBP transition and for degenerate outliers. Our results highlight both the similarity and difference between the spiked separable covariance matrix model and the spiked covariance matrix model in (Probab. Theory Related Fields 164 (2016) 459–552). In particular, we show that the spikes of both à and B̃ will cause outliers of the eigenvalue spectrum, and the eigenvectors can help to select the outliers that correspond to the spikes of à (or B̃).

• Publisher: Institute of Mathematical Statistics
• Subject: Convergence / Covariance matrix / Datasets / Eigenvalues / Eigenvectors / Histograms / Mathematical analysis / Matrix methods / Outliers (statistics) / Spikes / Studies