TY - JOUR
T1 - Robust estimation of precision matrices under cellwise contamination
AU - Tarr, G.
AU - Müller, S.
AU - Weber, N. C.
PY - 2016/1
Y1 - 2016/1
N2 - There is a great need for robust techniques in data mining and machine learning contexts where many standard techniques such as principal component analysis and linear discriminant analysis are inherently susceptible to outliers. Furthermore, standard robust procedures assume that less than half the observation rows of a data matrix are contaminated, which may not be a realistic assumption when the number of observed features is large. The problem of estimating covariance and precision matrices under cellwise contamination is investigated. The use of a robust pairwise covariance matrix as an input to various regularisation routines, such as the graphical lasso, QUIC and CLIME is considered. A method that transforms a symmetric matrix of pairwise covariances to the nearest covariance matrix is used to ensure the input covariance matrix is positive semidefinite. The result is a potentially sparse precision matrix that is resilient to moderate levels of cellwise contamination. Since this procedure is not based on subsampling it scales well as the number of variables increases.
AB - There is a great need for robust techniques in data mining and machine learning contexts where many standard techniques such as principal component analysis and linear discriminant analysis are inherently susceptible to outliers. Furthermore, standard robust procedures assume that less than half the observation rows of a data matrix are contaminated, which may not be a realistic assumption when the number of observed features is large. The problem of estimating covariance and precision matrices under cellwise contamination is investigated. The use of a robust pairwise covariance matrix as an input to various regularisation routines, such as the graphical lasso, QUIC and CLIME is considered. A method that transforms a symmetric matrix of pairwise covariances to the nearest covariance matrix is used to ensure the input covariance matrix is positive semidefinite. The result is a potentially sparse precision matrix that is resilient to moderate levels of cellwise contamination. Since this procedure is not based on subsampling it scales well as the number of variables increases.
KW - Precision matrix
KW - Covariance matrix
KW - Robust estimation
KW - Data mining
UR - http://www.scopus.com/inward/record.url?scp=84944152809&partnerID=8YFLogxK
UR - http://http:/http://purl.org/au-research/grants/arc/DP140101259
U2 - 10.1016/j.csda.2015.02.005
DO - 10.1016/j.csda.2015.02.005
M3 - Article
AN - SCOPUS:84944152809
SN - 0167-9473
VL - 93
SP - 404
EP - 420
JO - Computational Statistics and Data Analysis
JF - Computational Statistics and Data Analysis
ER -