Paper ID sheet UCL-INMA-2009.026

Title

Best low multilinear rank approximation of higher-order tensors, based on the Riemannian trust-region scheme

Authors
Mariya Ishteva, P.-A. Absil, Sabine Van Huffel, Lieven De Lathauwer
Abstract
Higher-order tensors are used in many application fields, such as statistics, signal processing, and scientific computing. Efficient and reliable algorithms for manipulating these multi-way arrays are thus required. In this paper, we focus on the best rank-$(R_1, R_2, R_3)$ approximation of third-order tensors. We propose a new iterative algorithm based on the trust-region scheme. The tensor approximation problem is expressed as a minimization of a cost function on a product of three Grassmann manifolds. We apply the Riemannian trust-region scheme, using the truncated conjugate-gradient method for solving the trust-region subproblem. Making use of second order information of the cost function, superlinear convergence is achieved. If the stopping criterion of the subproblem is chosen adequately, the local convergence rate is quadratic. We compare this new method with the well-known higher-order orthogonal iteration method and discuss the advantages over Newton-type methods.
Key words
multilinear algebra; higher-order tensor; rank reduction; singular value decomposition; trust-region scheme; Riemannian manifold; Grassmann manifold
Status
SIAM Journal on Matrix Analysis and Applications, Vol. 32, Iss. 1 (2011)
Download
[Home]