Paper ID sheet UCL-INMA-2022.01

Title

An apocalypse-free first-order low-rank optimization algorithm

Authors
Guillaume Olikier, Kyle A. Gallivan, P.-A. Absil
Abstract
We consider the problem of minimizing a differentiable function with locally Lipschitz continuous gradient on the real determinantal variety, and present a first-order algorithm designed to find stationary points of that problem. This algorithm applies steps of steepest descent with backtracking line search on the variety, as proposed by Schneider and Uschmajew (2015), but by taking the numerical rank into account to perform suitable rank reductions. We prove that this algorithm produces sequences of iterates the accumulation points of which are stationary, and therefore does not follow the so-called apocalypses described by Levin, Kileel, and Boumal (2021).
Key words
Convergence analysis; Stationarity; Low-rank optimization; Determinantal variety; Steepest descent; Tangent cones
Status
Submitted
Download
Errata
Errata for the proof of Proposition 5.1 of arXiv:2201.03962v1
[Home]