Paper ID sheet UCL-INMA-2008.013

Title

A geometric Newton method for Oja's vector field

Authors
P.-A. Absil, M. Ishteva, L. De Lathauwer, S. Van Huffel
Abstract
Newton's method for solving the matrix equation $F(X)\equiv AX-XX^TAX=0$ runs up against the fact that its zeros are not isolated. This is due to a symmetry of $F$ by the action of the orthogonal group. We show how differential-geometric techniques can be exploited to remove this symmetry and obtain a ``geometric'' Newton algorithm that finds the zeros of $F$. The geometric Newton method does not suffer from the degeneracy issue that stands in the way of the original Newton method.
Key words
Oja's learning equation; Oja's flow; differential-geometric optimization; Riemannian optimization; quotient manifold; neural networks
Status
Neural Computation, Vol. 21, No. 5, Pages 1415-1433, May 2009
Download
BibTeX entry

@ARTICLE{AbsIshLatHuf2009,
  author = "P.-A. Absil and M. Ishteva and L. De Lathauwer and S. Van Huffel",
  title = "A geometric {Newton} method for {Oja}'s vector field",
  journal = "Neural Comput.",
  fjournal = "Neural Computation",
  year = 2009,
  month = "May",
  volume = 21,
  number = 5,
  pages = "1415--1433",
}
  
[Home]