Errata (and improvements) for Optimization Algorithms on Matrix Manifolds

If you find an error that is not in the list below, please let us know about it.

P.-A. Absil, R. Mahony, & R. Sepulchre

• On page 8, replace the 2nd and 3rd sentences by this: "In view of the properties of matrix trace and inversion, one has the invariance property that $f(YN)=f(Y)$ for all invertible $p\times p$ matrices $N$. Each equivalence class $\{YN:N\in {\mathbb{R}}^{p\times p}\text{ invertible}\}$, which gathers all the $n\times p$ matrices with the same column space as $Y$, contains matrices $YN$ such that $(YN{)}^{T}BYN=I_p$. (Take $N=(Y^{T}BY{)}^{-1/2}$.) Thus, without loss of generality, we can restrict the search space to matrices $Y$ such that $Y^{T}BY=I_p$. Moreover, since $V$ is invertible, we can set $Y=VM$. Since $V^{T}BV=I_p$, the condition $Y^{T}BY=I_p$ is equivalent to $M^{T}M=I_p$."
• page 25, Proposition 3.3.2: the symbol "$x$" is used to mean two different things. To fix this, replace, e.g., "$x$" by "$\overline{x}$" in the 3rd line of the proposition.
• page 34, line -11: also require that $\phi (x)=0$.
• page 43, line 15: "$T_{\bar{x}}\mathcal{M}$" should be "$T_{\bar{x}}\bar{\mathcal{M}}$".
• page 48, line -3 (last displayed equation of the page): delete the first "$T_{\bar{x}}$".
• page 48, line -1: insert "$={\xi }_x$" after "$\mathrm{D}\pi (\overline{x})[{\overline{\xi }}_{\overline{x}}]$".
• page 59, two lines below (4.8): replace "$n\times p$" by "$p\times p$".
• page 62, Definition 4.2.1: insert "to $\{x_k\}$" after "gradient-related".
  
• pages 62-63: in Algorithm 1, without further assumptions, $t_k^A$ may not exist. In that case, Algorithm 1 produces a finite sequence. This situation is explicitly dismissed in subsequent results that assume an infinite sequence of iterates. Nevertheless, in a practical implementation of Algorithm 1, care must be taken to ensure that the inner iteration that computes $t_k^A$ terminates. This can be done as follows. In Definition 4.2.2 (Armijo point), insert the assumption that "$\eta$ is a descent direction (i.e., $⟨\mathrm{grad}f(x),\eta {⟩}_x<0$)". In Algorithm 1, as first line in the for loop, insert: "0: If $\mathrm{grad}f(x_k)=0$ then Break." Still in Algorithm 1, replace line "2:" by this: "2: Pick ${\eta }_k$ in $T_{x_k}\mathcal{M}$ by a procedure guaranteeing that (i) $⟨\mathrm{grad}f(x_k),{\eta }_k⟩<0$ and (ii) if the sequence ${\left\{{\eta }_i\right\}}_{i=0,1,\dots }$ is infinite (i.e., the above Break is never reached) then it is gradient-related to $\{x_k\}$ (Definition 4.2.1). (Note that ${\eta }_k:=-\mathrm{grad}f(x_k)$ is such a procedure.)"
  
• page 64: In the proof of Theorem 4.3.1, ${\alpha }_k$ denotes the Armijo step size $t_k^A$ computed in Algorithm 1.
  
• page 64, line -6: insert "in $\mathcal{K}$" after "for all $k$".
  
• page 65: the "$t$" that appears in (4.15) and on the line above depends on $k$, hence "$t_k$" is a better notation.
  
• page 68, line 13: "$\delta >0$" should be "$\delta \in (0,ϵ)$".
• page 75, table 4.1: the normal space to ${\mathbb{R}}^n$ should rather be $\{0\}$ (seeing ${\mathbb{R}}^n$ as its own embedding space).
• page 80, line 4: "(local)" can be deleted.
• page 80, line below (4.32): replace all "$\le$" signs by "$<$".
• page 86, Algorithm 3, step 2: "$Y^T$" is missing in $-Y(Y^{T}Y{)}^{-1}{Y}^{T}AY$.
• page 92, first line below Figure 5.1: replace "${\mathbb{R}}^n\to {\mathbb{R}}^n$" by "$\mathbb{R}\to \mathbb{R}$".
• page 108, line 5: replace "$T_x\mathcal{M}$" by "$T_v\mathcal{M}$"
• page 119, line 9: delete the factor "$2$" in the first equation.
• page 123, line -6: "$\mathrm{span}(V)$" should be "the orthogonal complement of $\mathrm{span}(V)$".
• page 124, two lines below (6.35): insert "$=0$" after "$Y_k^T{B}_k{Z}_k$".
• page 130, (6.46): on the right-hand side of the equation, replace "$y$" by "$x$".
• page 143, section 7.3.2, second paragraph, 4th line: insert a minus sign, yielding ${\eta }_k^N=-(H_k{)}^{-1}\mathrm{grad}f(x_k)$.
• page 144, Algorithm 10, lines 4, 9, 10: replace "$\mathrm{\Delta }$" (but not "$\delta$") by "${\mathrm{\Delta }}_k$".
• page 147, line 6: replace "$=$" by "$\le$".
• page 148, line -8: definition of $i_x$: remove "for all $x\in \mathcal{M}$".
• page 150, line 4: replace "$B_k$" by "$H_k$".
• page 152, line -2: replace "minimizing geodesic" by "geodesic in $\mathcal{V}$".
• page 153, second line of the proof of Lemma 7.4.8: replace "$\mathrm{grad}f(v)$" by "$\mathrm{grad}f(x)$".
• page 154, first line of the proof of Lemma 7.4.10: insert "$\setminus \{v\}$" at the end of the sentence.
• page 164, Algorithm 12, lines 4, 9, and 10: replace $\mathrm{\Delta }$ by ${\mathrm{\Delta }}^2$, and replace the Frobenius metric by the nonstandard metric (7.55), i.e., insert $(Y^{T}BY{)}^{-1}$ in the trace.
• page 171, equation (8.4): replace $x^T(0)$ by $u^T$ (in the middle term).
• page 174, section 8.1.3: replace the two occurences of $\mathcal{N}$ by $\mathcal{M}$.
• page 174: second displayed equation: replace the subscript $R_{\mathcal{Y}}(\eta )$ in the left-hand side by $Y+{\bar{\eta }}_Y$.
• page 174: at the end of the page, add: provided that the right-hand side is a bona-fide horizontal lift. Since horizontality is guaranteed by construction, it remains to require that $\mathrm{D}\pi (\overline{x}+{\overline{\eta }}_{\overline{x}})[{\mathrm{P}}_{\overline{x}+{\overline{\eta }}_{\overline{x}}}^h{\overline{\xi }}_{\overline{x}}]$ does not depend on the choice of $\overline{x}$ in the fiber ${\pi }^{-1}(x)$. Equivalently stated, for all real-valued functions $f$ on the quotient manifold, $\frac{\mathrm{d}}{\mathrm{d}t}f(\overline{x}+{\overline{\eta }}_{\overline{x}}+t{\mathrm{P}}_{\overline{x}+{\overline{\eta }}_{\overline{x}}}^h{\overline{\xi }}_{\overline{x}}){|}_{t=0}$ must not depend on the choice of $\overline{x}$ in the fiber ${\pi }^{-1}(x)$.
• page 179, line -15: "for all $p$" should be "for all $\eta$".
• page 181, line 6: remove the minus sign in the formula of ${\alpha }_k$. (Observe that $r_k$ is defined as $b-A{x}_k$.)
• page 185, line -8: replace "$⟨\xi ,(DF(x){)}^{\ast }[F(x)]⟩$" by "$g(\xi ,(DF(x){)}^{\ast }[F(x)])$".
• page 196, line -4: $\mathrm{D}\mathrm{qf}(X)[Z]=Q{\rho }_{\mathrm{skew}}(Q^{T}Z{R}^{-1})+(I-Q{Q}^T)Z{R}^{-1}$.