Projection-like Retractions on Matrix Manifolds

Type: Article

Publication Date: 2012-01-01

Citations: 281

DOI: https://doi.org/10.1137/100802529

Abstract

This paper deals with constructing retractions, a key step when applying optimization algorithms on matrix manifolds. For submanifolds of Euclidean spaces, we show that the operation consisting of taking a tangent step in the embedding Euclidean space followed by a projection onto the submanifold is a retraction. We also show that the operation remains a retraction if the projection is generalized to a projection-like procedure that consists of coming back to the submanifold along “admissible” directions, and we give a sufficient condition on the admissible directions for the generated retraction to be second order. This theory offers a framework in which previously proposed retractions can be analyzed, as well as a toolbox for constructing new ones. Illustrations are given for projection-like procedures on some specific manifolds for which we have an explicit, easy-to-compute expression.

Locations

  • HAL (Le Centre pour la Communication Scientifique Directe) - View - PDF
  • SIAM Journal on Optimization - View

Similar Works

Action Title Year Authors
+ PDF Chat Low-rank retractions: a survey and new results 2014 Pierre-Antoine Absil
Ivan Oseledets
+ PDF Chat Fast and accurate optimization on the orthogonal manifold without retraction 2022 Pierre Ablin
Gabriel Peyré
+ PDF Chat Retractions on closed sets 2024 Guillaume Olikier
+ Newton retraction as approximate geodesics on submanifolds 2020 Ruda Zhang
+ Fast and accurate optimization on the orthogonal manifold without retraction 2021 Pierre Ablin
Gabriel Peyré
+ Optimization on the biorthogonal manifold 2016 Klaus Glashoff
Michael M. Bronstein
+ First-order optimization algorithms 2023
+ Determining step sizes in geometric optimization algorithms 2015 Zhizhong Li
Deli Zhao
Zhouchen Lin
Edward Yi Chang
+ PDF Chat Convergence analysis of the transformed gradient projection algorithms on compact matrix manifolds 2024 Wentao Ding
Jianze Li
Shuzhong Zhang
+ Computing Euclidean distance and maximum likelihood retraction maps for constrained optimization 2022 Alexander Heaton
Matthias Himmelmann
+ Unconstrained Optimization on Riemannian Manifolds 2021 Hiroyuki Sato
+ Optimization on the symplectic Stiefel manifold: SR decomposition-based retraction and applications 2022 Bin Gao
Nguyen Thanh Son
Tatjana Stykel
+ Optimization Algorithms on Matrix Manifolds 2007 P.-A. Absil
Robert Mahony
Rodolphe Sepulchre
+ PDF Chat Optimization on the symplectic Stiefel manifold: SR decomposition-based retraction and applications 2023 Bin Gao
Nguyen Thanh Son
Tatjana Stykel
+ Low-rank matrix completion by Riemannian optimization---extended version 2012 Bart Vandereycken
+ Low-Rank Matrix Completion by Riemannian Optimization 2013 Bart Vandereycken
+ From low-rank retractions to dynamical low-rank approximation and back 2023 Axel Séguin
Gianluca Ceruti
Daniel Kreßner
+ Constrained Optimization on Manifolds 2020 Julián Ortiz
+ PDF Chat From low-rank retractions to dynamical low-rank approximation and back 2024 Axel Séguin
Gianluca Ceruti
Daniel Kreßner
+ Quotient manifolds 2023