Approximate Joint Diagonalization with Riemannian Optimization on the General Linear Group

Type: Article

Publication Date: 2020-01-01

Citations: 11

DOI: https://doi.org/10.1137/18m1232838

Abstract

We consider the classical problem of approximate joint diagonalization of matrices, which can be cast as an optimization problem on the general linear group. We propose a versatile Riemannian optimization framework for solving this problem---unifiying existing methods and creating new ones. We use two standard Riemannian metrics (left- and right-invariant metrics) having opposite features regarding the structure of solutions and the model. We introduce the Riemannian optimization tools (gradient, retraction, vector transport) in this context, for the two standard nondegeneracy constraints (oblique and nonholonomic constraints). We also develop tools beyond the classical Riemannian optimization framework to handle the non-Riemannian quotient manifold induced by the nonholonomic constraint with the right-invariant metric. We illustrate our theoretical developments with numerical experiments on both simulated data and a real electroencephalographic recording.

Locations

  • SIAM Journal on Matrix Analysis and Applications - View
  • HAL (Le Centre pour la Communication Scientifique Directe) - View - PDF

Similar Works

Action Title Year Authors
+ Riemannian Optimization via Frank-Wolfe Methods 2017 Melanie Weber
Suvrit Sra
+ PDF Chat Riemannian geometry and optimization for approximate joint diagonalization : application to source separation of electroencephalograms 2018 Florent Bouchard
+ Riemannian Newton's method for joint diagonalization on the Stiefel manifold with application to ICA 2014 Hiroyuki Sato
+ Low-rank matrix completion by Riemannian optimization---extended version 2012 Bart Vandereycken
+ Convergence of Gradient-Based Block Coordinate Descent Algorithms for Nonorthogonal Joint Approximate Diagonalization of Matrices 2023 Jianze Li
Konstantin Usevich
Pierre Comon
+ Convergence of gradient-based block coordinate descent algorithms for non-orthogonal joint approximate diagonalization of matrices 2020 Jianze Li
Konstantin Usevich
Pierre Comon
+ PDF Chat Gradient based block coordinate descent algorithms for joint approximate diagonalization of matrices 2020 Jianze Li
Konstantin Usevich
Pierre Comon
+ Low-Rank Matrix Completion by Riemannian Optimization 2013 Bart Vandereycken
+ A Riemannian BFGS Method Without Differentiated Retraction for Nonconvex Optimization Problems 2018 Wen Huang
Pierre-Antoine Absil
Kyle A. Gallivan
+ Riemannian Optimization for Solving High-Dimensional Problems with Low-Rank Tensor Structure 2016 Michael Steinlechner
+ Vector-wise Joint Diagonalization of Almost Commuting Matrices 2022 Bowen Li
Jianfeng Lu
Ziang Yu
+ PDF Chat Riemannian Optimization for Non-convex Euclidean Distance Geometry with Global Recovery Guarantees 2024 Chandler Smith
HanQin Cai
Abiy Tasissa
+ A Riemannian BFGS Method for Nonconvex Optimization Problems 2016 Wen Huang
Pierre-Antoine Absil
Kyle A. Gallivan
+ Computing the matrix geometric mean: Riemannian versus Euclidean conditioning, implementation techniques, and a Riemannian BFGS method 2020 Xinru Yuan
Wen Huang
Pierre-Antoine Absil
Kyle A. Gallivan
+ PDF Chat Riemannian Optimization via Frank-Wolfe Methods 2022 Melanie Weber
Suvrit Sra
+ An accelerated hybrid Riemannian conjugate gradient method for unconstrained optimization 2024 Jinchao Zhang
Wei Zhu
Wei Wang
Zhaochong Wu
Xiaojun Zhang
+ Vector Transport Free Riemannian LBFGS for Optimization on Symmetric Positive Definite Matrix Manifolds 2021 Reza Godaz
Benyamin Ghojogh
Reshad Hosseini
Reza Monsefi
Fakhri Karray
Mark Crowley
+ PDF Chat Geometry of matrix decompositions seen through optimal transport and information geometry 2017 Klas Modin
+ PDF Chat Riemannian Preconditioning 2016 Bamdev Mishra
Rodolphe Sepulchre
+ Vector Transport Free Riemannian LBFGS for Optimization on Symmetric Positive Definite Matrix Manifolds. 2021 Reza Godaz
Benyamin Ghojogh
Reshad Hosseini
Reza Monsefi
Fakhri Karray
Mark Crowley