Complementary time‐frequency domain networks for dynamic parallel MR image reconstruction

Type: Article

Publication Date: 2021-07-13

Citations: 33

DOI: https://doi.org/10.1002/mrm.28917

Abstract

Purpose To introduce a novel deep learning‐based approach for fast and high‐quality dynamic multicoil MR reconstruction by learning a complementary time‐frequency domain network that exploits spatiotemporal correlations simultaneously from complementary domains. Theory and Methods Dynamic parallel MR image reconstruction is formulated as a multivariable minimization problem, where the data are regularized in combined temporal Fourier and spatial ( x ‐ f ) domain as well as in spatiotemporal image ( x ‐ t ) domain. An iterative algorithm based on variable splitting technique is derived, which alternates among signal de‐aliasing steps in x ‐ f and x ‐ t spaces, a closed‐form point‐wise data consistency step and a weighted coupling step. The iterative model is embedded into a deep recurrent neural network which learns to recover the image via exploiting spatiotemporal redundancies in complementary domains. Results Experiments were performed on two datasets of highly undersampled multicoil short‐axis cardiac cine MRI scans. Results demonstrate that our proposed method outperforms the current state‐of‐the‐art approaches both quantitatively and qualitatively. The proposed model can also generalize well to data acquired from a different scanner and data with pathologies that were not seen in the training set. Conclusion The work shows the benefit of reconstructing dynamic parallel MRI in complementary time‐frequency domains with deep neural networks. The method can effectively and robustly reconstruct high‐quality images from highly undersampled dynamic multicoil data ( and yielding 15 s and 10 s scan times respectively) with fast reconstruction speed (2.8 seconds). This could potentially facilitate achieving fast single‐breath‐hold clinical 2D cardiac cine imaging.

Locations

  • Magnetic Resonance in Medicine - View
  • arXiv (Cornell University) - View - PDF
  • University of Birmingham Research Portal (University of Birmingham) - View - PDF
  • PubMed - View

Similar Works

Action Title Year Authors
+ Complementary Time-Frequency Domain Networks for Dynamic Parallel MR Image Reconstruction 2020 Chen Qin
Jinming Duan
Kerstin Hammernik
Jo Schlemper
Thomas Küstner
René M. Botnar
Claudia Prieto
Anthony N. Price
Joseph V. Hajnal
Daniel Rueckert
+ Holistic Multi-Slice Framework for Dynamic Simultaneous Multi-Slice MRI Reconstruction 2023 Daniel H. Pak
Xiaohong Chen
Eric Z. Chen
Yikang Liu
Terrence Chen
Shanhui Sun
+ PDF Chat Joint Frequency and Image Space Learning for MRI Reconstruction and Analysis 2022 Nalini Singh
Juan Eugenio Iglesias
Elfar Adalsteinsson
Adrian V. Dalca
Polina Golland
+ Joint Frequency and Image Space Learning for MRI Reconstruction and Analysis 2020 Nalini Singh
Juan Eugenio Iglesias
Elfar Adalsteinsson
Adrian V. Dalca
Polina Golland
+ k-t NEXT: Dynamic MR Image Reconstruction Exploiting Spatio-temporal Correlations 2019 Chen Qin
Jo Schlemper
Jinming Duan
Gavin Seegoolam
Anthony N. Price
Joseph V. Hajnal
Daniel Rueckert
+ A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstruction 2017 Jo Schlemper
José Caballero
Joseph V. Hajnal
Anthony N. Price
Daniel Rueckert
+ Dual-Domain Multi-Contrast MRI Reconstruction with Synthesis-based Fusion Network 2023 Junwei Yang
Píetro Lió
+ A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstruction 2017 Jo Schlemper
José Caballero
Joseph V. Hajnal
Anthony N. Price
Daniel Rueckert
+ DIMENSION: Dynamic MR Imaging with Both K-space and Spatial Prior Knowledge Obtained via Multi-Supervised Network Training 2018 Shanshan Wang
Ziwen Ke
Huitao Cheng
Sen Jia
Ying Leslie
Hairong Zheng
Dong Liang
+ PDF Chat DIMENSION: Dynamic MR imaging with both k‐space and spatial prior knowledge obtained via multi‐supervised network training 2019 Shanshan Wang
Ziwen Ke
Huitao Cheng
Sen Jia
Leslie Ying
Hairong Zheng
Dong Liang
+ PDF Chat 3D cine-magnetic resonance imaging using spatial and temporal implicit neural representation learning (STINR-MR) 2024 Hua‐Chieh Shao
Tielige Mengke
Jie Deng
You Zhang
+ DuDoRNet: Learning a Dual-Domain Recurrent Network for Fast MRI Reconstruction with Deep T1 Prior 2020 Bo Zhou
S. Kevin Zhou
+ PDF Chat DuDoRNet: Learning a Dual-Domain Recurrent Network for Fast MRI Reconstruction With Deep T1 Prior 2020 Bo Zhou
S. Kevin Zhou
+ $k$-$t$ CLAIR: Self-Consistency Guided Multi-Prior Learning for Dynamic Parallel MR Image Reconstruction 2023 Liping Zhang
Weitian Chen
+ Model-based Convolutional De-Aliasing Network Learning for Parallel MR Imaging 2019 Yanxia Chen
Taohui Xiao
Cheng Li
Qiegen Liu
Shanshan Wang
+ DONet: Dual-Octave Network for Fast MR Image Reconstruction 2021 Chun-Mei Feng
Zhanyuan Yang
Huazhu Fu
Yong Xu
Jian Yang
Ling Shao
+ PDF Chat Convolutional Recurrent Neural Networks for Dynamic MR Image Reconstruction 2018 Chen Qin
Jo Schlemper
José Caballero
Anthony N. Price
Joseph V. Hajnal
Daniel Rueckert
+ PDF Chat Domain-conditioned and Temporal-guided Diffusion Modeling for Accelerated Dynamic MRI Reconstruction 2025 Liping Zhang
Iris Y. Zhou
Sydney B. Montesi
Feng Li
Fang Liu
+ PDF Chat DONet: Dual-Octave Network for Fast MR Image Reconstruction 2021 Chun-Mei Feng
Zhanyuan Yang
Huazhu Fu
Yong Xu
Jian Yang
Ling Shao
+ Spatiotemporal implicit neural representation for unsupervised dynamic MRI reconstruction 2023 Jie Feng
Ruimin Feng
Qing Wu
Zhiyong Zhang
Yuyao Zhang
Hongjiang Wei

Works Cited by This (16)

Action Title Year Authors
+ The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance 1937 Milton Friedman
+ A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstruction 2017 Jo Schlemper
José Caballero
Joseph V. Hajnal
Anthony N. Price
Daniel Rueckert
+ Learning a variational network for reconstruction of accelerated MRI data 2017 Kerstin Hammernik
Teresa Klatzer
Erich Kobler
Michael P. Recht
Daniel K. Sodickson
Thomas Pock
Florian Knöll
+ PDF Chat Deep Convolutional Framelets: A General Deep Learning Framework for Inverse Problems 2018 Jong Chul Ye
Yoseob Han
Eunju Cha
+ PDF Chat MR Image Reconstruction Using Deep Density Priors 2018 Kerem Can Tezcan
Christian F. Baumgartner
Roger Luechinger
Klaas P. Pruessmann
Ender Konukoğlu
+ PDF Chat Real‐time cardiovascular MR with spatio‐temporal artifact suppression using deep learning–proof of concept in congenital heart disease 2018 Andreas Hauptmann
Simon Arridge
Felix Lucka
Vivek Muthurangu
Jennifer A. Steeden
+ PDF Chat Convolutional Recurrent Neural Networks for Dynamic MR Image Reconstruction 2018 Chen Qin
Jo Schlemper
José Caballero
Anthony N. Price
Joseph V. Hajnal
Daniel Rueckert
+ PDF Chat ${k}$ -Space Deep Learning for Accelerated MRI 2019 Yoseob Han
Leonard Sunwoo
Jong Chul Ye
+ PDF Chat DIMENSION: Dynamic MR imaging with both k‐space and spatial prior knowledge obtained via multi‐supervised network training 2019 Shanshan Wang
Ziwen Ke
Huitao Cheng
Sen Jia
Leslie Ying
Hairong Zheng
Dong Liang
+ Data consistency networks for (calibration-less) accelerated parallel MR image reconstruction. 2019 Jo Schlemper
Jinming Duan
Cheng Ouyang
Chen Qin
José Caballero
Joseph V. Hajnal
Daniel Rueckert