-
Autoregressive Image Diffusion: Generation of Image Sequence and Application in MRI
Authors:
Guanxiong Luo,
Shoujin Huang,
Martin Uecker
Abstract:
Magnetic resonance imaging (MRI) is a widely used non-invasive imaging modality. However, a persistent challenge lies in balancing image quality with imaging speed. This trade-off is primarily constrained by k-space measurements, which traverse specific trajectories in the spatial Fourier domain (k-space). These measurements are often undersampled to shorten acquisition times, resulting in image a…
▽ More
Magnetic resonance imaging (MRI) is a widely used non-invasive imaging modality. However, a persistent challenge lies in balancing image quality with imaging speed. This trade-off is primarily constrained by k-space measurements, which traverse specific trajectories in the spatial Fourier domain (k-space). These measurements are often undersampled to shorten acquisition times, resulting in image artifacts and compromised quality. Generative models learn image distributions and can be used to reconstruct high-quality images from undersampled k-space data. In this work, we present the autoregressive image diffusion (AID) model for image sequences and use it to sample the posterior for accelerated MRI reconstruction. The algorithm incorporates both undersampled k-space and pre-existing information. Models trained with fastMRI dataset are evaluated comprehensively. The results show that the AID model can robustly generate sequentially coherent image sequences. In MRI applications, the AID can outperform the standard diffusion model and reduce hallucinations, due to the learned inter-image dependencies. The project code is available at https://github.com/mrirecon/aid.
△ Less
Submitted 7 October, 2024; v1 submitted 23 May, 2024;
originally announced May 2024.
-
Self-Supervised Learning for Improved Calibrationless Radial MRI with NLINV-Net
Authors:
Moritz Blumenthal,
Chiara Fantinato,
Christina Unterberg-Buchwald,
Markus Haltmeier,
Xiaoqing Wang,
Martin Uecker
Abstract:
Purpose: To develop a neural network architecture for improved calibrationless reconstruction of radial data when no ground truth is available for training. Methods: NLINV-Net is a model-based neural network architecture that directly estimates images and coil sensitivities from (radial) k-space data via non-linear inversion (NLINV). Combined with a training strategy using self-supervision via dat…
▽ More
Purpose: To develop a neural network architecture for improved calibrationless reconstruction of radial data when no ground truth is available for training. Methods: NLINV-Net is a model-based neural network architecture that directly estimates images and coil sensitivities from (radial) k-space data via non-linear inversion (NLINV). Combined with a training strategy using self-supervision via data undersampling (SSDU), it can be used for imaging problems where no ground truth reconstructions are available. We validated the method for (1) real-time cardiac imaging and (2) single-shot subspace-based quantitative T1 mapping. Furthermore, region-optimized virtual (ROVir) coils were used to suppress artifacts stemming from outside the FoV and to focus the k-space based SSDU loss on the region of interest. NLINV-Net based reconstructions were compared with conventional NLINV and PI-CS (parallel imaging + compressed sensing) reconstruction and the effect of the region-optimized virtual coils and the type of training loss was evaluated qualitatively. Results: NLINV-Net based reconstructions contain significantly less noise than the NLINV-based counterpart. ROVir coils effectively suppress streakings which are not suppressed by the neural networks while the ROVir-based focussed loss leads to visually sharper time series for the movement of the myocardial wall in cardiac real-time imaging. For quantitative imaging, T1-maps reconstructed using NLINV-Net show similar quality as PI-CS reconstructions, but NLINV-Net does not require slice-specific tuning of the regularization parameter. Conclusion: NLINV-Net is a versatile tool for calibrationless imaging which can be used in challenging imaging scenarios where a ground truth is not available.
△ Less
Submitted 11 July, 2024; v1 submitted 9 February, 2024;
originally announced February 2024.
-
Assessment of Deep Learning Segmentation for Real-Time Free-Breathing Cardiac Magnetic Resonance Imaging at Rest and Under Exercise Stress
Authors:
Martin Schilling,
Christina Unterberg-Buchwald,
Joachim Lotz,
Martin Uecker
Abstract:
In recent years, a variety of deep learning networks for cardiac MRI (CMR) segmentation have been developed and analyzed. However, nearly all of them are focused on cine CMR under breathold. In this work, accuracy of deep learning methods is assessed for volumetric analysis (via segmentation) of the left ventricle in real-time free-breathing CMR at rest and under exercise stress. Data from healthy…
▽ More
In recent years, a variety of deep learning networks for cardiac MRI (CMR) segmentation have been developed and analyzed. However, nearly all of them are focused on cine CMR under breathold. In this work, accuracy of deep learning methods is assessed for volumetric analysis (via segmentation) of the left ventricle in real-time free-breathing CMR at rest and under exercise stress. Data from healthy volunteers (n=15) for cine and real-time free-breathing CMR at rest and under exercise stress were analyzed retrospectively. Segmentations of a commercial software (comDL) and a freely available neural network (nnU-Net), were compared to a reference created via the manual correction of comDL segmentation. Segmentation of left ventricular endocardium (LV), left ventricular myocardium (MYO), and right ventricle (RV) is evaluated for both end-systolic and end-diastolic phases and analyzed with Dice's coefficient (DC). The volumetric analysis includes LV end-diastolic volume (EDV), LV end-systolic volume (ESV), and LV ejection fraction (EF). For cine CMR, nnU-Net and comDL achieve a DC above 0.95 for LV and 0.9 for MYO, and RV. For real-time CMR, the accuracy of nnU-Net exceeds that of comDL overall. For real-time CMR at rest, nnU-Net achieves a DC of 0.94 for LV, 0.89 for MYO, and 0.90 for RV; mean absolute differences between nnU-Net and reference are 2.9mL for EDV, 3.5mL for ESV and 2.6% for EF. For real-time CMR under exercise stress, nnU-Net achieves a DC of 0.92 for LV, 0.85 for MYO, and 0.83 for RV; mean absolute differences between nnU-Net and reference are 11.4mL for EDV, 2.9mL for ESV and 3.6% for EF. Deep learning methods designed or trained for cine CMR segmentation can perform well on real-time CMR. For real-time free-breathing CMR at rest, the performance of deep learning methods is comparable to inter-observer variability in cine CMR and is usable or fully automatic segmentation.
△ Less
Submitted 9 February, 2024; v1 submitted 23 November, 2023;
originally announced November 2023.
-
Generative Image Priors for MRI Reconstruction Trained from Magnitude-Only Images
Authors:
Guanxiong Luo,
Xiaoqing Wang,
Mortiz Blumenthal,
Martin Schilling,
Erik Hans Ulrich Rauf,
Raviteja Kotikalapudi,
Niels Focke,
Martin Uecker
Abstract:
Purpose: In this work, we present a workflow to construct generic and robust generative image priors from magnitude-only images. The priors can then be used for regularization in reconstruction to improve image quality. Methods: The workflow begins with the preparation of training datasets from magnitude-only MR images. This dataset is then augmented with phase information and used to train genera…
▽ More
Purpose: In this work, we present a workflow to construct generic and robust generative image priors from magnitude-only images. The priors can then be used for regularization in reconstruction to improve image quality. Methods: The workflow begins with the preparation of training datasets from magnitude-only MR images. This dataset is then augmented with phase information and used to train generative priors of complex images. Finally, trained priors are evaluated using both linear and nonlinear reconstruction for compressed sensing parallel imaging with various undersampling schemes. Results: The results of our experiments demonstrate that priors trained on complex images outperform priors trained only on magnitude images. Additionally, a prior trained on a larger dataset exhibits higher robustness. Finally, we show that the generative priors are superior to L1 -wavelet regularization for compressed sensing parallel imaging with high undersampling. Conclusion: These findings stress the importance of incorporating phase information and leveraging large datasets to raise the performance and reliability of the generative priors for MRI reconstruction. Phase augmentation makes it possible to use existing image databases for training.
△ Less
Submitted 4 August, 2023;
originally announced August 2023.
-
Deep, Deep Learning with BART
Authors:
Moritz Blumenthal,
Guanxiong Luo,
Martin Schilling,
H. Christian M. Holme,
Martin Uecker
Abstract:
Purpose: To develop a deep-learning-based image reconstruction framework for reproducible research in MRI.
Methods: The BART toolbox offers a rich set of implementations of calibration and reconstruction algorithms for parallel imaging and compressed sensing. In this work, BART was extended by a non-linear operator framework that provides automatic differentiation to allow computation of gradien…
▽ More
Purpose: To develop a deep-learning-based image reconstruction framework for reproducible research in MRI.
Methods: The BART toolbox offers a rich set of implementations of calibration and reconstruction algorithms for parallel imaging and compressed sensing. In this work, BART was extended by a non-linear operator framework that provides automatic differentiation to allow computation of gradients. Existing MRI-specific operators of BART, such as the non-uniform fast Fourier transform, are directly integrated into this framework and are complemented by common building blocks used in neural networks. To evaluate the use of the framework for advanced deep-learning-based reconstruction, two state-of-the-art unrolled reconstruction networks, namely the Variational Network [1] and MoDL [2], were implemented.
Results: State-of-the-art deep image-reconstruction networks can be constructed and trained using BART's gradient based optimization algorithms. The BART implementation achieves a similar performance in terms of training time and reconstruction quality compared to the original implementations based on TensorFlow.
Conclusion: By integrating non-linear operators and neural networks into BART, we provide a general framework for deep-learning-based reconstruction in MRI.
△ Less
Submitted 23 September, 2022; v1 submitted 28 February, 2022;
originally announced February 2022.
-
Free-Breathing Liver Fat, $R_2^*$ and $B_0$ Field Mapping Using Multi-Echo Radial FLASH and Regularized Model-based Reconstruction
Authors:
Zhengguo Tan,
Christina Unterberg-Buchwald,
Moritz Blumenthal,
Nick Scholand,
Philip Schaten,
Christian Holme,
Xiaoqing Wang,
Dirk Raddatz,
Martin Uecker
Abstract:
This work introduced a stack-of-radial multi-echo asymmetric-echo MRI sequence for free-breathing liver volumetric acquisition. Regularized model-based reconstruction was implemented in Berkeley Advanced Reconstruction Toolbox (BART) to jointly estimate all physical parameter maps (water, fat, R2*, and B0 field inhomogeneity maps) and coil sensitivity maps from self-gated k-space data. Specificall…
▽ More
This work introduced a stack-of-radial multi-echo asymmetric-echo MRI sequence for free-breathing liver volumetric acquisition. Regularized model-based reconstruction was implemented in Berkeley Advanced Reconstruction Toolbox (BART) to jointly estimate all physical parameter maps (water, fat, R2*, and B0 field inhomogeneity maps) and coil sensitivity maps from self-gated k-space data. Specifically, locally low rank and temporal total variation regularization were employed directly on physical parameter maps. The proposed free-breathing radial technique was tested on a water/fat & iron phantom, a young volunteer, and obesity/diabetes/hepatic steatosis patients. Quantitative fat fraction and R2* accuracy were confirmed by comparing our technique with the reference breath-hold Cartesian scan. The multi-echo radial sampling sequence achieves fast k-space coverage and is robust to motion. Moreover, the proposed motion-resolved model-based reconstruction allows for free-breathing liver fat and R2* quantification in multiple motion states. Overall, our proposed technique offers a convenient tool for non-invasive liver assessment with no breath holding requirement.
△ Less
Submitted 25 November, 2022; v1 submitted 7 January, 2021;
originally announced January 2021.
-
Physics-based Reconstruction Methods for Magnetic Resonance Imaging
Authors:
Xiaoqing Wang,
Zhengguo Tan,
Nick Scholand,
Volkert Roeloffs,
Martin Uecker
Abstract:
Conventional Magnetic Resonance Imaging (MRI) is hampered by long scan times and only qualitative image contrasts that prohibit a direct comparison between different systems. To address these limitations, model-based reconstructions explicitly model the physical laws that govern the MRI signal generation. By formulating image reconstruction as an inverse problem, quantitative maps of the underlyin…
▽ More
Conventional Magnetic Resonance Imaging (MRI) is hampered by long scan times and only qualitative image contrasts that prohibit a direct comparison between different systems. To address these limitations, model-based reconstructions explicitly model the physical laws that govern the MRI signal generation. By formulating image reconstruction as an inverse problem, quantitative maps of the underlying physical parameters can then be extracted directly from efficiently acquired k-space signals without intermediate image reconstruction -- addressing both shortcomings of conventional MRI at the same time. This review will discuss basic concepts of model-based reconstructions and report about our experience in developing several model-based methods over the last decade using selected examples that are provided complete with data and code.
△ Less
Submitted 11 February, 2021; v1 submitted 3 October, 2020;
originally announced October 2020.
-
CG-SENSE revisited: Results from the first ISMRM reproducibility challenge
Authors:
Oliver Maier,
Steven H. Baete,
Alexander Fyrdahl,
Kerstin Hammernik,
Seb Harrevelt,
Lars Kasper,
Agah Karakuzu,
Michael Loecher,
Franz Patzig,
Ye Tian,
Ke Wang,
Daniel Gallichan,
Martin Uecker,
Florian Knoll
Abstract:
Purpose: The aim of this work is to shed light on the issue of reproducibility in MR image reconstruction in the context of a challenge. Participants had to recreate the results of "Advances in sensitivity encoding with arbitrary k-space trajectories" by Pruessmann et al.
Methods: The task of the challenge was to reconstruct radially acquired multi-coil k-space data (brain/heart) following the m…
▽ More
Purpose: The aim of this work is to shed light on the issue of reproducibility in MR image reconstruction in the context of a challenge. Participants had to recreate the results of "Advances in sensitivity encoding with arbitrary k-space trajectories" by Pruessmann et al.
Methods: The task of the challenge was to reconstruct radially acquired multi-coil k-space data (brain/heart) following the method in the original paper, reproducing its key figures. Results were compared to consolidated reference implementations created after the challenge, accounting for the two most common programming languages used in the submissions (Matlab/Python).
Results: Visually, differences between submissions were small. Pixel-wise differences originated from image orientation, assumed field-of-view or resolution. The reference implementations were in good agreement, both visually and in terms of image similarity metrics.
Discussion and Conclusion: While the description level of the published algorithm enabled participants to reproduce CG-SENSE in general, details of the implementation varied, e.g., density compensation or Tikhonov regularization. Implicit assumptions about the data lead to further differences, emphasizing the importance of sufficient meta-data accompanying open data sets. Defining reproducibility quantitatively turned out to be non-trivial for this image reconstruction challenge, in the absence of ground-truth results. Typical similarity measures like NMSE of SSIM were misled by image intensity scaling and outlier pixels. Thus, to facilitate reproducibility, researchers are encouraged to publish code and data alongside the original paper. Future methodological papers on MR image reconstruction might benefit from the consolidated reference implementations of CG-SENSE presented here, as a benchmark for methods comparison.
△ Less
Submitted 10 August, 2020;
originally announced August 2020.
-
Model-Based Reconstruction for Simultaneous Multi-Slice T1 Mapping using Single-Shot Inversion-Recovery Radial FLASH
Authors:
Xiaoqing Wang,
Sebastian Rosenzweig,
Nick Scholand,
H. Christian M. Holme,
Martin Uecker
Abstract:
Purpose: To develop a single-shot multi-slice T1 mapping method by combing simultaneous multi-slice (SMS) excitations, single-shot inversion-recovery (IR) radial fast low-angle shot (FLASH) and a nonlinear model-based reconstruction method. Methods: SMS excitations are combined with a single-shot IR radial FLASH sequence for data acquisition. A previously developed single-slice calibrationless mod…
▽ More
Purpose: To develop a single-shot multi-slice T1 mapping method by combing simultaneous multi-slice (SMS) excitations, single-shot inversion-recovery (IR) radial fast low-angle shot (FLASH) and a nonlinear model-based reconstruction method. Methods: SMS excitations are combined with a single-shot IR radial FLASH sequence for data acquisition. A previously developed single-slice calibrationless model-based reconstruction is extended to SMS, formulating the estimation of parameter maps and coil sensitivities from all slices as a single nonlinear inverse problem. Joint-sparsity constraints are further applied to the parameter maps to improve T1 precision. Validations of the proposed method are performed for a phantom and for the human brain and liver in six healthy adult subjects. Results: Phantom results confirm good T1 accuracy and precision of the simultaneously acquired multi-slice T1 maps in comparison to single-slice references. In-vivo human brain studies demonstrate the better performance of SMS acquisitions compared to the conventional spoke-interleaved multi-slice acquisition using model-based reconstruction. Apart from good accuracy and precision, the results of six healthy subjects in both brain and abdominal studies confirm good repeatability between scan and re-scans. The proposed method can simultaneously acquire T1 maps for five slices of a human brain ($0.75 \times 0.75 \times 5$ mm$^3$) or three slices of the abdomen ($1.25 \times 1.25 \times 6$ mm$^3$) within four seconds. Conclusion: The IR SMS radial FLASH acquisition together with a non-linear model-based reconstruction enable rapid high-resolution multi-slice T1 mapping with good accuracy, precision, and repeatability.
△ Less
Submitted 19 August, 2020; v1 submitted 23 September, 2019;
originally announced September 2019.
