Published July 1, 2024 | Version Published
Journal Article

Learning Task-Specific Strategies for Accelerated MRI

Abstract

Compressed sensing magnetic resonance imaging (CS-MRI) seeks to recover visual information from subsampled measurements for diagnostic tasks. Traditional CS-MRI methods often separately address measurement subsampling, image reconstruction, and task prediction, resulting in a suboptimal end-to-end performance. In this work, we propose Tackle as a unified co-design framework for jointly optimizing subsampling, reconstruction, and prediction strategies for the performance on downstream tasks. The naïve approach of simply appending a task prediction module and training with a task-specific loss leads to suboptimal downstream performance. Instead, we develop a training procedure where a backbone architecture is first trained for a generic pre-training task (image reconstruction in our case), and then fine-tuned for different downstream tasks with a prediction head. Experimental results on multiple public MRI datasets show that Tackle achieves an improved performance on various tasks over traditional CS-MRI methods. We also demonstrate that Tackle is robust to distribution shifts by showing that it generalizes to a new dataset we experimentally collected using different acquisition setups from the training data. Without additional fine-tuning, Tackle leads to both numerical and visual improvements compared to existing baselines. We have further implemented a learned 4×-accelerated sequence on a Siemens 3T MRI Skyra scanner. Compared to the fully-sampling scan that takes 335 seconds, our optimized sequence only takes 84 seconds, achieving a four-fold time reduction as desired, while maintaining high performance.

Copyright and License

© 2024 IEEE.

Acknowledgement

The authors would like to thank Xinyi Wu for her assistance as a volunteer in testing our learned MRI sequence and collecting data.

Funding

The work of Zihui Wu was supported in part by Kortschak Fellowship, in part by Amazon AI4Science Fellowship, and in part by Amazon AI4Science Partnership Discovery Grant. This work was supported in part by NSF under Grant 2048237, in part by NIH under Grant 5R01AG064027, Grant 5R01AG070988, Grant R21EB029641, Grant R01HD099846, and Grant R01HD085813, in part by Heritage Medical Research Fellowship, in part by S2I Clinard Innovation Award, and in part by Rockley Photonics.

Ethics

This work involved human subjects or animals in its research. Approval of all ethical and experimental procedures and protocols was granted by Mass General Brigham Institutional Review Board under IRB Protocol No. 2012P002376, and performed in line with the Department of Health and Human Services (DHHS) 45 CFR Parts 46 and 164.

Data Availability

Our code is available at https://github.com/zihuiwu/TACKLE.

Additional Information

The associate editor coordinating the review of this manuscript and approving it for publication was Prof. Alejandro F. Frangi.

Additional details

Related works

Is new version of
Discussion Paper: arXiv:2304.12507 (arXiv)
Is supplemented by
Supplemental Material: 10.1109/TCI.2024.3410521/mm1 (DOI)
Software: https://github.com/zihuiwu/TACKLE (URL)

Funding

California Institute of Technology
Kortschak Scholars Program
Amazon (United States)
National Science Foundation
CCF-2048237
National Institutes of Health
5R01AG064027
National Institutes of Health
5R01AG070988
National Institutes of Health
R21EB029641
National Institutes of Health
R01HD099846
National Institutes of Health
R01HD085813
California Institute of Technology
Heritage Medical Research Institute
California Institute of Technology
S2I Clinard Innovation Award Caltech Center for Sensing to Intelligence
Rockley Photonics

Dates

Submitted
2023-11-06
Accepted
2024-05-21
Available
2024-07-18
Date of current version