Published October 2023 | Version Published
Conference Paper

Score-Based Diffusion Models as Principled Priors for Inverse Imaging

  • 1. ROR icon California Institute of Technology
  • 2. ROR icon Google (United States)

Abstract

Priors are essential for reconstructing images from noisy and/or incomplete measurements. The choice of the prior determines both the quality and uncertainty of recovered images. We propose turning score-based diffusion models into principled image priors ("score-based priors") for analyzing a posterior of images given measurements. Previously, probabilistic priors were limited to handcrafted regularizers and simple distributions. In this work, we empirically validate the theoretically-proven probability function of a score-based diffusion model. We show how to sample from resulting posteriors by using this probability function for variational inference. Our results, including experiments on denoising, deblurring, and interferometric imaging, suggest that score-based priors enable principled inference with a sophisticated, data-driven image prior.

Copyright and License

© 2023 IEEE.

Acknowledgement

This project was partially done while BTF was an intern at Google Research. The authors would like to thank Michael Brenner for his helpful discussions throughout the project. They thank Yang Song, Zelda Mariet, Tianwei Yin, Patrick Kidger, and Mauricio Delbracio for their insightful feedback. Thanks also to Aviad Levis for his help with EHT software and Patrick Kidger for his help with Diffrax. BTF and KLB acknowledge funding from NSF Awards 2048237 and 1935980 and the Amazon AI4Science Partnership Discovery Grant. BTF is supported by the NSF GRFP.

Additional details

Funding

National Science Foundation
CCF-2048237
National Science Foundation
AST-1935980
Amazon (United States)
Amazon4Science
National Science Foundation
NSF Graduate Research Fellowship