- Rating
- 4(+1)
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The authors introduce PC-DAPS, which aims to improve DAPS by pruning samples that could end up in the incorrect posterior modes during the sampling procedure, thus bypassing the need for best-of-k evaluation. The failure case, where standard DAPS can result in samples from the wrong mode, is clearly demonstrated using both toy examples and real data-driven priors. They propose two improvements during the sampling: (1) pruning intermediate particles that are unlikely under a surrogate prior density approximation using noised scores, and (2) combining the unimodal Gaussian posterior conditionals of each sample into a mixture of Gaussians. Experimental results demonstrate that PC-DAPS performs substantially better on multimodal inverse problems like phase retrieval, and samples the wrong mode much less often.
Critical strengths
The paper brings to light a significant limitation of DAPS, in which it often samples the wrong posterior mode, and also provides useful insights as to why and a solution. I have independently encountered similar issues using DAPS for posterior sampling, yet this problem has not really been discussed or analyzed in the literature despite the popularity of DAPS, making the paper's focus a valuable contribution.
The proposed improvements are intuitive, efficient, and justifiable under the Gaussian approximation.
For the same amount of computation and sampled particles, PC-DAPS outperforms even the best-of-k DAPS under image-based metrics, making it practically useful when generating many samples.
Critical weaknesses
SMC-based methods (like TDS) also perform resampling, which also weight and prune particles depending on their trajectory, but their performance on phase retrieval is not shown. What is the advantage of PC-DAPS over existing SMC approaches? Does PC-DAPS give more diversity and less particle collapse under the same number of samples?
Questions for authors
DAPS also has a diffusion-score alternative where the Gaussian conditional is replaced with the learned score queried at low noise. The samples of should be more prior-consistent due to not relying on Gaussian approximation, making upside down / inverted images much less likely, though with more computation and maybe less measurement consistency. How does PC-DAPS compare?
How do the surrogate prior-based weights compare to the true SMC weights along the DAPS annealing path?
What happens when the measurement is OOD, i.e. where the ground truth already fails the calibration check? Does PC-DAPS give worse reconstructions than standard DAPS here?
3 comments
Response to uv9e (2 of 2)
(Q2) How do the surrogate prior-based weights compare to the true SMC weights along the DAPS annealing path?
We are very interested in the answer to this question. We find it difficult to compare the two, primarily because computing accurate posterior weights is difficult when solving nonlinear inverse problems. For example, in IEnSF [11], the authors aim to solve nonlinear inverse problems with Gaussian mixture priors (appearing as the analysis step in data assimilation). The authors state at the beginning of Section 3.2 that, even in their GMM-only prior setting, the posterior mixture weights are intractable when is nonlinear and thus must be approximated (when is linear the weights are available by Gaussian conjugacy).
In our setting, our understanding is that, to know the analog of SMC weights along the DAPS path, we would require knowledge of the Langevin proposal and/or its integral over , the denoising likelihood . Unfortunately, it’s unclear to us how to accurately estimate either in high dimensions, even offline, since we don’t know . However, being able to tractably estimate these quantities in high dimensions would make for a great benchmark for existing twisting and tilting methods, and would resolve the final paragraph of our discussion section; thus, we have great interest in accurate techniques for computing these weights. We see the intractability of these objects as the primary motivation for using methods like DPS and DAPS.
Finally, although we can compare our prior-consistency scores to the SMC weights (given access to the latter), we want to flag that since SMC weights in generative approaches are typically importance weights, they use likelihood information, and so the scores and weights are likely quite dissimilar.
(Q3) What happens when the measurement is OOD, i.e. where the ground truth already fails the calibration check? Does PC-DAPS give worse reconstructions than standard DAPS here?
To measure OOD behavior, we ran PC-DAPS with the FFHQ score conditioned on the phase retrieval measurements of both (i) FFHQ validation images (in-distribution) and (ii) ImageNet images (OOD). Results reported in the table below are validated across 50 measurements.
On the ImageNet examples, we observe that PC-DAPS obtains better performance than DAPS: the average PSNR of the PC-DAPS samples is marginally higher, and the orientation of the outputted samples is consistent with the ground truth’s orientation more often.
| dataset | GT fails check | PSNR () | Correct orientation () | ||
|---|---|---|---|---|---|
| PC-DAPS | DAPS | PC-DAPS | DAPS | ||
| FFHQ | 0/50 | 29.65 | 25.02 | 94% | 78% |
| ImageNet | 0/50 | 16.46 | 14.73 | 46% | 32% |
Response to Authors
I appreciate the author's thorough response, and my concerns are resolved. As this is a direct improvement to a state-of-the-art posterior sampling method, I'll raise my score to 4.
Response to uv9e (1 of 2)
We thank the reviewer for the constructive feedback and for recognizing (i) the significance of the wrong-mode sampling issue in DAPS, which the reviewer has also independently observed, (ii) the intuitive, efficient, and theoretically grounded nature of our improvements, and (iii) the practical gains of PC-DAPS at equal compute. We address the remaining concerns below. Our citations appear above as a single public comment, as the same numbers are used across comments.
We will answer both (W1) and (Q1) using the following table:
Because PC-DAPS uses a generative prior, we focus on generative (specifically diffusion) SMC-based methods, for example [1, 3, 9]. In general, the main difference we see between the three SMC-based methods and PC-DAPS is that the SMC-methods typically use measurement-based importance weights, whereas PC-DAPS uses prior-consistency scores for pruning. However, of these three methods with which we are most familiar, FPS-SMC [3] and MCGDiff [1] are constructed to solve linear inverse problems. Because PC-DAPS is particularly interesting for nonlinear inverse problems, we compare against TDS, which supports nonlinear measurement models.
As you note, TDS [9] doesn’t report phase-retrieval results; thus, we implement our own phase retrieval twisting function and use their official code with the default settings, 4 particles (to match the PC-DAPS bag size), and the same diffusion model. We obtain an average PSNR of 18.80 dB and observe that 20% of its samples are flipped or failed (cf. 1.5% from PC-DAPS). We observe the cause of this TDS failure to be weight degeneracy: with 4 particles and 442k measurements, the median empirical effective sample size is 1.0 over the first 40% of the reverse process, so one particle takes all the weight from the start. On all 100 trials, only one of the 4 initial particles has descendants at the end, and the 4 outputs are near-copies (in-bag pairwise LPIPS 0.000). TDS thus returns one reconstruction per measurement; when it is flipped, all 4 samples are flipped. Also, PC-DAPS is 3.9 times faster than TDS, since it does not use backpropagation during sampling. All the results are presented in the table above.
We ran the diffusion-score option in DAPS’s official code base from the same initialization as the Gaussian step, and find the quality gain to be small despite the large increase in cost. Compared to DAPS-1K, the proportion of flipped samples in FFHQ phase retrieval decreases from 14.0% to 12.5% (cf. 1.5% from PC-DAPS) and metric gains are small (e.g. +0.87 dB for PSNR), yet the wall clock sampling time increases from 28s to 707s. All the results are presented in the table above.