- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
Tahis paper proposes TRACE, training-free framework for imaging inverse problems that combines deep image priors with a diffusion-inspired trajectory. The method optimizes a network for each measurement instance, using scheduled input perturbations and Stochastic Proximal Consistency (SPC) to couple successive reconstruction states. Experiments cover CT reconstruction, inpainting, super-resolution, and deblurring, while additional results examine SPC within existing diffusion-based solvers. The paper presents a clear motivation, achieves competitive results across multiple tasks, and includes extensive component ablations and hyperparameter analyses. However, the specific benefit of the diffusion-inspired schedule over general perturbation or annealing strategies remains insufficiently established. The distinction between SPC and existing proximal constraints, particularly those in DAPS, also requires clarification. Furthermore, TRACE’s practical advantages over available pretrained diffusion models are not fully demonstrated, especially given its higher reconstruction cost. Overall, the approach is promising, but its novelty and most suitable application settings need to be articulated more clearly.
Critical strengths
S1. The paper is well-structured and clearly presents the research motivation and method design.
S2. Combining DIP with diffusion-style trajectories has certain value, and the proposed method achieves good reconstruction performance on most evaluated tasks.
S3. The authors provide extensive ablation studies and hyperparameter analyses, which help clarify the roles of different components and the impact of parameter settings on performance.
Critical weaknesses
W1. Limited novelty.
The proposed method mainly combines per-instance network optimization, noise scheduling, and proximal constraints between consecutive states. Compared with existing methods such as SDI and aSeqDIP, the paper does not sufficiently clarify what substantial new contribution arises from this combination.
W2. Insufficient validation of the claimed benefits of diffusion-style scheduling.
The authors claim to incorporate the advantages of diffusion scheduling into DIP. However, the existing ablation studies mainly examine the effects of noise perturbation and proximal constraints, which are insufficient to establish the specific value of the proposed scheduling strategy. In particular, the method still optimizes a clean image estimate, and its connection to diffusion trajectories requires further explanation. Comparisons with fixed noise levels, alternative annealing schedules, and designs inspired by flow matching or diffusion bridges would help determine whether the improvements arise from the specific schedule or from generic perturbation and progressive optimization.
W3. Incorrect citation information.
SDI (Self-Diffusion for Solving Inverse Problems) is listed as a NeurIPS 2026 paper, whereas its official conference version was published at NeurIPS 2025. The authors should verify and correct the reference information to ensure consistency.
W4. Insufficient explanation of the definition, implementation, and distinctive contribution of SPC.
The method section is overly brief, making it difficult to understand how Stochastic Proximal Consistency (SPC) differs from existing techniques. Frameworks such as Half-Quadratic Splitting (HQS) already incorporate measurement consistency and proximal constraints, while the paper does not adequately explain how stochastic perturbations make the proposed mechanism fundamentally different.
Regarding Table 3, the authors should also provide a clearer explanation of how SPC is incorporated into each diffusion solver. In particular, DAPS already employs Gaussian-form quadratic constraints and noise-scale scheduling. Therefore, the distinction between the additional SPC term and its schedule and the corresponding mechanisms already present in DAPS remains unclear.
W5. Insufficient justification of the practical scenarios in which avoiding pretraining is advantageous.
For the natural-image and CT tasks considered in this paper, suitable datasets and pretrained diffusion models are already available. Therefore, reliance on training data does not necessarily constitute a practical disadvantage. Meanwhile, Table 8 shows that several diffusion-based methods have substantially shorter reconstruction times than TRACE.
The value of TRACE may be more pronounced in scenarios where suitable training data or pretrained priors are difficult to obtain, but the current experiments do not sufficiently validate this advantage. Furthermore, [1] shows that even mismatched or weak diffusion priors can achieve strong reconstruction performance when the observations provide sufficient information. Therefore, the authors should more clearly delineate the practical advantages of TRACE over existing diffusion-prior-based approaches.
Reference
[1] Weak Diffusion Priors Can Still Achieve Strong Inverse-Problem Performance.
Questions for authors
Q1. Benefits of diffusion-style scheduling (W2).
Can the authors explain what specific advantages diffusion-style scheduling brings to TRACE? How do these advantages differ from those of general noise perturbation or annealing strategies?
Q2. Definition and novelty of SPC (W4).
Can the authors more clearly explain the meaning of "Stochastic" in Stochastic Proximal Consistency (SPC) and how it differs from existing proximal constraints? In particular, what exactly does SPC add to DAPS?
Q3. Practical advantages and applicability of TRACE (W5).
When pretrained diffusion models are already available and offer faster reconstruction, what are the practical advantages of TRACE? In which scenarios would TRACE be a more suitable choice?
9 comments
Response to W2 and Q1: Role of diffusion-inspired scheduling.
In TRACE, noise is added to the network input, , while the output remains a clean-image estimate fitted to the measurements under the SPC constraint. We borrow the noise-level schedule from diffusion, but do not perform reverse-diffusion sampling. The schedule lets us reduce input perturbation as reconstruction proceeds. Proposition 4.3 explains its local effect through a sensitivity penalty whose strength depends on the noise amplitude.
Our default schedule uses noise level decreases from approximately 0.428 to 0.010. A fresh Gaussian noise sample is drawn at each stage.
According to your suggestion, we added comparisons on 14 images per task, keeping and .
For the fixed-perturbation comparison (Table R5), we tested seven constant amplitudes from 0.01 to 0.80 and reused one noise sample across stages. Table R5 shows gains of 1.65 and 1.74 dB over the best tested fixed perturbations. This comparison includes both scheduling and noise resampling.
For the fixed noise level comparison (Table R5'), we compare TRACE with seven constant noise levels, drawing fresh noise at every outer step in all settings. Results in Table R5' show that decreasing the noise amplitude is beneficial for super-resolution under the tested settings, but is not necessary for strong inpainting performance.
For the schedule comparison (Table R6), we kept the endpoints and noise samples unchanged and tested two alternatives: geometric decay, with , and a flow matching (FM)-inspired shift, , where . Table R6 isolates the schedule shape: the default schedule exceeds geometric decay by 0.29 and 0.79 dB, while the shifted schedule gives slightly higher PSNR than the default.
We also tested FM-inspired input interpolation (Table R7). Setting gives . Thus, at the same reconstruction state, this changes only the overall input scale. Table R7 shows little change under input interpolation, consistent with the approximate scale invariance introduced by BatchNorm.
The experiments show that the schedule affects performance, but the default form is not essential. We will clarify this in the manuscript.
Response to W4 & Q2: Contribution and implementation of SPC.
Meaning of SPC and distinction from existing proximal constraints. TRACE enforces SPC along the reconstruction trajectory through a proximal constraint that keeps the reconstruction generated from each stochastically perturbed intermediate trajectory estimate close to its preceding unperturbed state. Specifically, "stochastic" refers to the injection of random noise into the input, , where . The resulting reconstruction is proximally coupled to the preceding unperturbed state through Unlike conventional proximal regularization, SPC explicitly applies the proximal constraint to a reconstruction generated from a stochastically perturbed input.
Also, we would like to clarify that standard HQS is an optimization algorithm. HQS introduces an auxiliary variable and uses a quadratic penalty to enforce agreement between the split variables. SPC instead penalizes deviations of the network output under random input perturbations from the preceding reconstruction. Our contribution is this perturbation–consistency interaction and its analysis, rather than the quadratic penalty itself.
Explanation of Table 3. For all the diffusion solvers, we use the same implementation. For all the experiments, we only add the SPC term between its current clean-image estimate and a stored reference to their objective function . The augmented objective is then solved by their default updating optimizer.
DAPS’s existing quadratic keeps the sampled image close to the denoised estimate obtained at the current annealing step. SPC adds a second quadratic that keeps it close to the stored denoised estimate from the preceding step. More specific settings are as follows.
| Solver | Variable | Original objective at each step | Objective with SPC | Solved by (unchanged) |
|---|---|---|---|---|
| DPS | One guidance step after the unconditional reverse step : , with . | |||
| DAPS | Langevin dynamics on this energy: The result is re-noised to level . | |||
| RED-diff | with . | . The detached snapshot is refreshed every 20 iterations because successive RED-diff iterates are nearly identical. | One Adam step on per iteration. | |
| PnP-DM | Langevin dynamics on this energy gives (likelihood step). The prior step then draws by reverse diffusion from at noise level . | |||
| SITCOM | Adam steps on , starting from , give . Then is re-noised to level . |
Notation: is the measurement, is the forward operator, is the clean-image estimate of the pretrained diffusion model, , and is the stop-gradient. Each solver keeps the symbols of its paper. (DAPS) and (PnP-DM) are their likelihood parameters and are unrelated to the SPC weight .
Response to W1: Methodological novelty.
TRACE reconstructs an image by sequentially optimizing a pretraining-free network on noise-perturbed inputs while coupling each output to the preceding unperturbed reconstruction.
(1) Distinct formulation. Unlike aSeqDIP, which updates its input deterministically and repeatedly solves the same objective form with a fixed λ, TRACE constructs a stochastic optimization problem at each outer iteration using annealed perturbations σt and time-varying proximal coupling βt. Unlike SDI, which optimizes measurement fidelity on perturbed inputs, TRACE constrains the reconstruction from each perturbed input to remain close to its preceding unperturbed state, introducing a distinct trajectory regularization mechanism.
(2) Distinct regularization mechanism. Proposition 4.3 shows that SDI-type stochastic perturbations induce measurement-space sensitivity regularization proportional to σt2∥AJD∥F2, whereas SPC additionally induces βtσt2∥JD∥F2. Crucially, this term also regularizes measurement-nullspace sensitivity, which measurement fidelity alone cannot directly constrain. This stochasticity-induced image-space Jacobian regularization is absent from both aSeqDIP's deterministic objective and SDI's formulation.
(3) Empirical and theoretical significance. TRACE achieves 29.55 dB in sparse-view CT, compared with 24.36 dB for SDI (+5.19 dB) and 27.15 dB for aSeqDIP (+2.40 dB), while outperforming both across all six natural-image settings. Our controlled ablations and null-space experiments further demonstrate that appropriate SPC strength improves peak PSNR, post-peak stability, and reconstruction of measurement-nullspace components while reducing null-space Jacobian sensitivity, compared with stochastic perturbations alone.
We further report additional PSNR curves of sparse-view CT reconstruction that compare TRACE and SDI over 300 outer stages, with 150 inner iterations per stage (Fig. R1: panel (a), panel (b), panel (c), panel (d), panel (e)). Across all five displayed examples, TRACE has a smooth PSNR curve during extended optimization, whereas SDI exhibits larger fluctuations and subsequent degradation. These results establish SPC as a distinct, significant, and previously overlooked design principle for imaging inverse problems.
We thank the reviewers for raising this question. We will clarify these methodological distinctions in the manuscript.
Response to W3 We thank the reviewer for pointing this out. We will modify it in the revised manuscript.