- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Piecewise DoD-SAE to improve the temporal stability and interpretability of sparse features in diffusion models. The method trains SAEs on normalized differences between neighboring timestep representations instead of raw features, aiming to reduce timestep-dependent variations. Experiments on three liver MRI datasets and MVTec AD show improved feature stability, semantic steering consistency, and downstream classification performance compared with existing SAE methods.
Critical strengths
-
The paper addresses a clear and meaningful problem with a simple and intuitive approach. The proposed method is easy to understand and does not require major architectural changes.
-
The experiments are organized around three clear research questions, making the evaluation logical and easy to follow. The ablation studies and additional analyses provide convincing evidence for improved temporal stability and steering consistency.
Critical weaknesses
The effectiveness of the proposed DoD formulation is not fully validated. The paper lacks a direct comparison with closely related temporal SAE methods, and the steering comparisons use the same gain despite large differences in actual intervention strength. These issues make it difficult to determine whether the improvements come from the proposed method or the evaluation setup.
Questions for authors
-
Please provide more direct comparisons with closely related temporal SAE methods and evaluate steering under matched intervention strengths to better validate the effectiveness of the proposed DoD formulation.
-
It would be helpful to include more implementation details for downstream classification, such as the optimizer, learning rate, batch size, training epochs, and data augmentation, to improve reproducibility.
-
The medical experiments are limited to liver MRI, while the paper makes broader claims about medical semantics. Additional evaluations on other anatomical regions (e.g., brain or cardiac MRI) or imaging modalities (e.g., CT) could further demonstrate the generalizability of the proposed method.
3 comments
Thank you for the considerate and detailed rebuttal, which has addressed some of my concerns. I am maintaining my original rating of weak acceptance.
Thank you for your positive feedback and for taking the time to carefully consider our rebuttal. We sincerely appreciate your thoughtful comments and support.
Author Response to Reviewer
Thank you for the helpful questions on baseline coverage, matched-effect steering, reproducibility, and generalization. We address each point below.
Regarding W1 and Q1: Temporal SAE Comparison and Matched-Effect Steering
We agree that Residualized Temporal SAE [1] and TIDE [2] are closely related temporal SAE methods. However, neither method currently provides publicly available code, preventing a faithful quantitative comparison without introducing substantial reimplementation choices. Upon acceptance, we will release our implementation to support direct comparison and future temporal-SAE research.
[1] Yeung et al., “Residualized Temporal Sparse Autoencoders for Interpreting Diffusion Models,” arXiv:2605.27813, 2026.
[2] Huang et al., “TIDE: Temporal-Aware Sparse Autoencoders for Interpretable Diffusion Transformers in Image Generation,” AAAI, 2026.
Original gain calibration. Raw gain values are not directly comparable across SAE parameterizations. In Figures 4 and 7, we therefore calibrate each method's gain range using random top-K steering, selecting ranges in which random latents already produce a comparable, non-negligible SSC change. Within these calibrated ranges, the low-entropy directions exhibit different controllability: P-DoD-SAE produces progressively stronger and more consistent semantic effects, whereas the baselines respond weakly or saturate. Thus, the original protocol compares semantic controllability after method-specific gain calibration, while matched effect-L2 provides a complementary image-space magnitude control.
For the reproducible baselines, we additionally evaluate steering after matching the image-space effect magnitude across methods to verify that P-DoD-SAE's advantage persists at matched intervention scales. The five target effect-L2 levels come from the P-DoD-SAE gain sweep reported in Table 12, including intermediate points from the same sweep. We tune method-specific gains so that, among reachable settings, the achieved effect-L2 differs from its target by at most 2.2%. Each cell reports effect cosine / SSC LPIPS / SSC SSIM.
Effect direction. P-DoD-SAE retains substantially higher effect-direction cosine at every matched magnitude.
Main SSC. The methods are similar under weak interventions, while P-DoD-SAE becomes clearly stronger at the two largest reachable magnitudes.
Response to gain. SAeUron requires gains several orders of magnitude larger while its effect cosine remains nearly flat, and DiffLens saturates before reaching the two strongest targets. In contrast, P-DoD-SAE reaches all five levels with increasingly aligned effects, consistent with its schedule-normalized, direction-based training target rather than an advantage caused only by larger interventions.
Regarding Q1
Please see our response to W1, where we report the requested matched-effect comparison.
Regarding Q2: Downstream Classification Details
Thank you for the suggestion. All four classifiers are initialized from public pretrained checkpoints and trained with Adam, batch size 32, and at most 110 epochs, with validation-loss early stopping. We use cross-entropy with 0.1 label smoothing. Training images are resized and randomly cropped, while validation and test images use center crops; no mixup is applied. The learning rate and weight decay are initialized at 10−4 and 10−4, respectively, and selected on the validation split; the resulting classifier-specific settings are kept identical across Real and all SAE-guided conditions. We will include the complete per-classifier configurations in the appendix.
Regarding Q3: Generalization Beyond Liver MRI
Thank you for the suggestion. Appendix E provides an additional evaluation on the natural-image MVTec AD dataset, showing that the temporal-stability improvement extends beyond the liver MRI setting. During the rebuttal period, our available computational resources were insufficient to retrain the diffusion and SAE pipelines on additional anatomical regions or imaging modalities. We therefore leave broader medical validation, including brain or cardiac MRI and CT, as important future work and limit our current medical claims to the evaluated liver MRI benchmarks.