- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces WAVEALIGN, a training-free, high-resolution image generation method based on wavelet decomposition. Its core mechanism involves using a low-resolution reference to constrain low-frequency structures while allowing high-frequency components to generate new details as the generation resolution is progressively increased. The paper presents a corresponding cross-scale alignment and sampling mechanism, and validates the method's effectiveness through experiments, including comparisons with baselines and ablation studies.
Critical strengths
- By employing wavelet decomposition to separate global structure from local details, this approach provides a clear, actionable framework for maintaining layout while enhancing detail during high-resolution generation. The method requires no additional training, making it highly practical.
- The ablation studies are comprehensive; beyond presenting high-resolution generation results, the paper investigates factors such as noise coupling, phase, cross-scale connections, and decomposition depth, which helps clarify the role of each individual component.
Critical weaknesses
The additional gains provided by "stage-matching" references—as opposed to fixed references—warrant more direct validation. In the proposed method, high-resolution sampling involves querying trajectories from a coarser (parent) resolution based on a scale-dependent temporal mapping; these queries are then used to refine the low-frequency structure of the current prediction. While the appendix offers valuable evidence by comparing various temporal query rules, it does not explicitly quantify the incremental improvement gained from dynamically querying parent-resolution trajectories versus consistently using the final, denoised output from the parent resolution. It is recommended to compare these two reference strategies—while keeping factors such as wavelet initialization, noise coupling, the intensity and scheduling of low-frequency correction, auxiliary inference settings, and the total sampling budget constant—to isolate the specific contribution of the stage-matching mechanism to structural preservation and detail generation.
Questions for authors
How does performance change when wavelet alignment is removed, while keeping the auxiliary reasoning setup, cascaded workflow, and computational budget constant?
4 comments
Response to Reviewer txhT (Part2)
Q2: Dynamic stage matching versus a fixed endpoint reference
Thank you for suggesting this direct comparison. The fixed-endpoint-reference experiments show a patch-level benefit from dynamic stage matching while retaining the other settings. We report the controlled image-quality comparison and a separate structural-consistency measurement below.
1. Dynamic versus fixed references under matched settings.
A fixed endpoint reference is conceptually related to I-Max's use of a low-resolution endpoint for guidance. In our experiment, we replace the dynamically queried parent clean prediction with the parent's last-step clean prediction, retaining wavelet-mixed initialization, noise coupling, the strength and schedule of low-frequency correction, auxiliary inference settings, and the model-evaluation budget. We test fixed references at 4K only and at both 2K and 4K. The former shares the same 2K parent trajectory and 4K initialization as the full method, directly isolating the effect of reference selection at 4K.
The table reports final 4K results on the same 1,000 prompts with seed 42 and includes the complete I-Max method as a reference. RADIO uses 1024×1024 inputs to evaluate global image–text consistency.
Configurations: I-Max: I-Max (full method); Fixed 4K: WAVEALIGN: fixed reference at 4K only; Fixed 2K/4K: WAVEALIGN: fixed references at 2K and 4K; Full: WAVEALIGN (full method).
| Metric | I-Max | Fixed 4K | Fixed 2K/4K | Full |
|---|---|---|---|---|
| RADIO ↑ | 34.0311 | 34.1869 | 34.1801 | 34.2016 |
| FID ↓ | 65.542 | 64.373 | 64.665 | 64.364 |
| KID×10³ ↓ | 6.033 | 4.358 | 4.231 | 4.409 |
| pFID ↓ | 83.448 | 44.331 | 46.289 | 42.679 |
| pKID×10³ ↓ | 56.265 | 18.600 | 19.137 | 18.324 |
| IS ↑ | 19.164 | 19.250 | 19.047 | 20.269 |
| pIS ↑ | 5.779 | 7.689 | 7.678 | 7.787 |
Dynamic stage matching improves patch-level distributional quality. Relative to fixing the reference only at 4K, dynamic querying reduces pFID from 44.331 to 42.679 and pKID from 18.600 to 18.324, with a small increase in RADIO. Using fixed references at both 2K and 4K increases final 4K pFID to 46.289. Both fixed-reference variants still achieve better patch-level distributional metrics than the complete I-Max method, indicating contributions from WAVEALIGN's other design choices. The internal controlled comparisons directly quantify the incremental gain from dynamic stage matching.
2. Structural preservation with a fixed parent trajectory. To further examine structural preservation, we conduct a separate paired experiment on 20 prompts, fixing the 2K parent trajectory and 4K initialization. We measure the shared-LL2 structural residual between the final 4K output and the parent endpoint reference. Dynamic querying reduces the mean residual from 13.353% to 12.490% and yields a lower residual on 18/20 prompts. This indicates that dynamic stage matching improves consistency with the parent's coarse structure alongside patch-level distributional quality.
Thank you again for your thoughtful comments and valuable suggestions. Your feedback has helped us better explain the role of cross-resolution alignment and dynamic parent-reference selection. We will incorporate the corresponding analyses and ablation results into the revised manuscript.
Response to Authors
Thank you for the clarification. The response resolves my concerns.
Response to Reviewer txhT (Part1)
We thank Reviewer txhT for recognizing the practical value of the framework and for suggesting direct controlled comparisons. Below, we report the contribution of cross-resolution alignment under a fixed budget and the incremental benefit of dynamic reference selection.
Q1: Removing wavelet alignment with auxiliary inference and budget fixed
Following your suggestion, we added an ablation with auxiliary inference, the cascaded workflow, and the model-evaluation budget fixed. The comparison shows that cross-resolution alignment improves high-resolution generation quality under these controls.
Controlled ablation.
We fix the backbone weights, cascade resolutions, sampling nodes, and attention settings. We then cumulatively disable wavelet structural correction, replace wavelet-mixed initialization with pixel-only initialization, and remove parent–child noise coupling. The final configuration retains auxiliary inference and cascaded generation without these cross-resolution alignment constraints.
The table reports final 4K results on the same 1,000 prompts with seed 42. RADIO uses 1024×1024 inputs.
Configurations: A: WAVEALIGN (full method); B: No structural correction; C: Pixel-only initialization, no structural correction; D: No cross-resolution alignment.
Removing all cross-resolution alignment increases FID from 64.364 to 67.091, pFID from 42.679 to 73.392, and pKID from 18.324 to 52.561, while reducing RADIO from 34.2016 to 33.7030. Under the same auxiliary inference settings and model-evaluation budget, these results show that cross-resolution alignment further improves high-resolution generation quality.
The intermediate ablations further illustrate the components' roles. Disabling structural correction alone increases pFID from 42.679 to 43.186 and pKID from 18.324 to 18.433, while RADIO and KID improve slightly. Replacing mixed initialization with pixel-only initialization in this configuration increases pFID to 63.409; additionally removing noise coupling increases it to 73.392. These results support the contribution of mixed initialization and noise coupling to high-resolution detail generation.