- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a generative method via recursive refinement. The method generates spatial fields through repeated coarse-to-fine refinement using one network shared across scales. Experiments cover Julia sets, natural images, and porous media.
Critical strengths
- The recursive refinement formulation can be useful intuitively and enables fundamental applications.
- The method is interesting and gives encouraging initial results.
- This paper is technically sound.
Critical weaknesses
- The quantitative metrics are weak.
- The evaluation task narrows the potential application of the method. And the experiments on the Julia set may rely on the prior assumptions of the method.
Questions for authors
- The method formulates the multi-scale training and sampling borrowing the lessons from diffusion models. It is interesting to discuss the scale generalization and non-Markovian sampling.
- Why was a single Julia set chosen as the main quantitative benchmark for scale extrapolation? Given its recurring structure across scales, could you also evaluate on other Julia-set parameters and natural-image super-resolution tasks to test whether the learned refinement rule generalizes beyond this particularly favorable setting?
Response to Reviewer wU8d
Thank you for recognizing the technical soundness and potential of the formulation. We have strengthened the quantitative evaluation and tested the limits of the learned refinement rule.
[W1] We trained a 2563 Berea sandstone model and evaluated 150 generated realizations. Values are means ± standard deviations:
We also computed two-point correlations on a separate subset ([W1 of rev-e78C]). These metrics assess learned geometry and transport beyond exact count conservation.
The Julia evaluation compares 16 held-out trajectories against recursive nearest-neighbor refinement and a deterministic transformer with the same architecture. At scale 10, the second unseen scale, relative pixel error is 5.65 ± 2.79% for our model, 18.06 ± 5.70% for the deterministic model, and 42.64 ± 15.71% for nearest neighbor. A new Appendix additionally reports CIFAR-10 ablations on sampling budgets, conditioning, and shared versus independent networks. The new conditional-image results are given in [Q2].
[W2] Julia sets provide fine-scale ground truth at successive zoom levels, including scales excluded from training. We agree that their recurring structure makes them a favorable setting for a controlled test of recursive error accumulation.
The network learns from images using spin refinement and shared weights, without scale conditioning. The Julia equation supplies the reference images, it is not used as the refinement rule. The assumption is that learned refinement statistics remain useful at finer scales. Weight sharing makes this possible; it does not guarantee it. Our experiments test that assumption and expose its limits.
The three applications deliberately test different capabilities of the same framework: Julia sets test extrapolation with ground truth, natural images test conservative conditional generation, and porous media test large-volume generation with exact count control and physical evaluation. The new parameter-transfer experiment below tests whether the learned rule remains useful beyond the training fractal.
[Q1] Within a given refinement stage, the process is Markovian: the fine configuration, reservoir counts or flip indicators, time, and fixed coarse condition. Across scales, each refinement conditions on the preceding coarse representation.
In a completed conservative hierarchy, earlier coarse grids are determined by aggregating the current grid. Supplying them again can change the parameterization but adds no observations. A history-dependent within-stage sampler would require discrete dynamics preserving the intended distribution and constraints. We have not evaluated this extension. Could you clarify whether you mean history across resolutions or an alternative sampler within each resolution?
[Q2] We now test the frozen model on 14 additional Julia parameters, perturbing the real or imaginary component by magnitudes from 10−4 to 10−1. Two independent trajectories per parameter give 28 trajectories. Each starts from its true scale-0 image and then uses its own predictions recursively, without retraining. Scale-10 errors range from 4.9% to 30.3% at magnitude 10−4. These results show useful transfer of the frozen model.
We also extend one held-out trajectory to scale 18, ten scales beyond training on 1–8. This example uses eight test-time augmentations with majority voting and shows eventual error accumulation; it is separate from the 16-trajectory comparison above. The final relative error at scale 18 is 12%.
For natural images, we added conditional refinement from held-out CIFAR-10 images. All methods use the same coarse inputs, produce 32×32 outputs, and use the same FID evaluation:
FID uses 10,000 outputs against the test set; learned refinement uses 512 reverse steps per remaining scale. They measure conditional generation within the training resolution range. The Appendix separately shows 32→64→128 refinement without fine-tuning. That extrapolation is qualitative since CIFAR-10 has no corresponding high-resolution targets.