- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper proposes GrowFlow, a single-image 3D generator that produces sparse voxel structure and SLAT features jointly within one piecewise flow-matching process over an octree. Generation goes from coarse to fine. On Toys4k, the method matches or exceeds multi-stage SLAT methods on ULIP and Uni3D with about half the parameters of Trellis2 and faster inference, and it can stop at intermediate levels to give lower-resolution outputs.
Critical strengths
1 The paper addresses a real limitation of current SLAT-based generators: structure is fixed in a separate first stage and cannot be corrected later. Extending piecewise multi-resolution flow matching to an octree with a variable branching factor is a natural and non-trivial step. The proposed expansion operator is simple and handles the variable number of children per node without timestep rescheduling. 2 The method is practically appealing. With 1.53B parameters, it reaches quality comparable to Trellis2 (3.11B) while running about 1.7× faster, and a single model supports multi-resolution readout and early termination. The qualitative results on thin structures, open cavities and flat plates (Figs. 4, 5, 9, 10) are convincing and support the claim that revisiting occupancy at each level helps.
Critical weaknesses
1 The quantitative evaluation is limited. For example, only image–shape embedding scores (ULIP and Uni3D) are reported, from a single run with no seed averaging, and the authors themselves treat differences of a few thousandths as ties. 2 The method still uses a separate structure decoder, so “single-stage” really means interleaved structure prediction. It is somehow overclaimed. 3 Some related work is missing.Hierarchical sparse-voxel generation (XCube, which is cited but not discussed) and octree-based diffusion (e.g., OctFusion) should be discussed
Questions for authors
See weakness.
Thank you for your constructive feedback. We address the three weaknesses below and will revise the final version accordingly, including ensuring consistent formatting throughout the paper.
Our reported scores are averaged over approximately 4,000 samples. In addition, during structure generation, we exploit the low computational cost at coarse resolutions to generate multiple occupancy predictions in parallel and use voting to improve stability. We will also revise the discussion to clarify the interpretation of differences on the order of 0.001 between models.
Evaluating multiple random seeds requires more time than the two-week rebuttal period allows. These experiments are ongoing, and we aim to report the mean scores before the final decision.
Besides, to further assess geometric quality, we have added an evaluation based on CLIP scores averaged over multi-view normal renderings. The scores are:
GrowFlow: 0.923 Trellis.2: 0.915 Direct3D-S2: 0.920 Hunyuan3D: 0.915 UniLat: 0.911 Hi3DGen: 0.902
We will include these results in Table 1 in the final version.
In generative pipelines, the DiT accounts for most of the inference cost, whereas decoding is comparatively fast. We therefore count stages according to the distinct DiT-based generative processes, each of which may include a decoder. For example, Trellis.2 uses a DiT and a decoder to generate the 3D structure in its first stage, followed by another DiT and decoder to generate the 3D model conditioned on that structure. Direct3D-S2 uses two DiT-and-decoder stages for structure generation, followed by a third for generating the 3D model.
GrowFlow uses a single shared DiT with VAE decoding to jointly generate structure and features; the structure VAE is a very small module. Our use of “single-stage” refers to this shared generative process. We will clarify this definition in the final version to make the role of the structure decoder explicit.
Thank you for pointing out these omissions. In the final version, we will add a comparison with XCube to Table 1, including metrics: 1. ULIP:0.1475, 2. Uni3D: 0.2595 3.CLIP: 0.875 and discuss OctFusion in the related work section.