- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Retire3D is a training-free framework for accelerating coarse-to-fine 3D generation through spatially selective evaluation in high-resolution stages. It uses coarse-stage geometry, trajectory changes, and uncertainty to establish a fixed partition of active and retired tokens. All latent states continue to evolve: active tokens receive fresh network evaluations, while retired tokens use history-based velocity predictions and provide approximate attention context through embeddings rebuilt from their current states. Residual checks trigger full reevaluations. Experiments on Direct3D-S2 and TRELLIS.2 assess reconstruction quality, fidelity to native outputs, and end-to-end efficiency, alongside ablations and composition with temporal caching.
Critical strengths
-
A practical approach to selective computation while maintaining the full spatial state. Retire3D reduces fresh evaluations without removing latent coordinates or freezing retired regions. Maintaining their evolution and contextual participation addresses an important difficulty in spatially selective 3D sampling. The refresh ablations further show that evaluation timing matters: on Direct3D-S2, residual-triggered refresh improves native fidelity over a uniform schedule at nearly identical query cost.
-
An informative evaluation of the quality–efficiency trade-off. The paper complements ground-truth reconstruction metrics with native-output fidelity and structural statistics, revealing geometric changes that conventional reconstruction scores can obscure. End-to-end timing includes selection, prediction, probes, and refresh overhead. The explicit reporting of negative ablations, missing measurements, and failure cases makes the demonstrated benefits and limitations easier to assess.
Critical weaknesses
-
The contribution of coarse-guided spatial allocation remains insufficiently established. The random-allocation control in Appendix D shows mixed results: G/C/U scoring decreases native F-score by 1.57 percentage points on Direct3D-S2 while improving it by 0.80 points on TRELLIS.2. Although this comparison uses an earlier configuration, a corresponding controlled evaluation of the final configuration is missing. Moreover, increasing the retirement fraction improves fidelity on Direct3D-S2, raising the question of whether the benefits primarily arise from state propagation and full refreshes rather than identifying local refinement demand. This distinction matters because coarse-guided allocation is central to the paper’s contribution.
-
The qualitative evidence provides limited coverage of the reported performance. The visual comparisons repeatedly feature a small set of objects, and the appendix clarifies that these examples are selected rather than randomly sampled. Reusing cases helps comparisons across settings, but offers limited evidence of robustness across the broader evaluation set. Aggregate metrics alone also do not reveal how often substantial local structural damage occurs or how severe the worst cases are. The paper does disclose failures, which is valuable; nevertheless, a broader, systematically selected visual evaluation, together with per-object fidelity distributions and structural failure rates, is needed to establish how representative the displayed results are.
Questions for authors
- Contribution of coarse-guided allocation. Could you provide a controlled comparison of G/C/U-guided allocation against random allocation using the final configuration on the held-out cohort, with matched query budgets or end-to-end latency? In particular, does coarse-guided allocation consistently improve fidelity across both backbones, and how much benefit remains relative to a simplified approach using only state propagation, probes, and full refreshes?
- Representativeness of the qualitative results. The qualitative comparisons repeatedly use a small set of selected objects. How representative are these examples of the full evaluation cohort? Could you summarize the per-object fidelity distribution and the frequency of substantial local structural failures, and provide additional examples selected by a predefined rule—for instance, random samples and cases near the lower fidelity quantiles? This would help assess whether the reported average performance reflects consistent behavior or masks a subset of severe failures.
3 comments
Thank you for the clarification and the additional per-object statistics. These results substantially alleviate my concern about the representativeness of the reported performance. I also agree that state propagation and refresh placement are legitimate contributions of the framework.
My main remaining concern is the practical value of coarse-guided spatial allocation. The reported improvement over random allocation is small on TRELLIS.2 (+0.8 pp) and negative on Direct3D-S2 (−1.6 pp). The refinement-demand precision indicates that the score captures a relevant signal, but does not establish that using this signal improves the final quality–efficiency trade-off. Similarly, the retirement-fraction trend supports the effectiveness of propagation and refresh with a small active set, rather than demonstrating the benefit of the coarse-guided score itself.
The promised controlled evaluation under the final configuration is therefore important. If random allocation achieves comparable or better results under matched budgets and refresh schedules, this would support the propagation-and-refresh framework more strongly than the coarse-guided allocation mechanism. This would not invalidate the overall approach, but would require a substantive adjustment to the contribution claims and a clearer justification for retaining the scoring component.
Regarding structural reliability, the improvements over Fast3Dcache are encouraging. However, 17 of 98 TRELLIS.2 objects meet the added-component criterion, so the severity of the remaining failures still deserves examination. The planned random and worst-case visual comparisons would help assess whether these defects materially affect usability and whether local structural damage is adequately captured by the reported connectivity metrics.
For now, I am retaining my current rating while awaiting the promised controlled experiments and visual comparisons. I am open to revising it if the additional evidence establishes a convincing quality–efficiency advantage and supports a clear, appropriately scoped statement of the method’s contributions.
Round 2 — Response to Reviewer pG8K
Thank you. We measured the severity of the remaining failures directly, and ran the controlled experiment you asked for.
Severity of failures, and whether component counts capture it
Data: connectivity vs. directly measured damage (TRELLIS.2, 100-object main comparison, Retire3D).
- 22 objects trip a connectivity criterion.
- 18 objects show severe visible damage.
- Only 6 objects are in both groups.
Takeaway. Your doubt is confirmed. Component counts do not identify local damage: they flag objects whose surface is intact apart from small detached fragments, and they miss local surface errors. We therefore report the direct measure for every method (definitions in the general update).
Data: objects with severe damage, 50 held-out objects per backbone.
| Direct3D-S2 visible | Direct3D-S2 surface | TRELLIS.2 visible | TRELLIS.2 surface | |
|---|---|---|---|---|
| Retire3D | 3 | 2 | 7 | 18 |
| Fast3Dcache, nearest / published budget | 11 / 39 | 19 / 31 | 8 / 43 | 19 / 43 |
| Fast-SAM3D | 48 | 40 | 50 | 47 |
| RAS | 48 | 36 | 0 | 0 |
Plates. Rule: 5 random and 5 lowest objects per backbone, every method, with missing- and extra-surface maps.
- 4 of our 5 lowest TRELLIS.2 objects have visible damage below 2%. Their low F_nat comes from small fragments and small surface offsets.
- On the same objects, Fast3Dcache scatters debris and Fast-SAM3D loses large surfaces.
- All 20 regenerated objects match the main table within .02.
Takeaway.
- Severe local damage is rare with Retire3D on Direct3D-S2 (3 of 50) and common for the spatial alternatives (11–48).
- On TRELLIS.2, Retire3D matches the most frugal Fast3Dcache budget and is far ahead of the others, except RAS, which uses 1.75× the memory.
- With per-layer context for retired tokens, severe visible damage falls to 1 of 49 on both backbones (an analysis result; its timing is not yet measured).
Quality–efficiency advantage
Data: Direct3D-S2, matched speed.
| F_nat | Severe visible damage | |
|---|---|---|
| Retire3D | .929 | 3 / 50 |
| Fast3Dcache, best budget | .841 | 11 / 50 |
| RAS | .411 | 48 / 48 |
| Fast-SAM3D | ≤ .216 | 48 / 50 |
- Retire3D vs. the best Fast3Dcache budget: +8.8 pp [6.9, 10.8].
- The accelerated stage is 1.29× / 1.32× faster.
- On a single-call (CFG-off) sampler, Retire3D keeps 97–99% of that speedup and its fidelity (.976 / .934).
- In the accelerated stage, removing CFG alone gives 1.99×; with Retire3D added it is 2.64× (Direct3D-S2).
Takeaway. Within spatial acceleration, Retire3D occupies an operating point no other method reaches, and it multiplies with CFG distillation. We scope the claim to that.
The allocation control, and the contribution statement
Setup. Final configuration, 50 held-out objects per backbone, same refresh rule. G/C/U and the random partitions execute identical queries (verified per object); ρ = .99 and propagation-only execute fewer.
| Direct3D-S2 | TRELLIS.2 | |
|---|---|---|
| Coarse score (G/C/U) | .929 | .869 |
| Random partition, 3 seeds | .943 | .873 |
| ρ = .99* | .953 | .898 |
| Propagation + probes + refresh only (no score-selected tokens)* | .938 | .893 |
* Objects that cannot run these settings are excluded rather than counted:
- ρ = .99 runs on 50 / 42 objects (Direct3D-S2 / TRELLIS.2);
- the propagation-only setting runs on 32 / 32 objects;
- on the remaining objects, the query-subset kernel either needs more query rows than the probes provide (Direct3D-S2) or would fall back to dense execution (TRELLIS.2).
Takeaway. As you anticipated, the coarse score does not improve on a random partition.
Your Round-1 question was how much benefit remains with propagation, probes and refreshes alone. The answer is all of it (.938 / .893). The framework holds with every partition we tested, and fidelity rises as the active set shrinks.
Following your suggestion:
- the revision presents the propagation-and-refresh framework as the method;
- the score becomes one replaceable initialization of the partition;
- Figure 1 is presented as evidence of spatial redundancy.
This replaces the earlier 12-object TRELLIS.2 figure (+0.8 pp).
Round 1 — Response to Reviewer pG8K
Thank you for the specific requests.
W1 / Q1 — Contribution of coarse-guided allocation.
W2 / Q2 — Per-object distribution and structural failures.
Q2 — Examples by a predefined rule.
tv_002andglass_047), each shown for native, Retire3D, and the baselines under one camera protocol.