- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper investigates the initialization bottleneck in autoregressive 3D mesh generation. The authors observe that providing a single ground-truth face significantly improves subsequent mesh generation, suggesting that predicting the first face from an empty context is considerably more difficult than generating later faces. To address this issue, the authors propose SeedFACE, which separates first-face generation from autoregressive mesh continuation. Specifically, a VAE learns a compact latent representation of the first face, while a latent diffusion model learns its distribution. The generated first face then serves as the geometric context for the original autoregressive model. Experiments on Objaverse and ShapeNet demonstrate improvements in distribution-level metrics, including Coverage (COV), Minimum Matching Distance (MMD), and 1-Nearest-Neighbor Accuracy (1-NNA). The authors also provide analyses of first-face prediction uncertainty, distribution diversity, and modeling gaps, together with ablations on different seed-generation strategies.
Critical strengths
S1. An interesting observation about autoregressive mesh initialization.
The paper identifies an interesting phenomenon: providing only the first ground-truth face substantially improves subsequent autoregressive generation. The authors support this observation through prefix experiments, cross-entropy analysis, and investigations of first-face distribution complexity. This provides a useful perspective on where modeling difficulties arise during sequential mesh generation.
S2. A simple and effective approach with improvements on Objaverse.
The proposed framework separates geometric initialization from autoregressive continuation while largely preserving the existing mesh generation architecture. The improvements over FACE on Objaverse are substantial, particularly in COV, MMD, and 1-NNA. The experiments also demonstrate that explicit seed modeling can be implemented using different generative approaches.
Critical weaknesses
W1. The first-face bottleneck may depend on mesh serialization and the absence of global conditioning.
The paper identifies first-face prediction as a major bottleneck in autoregressive mesh generation. However, the first face is not an intrinsic property of a mesh; it is determined by the adopted face ordering strategy.
The experiments primarily follow the face-based serialization framework of FACE, which uses deterministic spatial ordering. Different traversal or ordering strategies may result in substantially different first-face distributions and prediction difficulties. Without evaluating alternative ordering strategies, it remains unclear whether the observed bottleneck reflects a general limitation of autoregressive mesh generation or a property of the particular serialization method.
Furthermore, the experiments focus on category-agnostic and category-conditioned generation without instance-specific geometric guidance. In practical mesh generation tasks, autoregressive models are often conditioned on images, point clouds, or other global geometric representations. Such conditioning could significantly reduce uncertainty during first-face prediction. Therefore, the generality of the proposed first-face bottleneck remains insufficiently established.
W2. The evaluation does not fully establish the necessity of the proposed design or its advantages in mesh quality.
The paper primarily evaluates generation performance using COV, MMD, and 1-NNA computed from sampled point clouds. While these metrics are appropriate for measuring distributional similarity, they do not directly evaluate geometric validity, mesh connectivity, topology, or surface quality.
A generated mesh can be geometrically plausible while differing from the empirical dataset distribution. Conversely, improved distribution matching does not necessarily imply better mesh structure. Additional evaluations of geometric validity and topology would strengthen the claim that SeedFACE improves mesh generation quality.
Moreover, Table 4 shows that an isolated autoregressive first-face generator achieves performance comparable to SeedFACE, including a slightly better MMD (10.43 versus 10.46). This suggests that explicitly separating first-face modeling from subsequent generation may account for much of the improvement, while the additional benefits of the proposed VAE and latent diffusion architecture remain unclear. Given the additional architectural and training complexity, a more systematic comparison of model capacity, computational cost, and generation quality would be valuable.
Questions for authors
Q1. Sensitivity to Face Ordering
How sensitive is the proposed first-face bottleneck to different mesh serialization strategies? Since the first face depends on the adopted ordering, it would be valuable to evaluate whether the reported uncertainty gap and the benefits of SeedFACE persist under alternative ordering strategies, such as different spatial sorting orders or graph-based traversal methods, with models retrained under matched settings.
Q2. Generalization to Conditional Mesh Generation
Does the first-face bottleneck remain significant when the autoregressive mesh model is conditioned on global geometric information, such as point clouds or image features? Such conditioning may already provide sufficient information for first-face prediction. Evaluating SeedFACE in these settings would help establish whether the proposed method addresses a general challenge in autoregressive mesh generation or a difficulty primarily associated with unconditional generation.
Q3. Necessity of Latent Diffusion
Table 4 shows that the isolated autoregressive seed generator achieves results comparable to SeedFACE. Could the authors provide a more detailed comparison of these approaches, including parameter counts, training costs, inference latency, and generation quality? This would help clarify the specific advantages of introducing a VAE and latent diffusion model rather than using a simpler dedicated first-face generator.
Q4. Evaluation of Geometric Validity
Could the authors provide additional evaluations that directly assess the geometric quality of generated meshes, beyond distribution-level metrics computed from point clouds? For example, measurements of disconnected components, degenerate faces, non-manifold geometry, or other mesh validity properties would help determine whether the improvements in COV, MMD, and 1-NNA translate into meaningful improvements in mesh quality.
3 comments
Q3: Necessity of Latent Diffusion.
We would like to clarify that the isolated AR experiment is intended to evaluate alternative first-face modeling strategies, rather than establish the superiority of diffusion over autoregression. The comparable performance of different seed generators supports our central insight that explicitly separating initialization from autoregressive continuation effectively addresses the first-face bottleneck.
Our contribution extends beyond introducing an additional seed generator. We identify and systematically analyze the initialization bottleneck, and propose a latent-space formulation that models the seed distribution while retaining the shared autoregressive mesh-decoding pathway. Compared with directly modeling discrete first-face tokens, our VAE provides a compact, regularized latent representation for diffusion-based generation.
Regarding computational cost, the isolated AR and latent-diffusion seed generators are matched in model size, providing a comparison with comparable model capacity. The latent model operates only on a compact seed representation, while subsequent mesh generation retains the original autoregressive process. We will clarify these architectural and computational considerations in the revision.
Q4: Evaluation of Geometric Validity.
We appreciate the suggestion to evaluate mesh structure beyond point-cloud-based distribution metrics. Accordingly, we additionally report the average numbers of vertices and faces (V/F) over 2,048 generated samples per method on Objaverse, providing complementary information about mesh complexity and vertex sharing. The results are shown below.
| Metric | MeshFlow | PolyGen | MeshGPT | PivotMesh | FACE | SeedFACE |
|---|---|---|---|---|---|---|
| COV ↑ | 51.86 | 40.66 | 26.41 | 38.67 | 40.43 | 52.88 |
| MMD ↓ | 12.33 | 11.38 | 15.80 | 12.28 | 14.40 | 10.46 |
| 1-NNA | 54.54 | 61.11 | 82.16 | 62.79 | 76.10 | 53.56 |
| V/F | 327.82 / 109.39 | 70.89 / 152.96 | 25.86 / 47.97 | 32.44 / 59.26 | 45.04 / 78.28 | 58.45 / 109.16 |
MeshFlow generates substantially more vertices than faces (327.82/109.39), suggesting limited vertex sharing and fragmented connectivity. In contrast, SeedFACE achieves a more balanced V/F ratio (58.45/109.16), comparable to PolyGen, while generating more faces than MeshGPT, PivotMesh, and a comparable number to MeshFlow. These results indicate that SeedFACE maintains reasonable vertex sharing while generating richer mesh structures, consistent with the qualitative comparisons.
We also note that the training meshes are not necessarily watertight or manifold, making strict topological validity criteria less representative of the target data distribution. We therefore use V/F as a complementary structural statistic rather than treating manifoldness or watertightness as universal requirements for generation quality.
Thank you for the detailed rebuttal and additional experiments.
The BFS/DFS experiments adequately address my concern regarding sensitivity to face ordering. I also appreciate the new image-conditioned generation experiments.
However, some concerns remain. In the conditional setting, MMD deteriorates substantially despite improvements in COV and 1-NNA, leaving the benefits for conditional generation unclear. Additionally, the reported V/F statistics do not directly establish mesh validity or connectivity quality.
I acknowledge the additional evidence supporting the importance of first-face initialization, but I do not believe the remaining concerns regarding evaluation and practical effectiveness have been fully resolved. Therefore, I will maintain my current rating.
We thank the reviewer for the positive assessment of our technical insights, method effectiveness, and experimental analysis. We address the concerns below.
Q1: Sensitivity to Face Ordering.
Following your suggestion, we retrained FACE and SeedFACE using two additional graph-based traversal strategies, breadth-first search (BFS) and depth-first search (DFS), under matched experimental settings. The results are shown below.
SeedFACE consistently improves all three distribution-level metrics over FACE under both traversal strategies. In particular, BFS improves COV from 42.19 to 50.78 and 1-NNA from 70.02 to 56.35, achieving even larger gains than the default zyx ordering. DFS also maintains consistent improvements across all metrics. These results demonstrate that the effectiveness of SeedFACE is not tied to a particular serialization strategy. Regardless of the traversal order, the first face must still be predicted without preceding geometric context, supporting the generality of the identified initialization bottleneck.
Q2: Generalization to Conditional Mesh Generation.
We further conducted image-conditioned generation experiments on Objaverse using renderings of untextured gray meshes as conditions, together with a first-face perturbation study.
As the results shown, explicit seed-face modeling further improves COV from 50.98 to 54.43 and brings 1-NNA closer to the ideal 50% (53.81->51.90). Although MMD increases, this may reflect a trade-off between broader distribution coverage and nearest-neighbor matching fidelity. These results suggest that image conditioning provides useful geometric context but does not eliminate the benefits of explicit first-face modeling.
More importantly, we also present a visualization comparison in Appendix Figure 10, showing that slightly perturbing the first face while keeping the image condition unchanged can substantially alter subsequent generation, resulting in incomplete geometry or deviations from the intended object structure. This further demonstrates that first-face initialization remains influential even with global visual guidance, rather than being a challenge exclusive to unconditional generation.