- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper extends GaussianGPT with semantic prediction. A semantic head reads the hidden state after each feature token. It is trained jointly with next-token prediction. The authors also construct composed Gaussian scenes and add direct attribute supervision to the tokenizer. The model supports scene generation, completion, and semantic labeling.
Critical strengths
- The motivation for preserving occluded surfaces is clear. Rendering losses alone provide weak supervision for these regions.
- The data construction pipeline provides complete furniture assets with semantic labels.
- The reported improvements are substantial. The semantic baselines are also fine-tuned on the proposed data.
Critical weaknesses
- The contribution is incremental. The overall backbone largely follow GaussianGPT. The main addition of network is a two-layer semantic head.
- The contribution of semantic learning to generation is not clear. Table 4 reports validation cross-entropy of 2.213 with semantic supervision and 2.221 without it.
Questions for authors
1.Does semantic supervision improve generation metrics when the data and tokenizer are fixed? 2. How are separate instances recovered when nearby objects share a category 3. How accurate are the semantic labels on freely generated scenes?