- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper introduces a reinforcement-learning framework that uses assembly-level physical rewards to shift stability enforcement from costly test-time correction to training-time optimization for efficient, rollback-free brick generation.
Critical strengths
- The paper is well written.
- The paper demonstrates strong empirical performance.
Critical weaknesses
-
The novelty of this work appears limited. While the paper emphasizes “rollback-free brick generation” as its core contribution, this property emerges naturally from reinforcement-learning policy optimization and finds counterparts in other autoregressive generation tasks. It does not seem to stem from task-specific insights or methodological innovations designed for brick generation. Rather, the main contribution consists of adapting an existing reinforcement-learning framework to this target task.
-
The method aggregates multiple reward terms via a simple weighted sum. However, these rewards can differ markedly in optimization difficulty, magnitude, and convergence behavior, and some objectives may even conflict, leading to unfavorable optimization trade-offs. More principled mechanisms for balancing and combining multi-objective rewards are therefore recommended, instead of naive weighted summation.
-
Figure 5 mainly presents training reward curves, rather than physical stability metrics measured on a held-out test set. While these curves verify that the model optimizes the predefined reward signals, they are inadequate to demonstrate that the model learns generalizable physical principles.
Questions for authors
See weakness