- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes FOMO, a training-free pipeline that builds a 3D scene from a single image. For each object, an occlusion-aware generator such as SAM3D gives a coarse mesh and its active voxels. An image editor then turns the mesh rendering and the scene image into a complete object image. TRELLIS or TRELLIS.2 takes the transferred voxels and this image and only synthesizes the local features. For layout, the method keeps the upstream rotation and fits scale and translation from 2D box edges and mean visible depth. Experiments show better object fidelity.
Critical strengths
The motivation is intuitive. SAM3D completes hidden parts but smooths details, while TRELLIS.2 keeps details but breaks under occlusion. Using voxel coordinates as the handoff between two pretrained models is efficient and needs no training or feature alignment. Fixing rotation and fitting only scale and translation keeps calibration cheap. It helps all eight generators and stays stable.
Critical weaknesses
-
It is not clear that the voxel structure is what carries the occlusion awareness, because Seedream also fills in hidden parts in image space. The gain seems to come from a closed commercial editor, which also hurts reproducibility. The paper also does not say what happens when the edited image disagrees with the voxels.
-
The core mechanism is closer to existing works than the framework suggests. What passes between the models is a plain occupancy grid on the same 64³ lattice, and TRELLIS itself builds this grid by voxelizing meshes. The TRELLIS paper also already regenerates local details on a fixed coarse structure. So any generator's mesh could be voxelized and refined in the same way, and the paper does not show what the claimed latent compatibility adds over this simple pipeline.
Questions for authors
- How much of the gain remains if Seedream is replaced by an open-source editor? How often does the edited image disagree with the transferred voxels? The editor prompt also asks Seedream to add realistic surface detail, so the fine details may already be in the edited image. What happens if SAM3D keeps its own voxels and its own second stage but receives the same edited image? If this comes close to FOMO, the gain comes from a better input image rather than from combining two models.