- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper addresses image-conditioned texturing of 3D meshes with very complex appearance (text, plaid, ornaments). Ink3D takes geometry from an off-the-shelf 3D generator and fine-tunes Wan-2.2-14B into OrbitPainter, which generates orbit-scan videos conditioned on the reference image and rendered normal and position videos. A geometry-aware sparse attention restricts attention to tokens at nearby 3D locations. TextureOptimizer then bakes the frames onto the mesh with MRF-based view selection and refines the result with the TRELLIS.2 VAE and a few denoising steps. On 85 TexVerse meshes with generated reference images, Ink3D beats Paint3D, TEXGen, SeqTex and TRELLIS.2 on front-view FID, CLIP-FID, LPIPS and CLIP-I. Ablations cover geometry conditions, attention, video resolution and frame count, baking strategy, trajectory and refinement noise.
Critical strengths
- Most design choices are backed by ablations (geometry conditions, sparse attention, video resolution and frame count, baking strategy, orbit trajectory, refinement noise). Readers can see what each component contributes, which makes the pipeline credible as engineering.
- The baking design is practical. Graph-cut view selection avoids blurry averaging, and mild TRELLIS.2 denoising fixes color bleeding without retraining. It is modular and training-free, and Table 4 shows clear gains over averaging and differentiable-rendering baking.
Critical weaknesses
- Limited novelty. The method combines existing pieces: a fine-tuned video model for geometry-conditioned multi-view painting (SeqTex already textures meshes with a video model, and Hunyuan3D-Paint and Step1X-3D do geometry-conditioned painting), a 3D-proximity sparse attention, and MRF view selection followed by TRELLIS.2 refinement. Each piece is incremental, and the paper does not give a new insight beyond the combination.
- The evaluation does not fully support the claims. The main Table 1 compares front-view renders against the conditioning reference image, so it largely rewards reproducing the input view, while the claim is about quality across views. The multi-view protocol appears only in the appendix.
- The metrics are FID and CLIP-FID on 85 images with no seeds, variance, significance tests or user study, yet the text says significantly outperforms. The strongest geometry-conditioned painters (Hunyuan3D-2.1 Paint, Step1X-3D) appear only in appendix Table 5, where the margin is smaller (FID 144.1 vs 153.9) and HY3D-Paint wins CLIP-I. The references are synthetic edits, and real photos are only shown qualitatively. Table 3 also does not clearly support the claim that too few frames degrade quality (41 frames has better LPIPS and CLIP-I than the 61-frame default).
Questions for authors
- What are the Table 1 results under the appendix multi-view protocol for all baselines, including TRELLIS.2, TEXGen, SeqTex and Paint3D, with variance over seeds? This would show whether the gains hold beyond the conditioning view.
- How much does TRELLIS.2 refinement alone contribute? Please give a quantitative ablation of MRF-only, refinement-only (on average-baked voxels) and both, to separate the video prior's contribution from TRELLIS.2's native 3D prior.