- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Gate3DGen is a preprocessing framework for improving single-image 3D generation from degraded photographs. It combines a degradation-aware router with a one-step image purifier, while keeping downstream 3D generators frozen. The authors construct synthetic paired training data and evaluate image restoration and downstream 3D quality using two generators, supplemented by real-image evaluations. Although the application is relevant and the purifier shows promising results, the evidence does not sufficiently establish the effectiveness of the selective routing mechanism or the proposed 3D-oriented spatial constraints.
Critical strengths
- Relevant practical problem. Improving robustness to occlusions, blur, and uneven illumination addresses an important limitation of single-image 3D generation. Preprocessing inputs without retraining downstream generators is a practical approach.
- Encouraging synthetic-benchmark results. The purifier improves several geometry and appearance metrics over degraded inputs, including a substantial reduction in mesh distance on TRELLIS.2.
Critical weaknesses
- The central claim of selective purification is not validated end to end. Section 4.1 explicitly states that all degraded inputs are purified and routing decisions do not affect the main reconstruction results. These experiments therefore establish the utility of the purifier, but not the benefit of the complete gated system. Moreover, on real photographs, the router achieves 58.33% accuracy, matching the trivial strategy of always predicting PURIFY under the proxy-label protocol. This is a substantial gap for a method whose central motivation is deciding when to intervene.
- The ablations provide weak support for the proposed spatial constraints. In Table 5, adding spatial losses worsens MD from 0.755 to 0.764 and lowers 2D PSNR, while providing no improvement in the reported F1 metrics. The improvements in shaded and albedo LPIPS are only 0.0004 and 0.0002, respectively, without uncertainty estimates. These results do not convincingly support the claim that the spatial constraints better preserve the geometric cues needed for downstream reconstruction.
- The methodological contribution is insufficiently separated from task-specific fine-tuning. The purifier is initialized from an existing image-editing model and trained with standard latent, photometric, perceptual, region-weighted, and edge objectives. No direct 3D supervision or gradient through the downstream generator is used. This does not invalidate the approach, but makes controlled comparisons particularly important. The main baselines are general-purpose editors, and the paper lacks a comparably trained restoration baseline using the same paired data and training budget. Consequently, it remains unclear how much of the improvement comes from the proposed design rather than adaptation to the training distribution.
- Real-world evidence does not adequately establish the claimed robustness. The real-image evaluation contains only 96 photographs and relies on VLM judgments, proxy routing labels, and human preferences without ground-truth geometry. The human study reports 341 valid ratings, but the allocation across comparisons, participant details, and uncertainty estimates are insufficiently specified. Furthermore, the method does not lead the VLM asset-quality scores, and the reported FD-DINOv2 results do not improve over unedited inputs. These outcomes warrant a more limited conclusion about real-world benefits.
- The efficiency motivation lacks measured support. A single purifier evaluation does not by itself establish low end-to-end cost, since the pipeline also includes a VLM router and feature extraction. Without latency and memory measurements for the complete system, the practical benefits of one-step purification and selective bypass remain unsubstantiated.
Questions for authors
- On a mixed set of clean and degraded inputs, how does the complete gated pipeline compare with always purifying and never purifying in downstream 3D quality? Are such results available for real photographs?
- What evidence supports the necessity of the spatial losses given the results in Table 5? Are the small rendering improvements consistent across runs, and is the claimed improvement in contour preservation quantitatively measured?
- Is there a baseline trained on the same paired data with a comparable parameter budget and standard restoration objectives? Such a comparison is needed to distinguish the contribution of the proposed architecture and conditioning from task-specific training.
- How are identity, geometry, and viewpoint consistency verified when generating degraded training pairs with image editors? Please specify the synthesis models, filtering criteria, and any manual validation of the resulting pairs.
- What are the measured end-to-end latency and peak memory usage, including routing and purification? For the human study, how many independent participants and comparisons support each reported preference rate?