- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The paper addresses inverse rendering, i.e., decomposing an image into intrinsic properties such as appearance, illumination, geometry, and material. Both the inverse and the forward rendering directions are obtained by fine-tuning Qwen-Image-Layered. In the inverse direction, the five intrinsic channels are denoised jointly within a single token sequence, so that the channels exchange information through attention; in the forward direction the roles are swapped and the RGB image is generated conditioned on the five intrinsic latents, with missing channels set to zero so that datasets with incomplete annotations can be used. Each direction uses its own rank-32 LoRA on a shared frozen backbone.
The core novelty claimed is the dual cycle: along the two reciprocal paths I→X’→I’ and X→I→X, the velocity predictions obtained from cycle-generated inputs are aligned with those obtained from real inputs. In practice, the output of the inverse pass is used as the condition of the forward pass, and the output of the forward pass as the condition of the inverse pass.
For validation, all quantitative evaluation is carried out on test subsets of three synthetic datasets. The metrics are PSNR/LPIPS for each channel (SSIM and RMSE additionally for albedo; mean angular error and the percentage of pixels within 11.25° for normals), together with PSNR/LPIPS of forward rendering from ground-truth intrinsics and of RGB reconstruction from predicted intrinsics (Table 1). The paper reports the best albedo results on all three datasets, “competitive” results on the other channels, and a lead across the board on MatrixCity.
Critical strengths
- A single base model carries both decomposition and rendering and can be trained on multiple datasets with heterogeneous annotations; the design is simple. The ablation shows that joint denoising improves consistently over per-channel prediction on all three attribute types: albedo +1.27 dB, irradiance +0.91 dB, normals −2.32° (Table 2, a→c).
Critical weaknesses
-
The model itself is a rather limited improvement over prior work, and the central claim has no direct evidence. The contribution of the dual cycle is marginal: the dual cycle designed in this paper improves albedo by only +0.07 dB over joint-only, and it is worse than the vanilla cycle inherited from Ouroboros in LPIPS and in RGB reconstruction. Once the dual cycle is removed, the only gain with evidence behind it comes from the multi-layer joint generation mechanism that the backbone already provides, not from a design specific to this paper.
-
The main comparison is unfair, and the results themselves are mixed. The model is trained on the training splits of the same three datasets used for testing (including 20K MatrixCity images), whereas the baselines are run from their official checkpoints; the real images are supervised with pseudo-labels produced by Ouroboros, which is then used as a baseline. Public baselines trained on exactly these two datasets, Marigold-IID and PRISM, are not included in the comparison. The large lead on MatrixCity (where all baselines have normal errors of 22 to 43°) looks more like because of in-domain training; on the two indoor datasets that the baselines may have seen, the method falls behind on normals (Hypersim 18.76° vs. 13.29°), on InteriorVerse roughness/metallic (14.95 vs. 16.20 and 17.18 vs. 19.74 dB), and on Hypersim RGB reconstruction (17.15 vs. 17.64 for RGB↔X). Table 1 therefore cannot serve as evidence for the claims of “competitive” performance and a “mutually compatible” representation, which directly determines my soundness score.
Questions for authors
-
On which datasets was each baseline’s official checkpoint trained? Please add baselines trained on the same data (Marigold-IID, PRISM, or Ouroboros/RGB↔X retrained on your 55K synthetic images); otherwise Table 1 cannot support the “competitive” conclusion.
-
What are the results without the real images pseudo-labeled by Ouroboros? How much of the improvement over Ouroboros on real images comes from distillation?
-
Why are the normals on Hypersim still 5.5° worse than Ouroboros despite training on Hypersim? Is the 22 to 43° normal error of all baselines on MatrixCity a convention mismatch?
-
Please measure cross-channel consistency directly, for example by reconstructing the input from the predicted intrinsics with a fixed physically based renderer, or with a leakage metric, rather than with each method’s own learned renderer.