- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This work proposes a method called PBRSense for single-image prediction of albedo, metallic, roughness, and surface normals. Specifically, PBRSense is a pretrained VLM-conditioned image edirot. It uses a shared backbone with attribute-specific prompts, selectively fine-tunes a subset of DiT blocks, and adopts an endpoint velocity objective for single-step prediction. Lightweight cross-attribute communication modules provide additional refinement. The predicted material maps are also used to guide a frozen 3D material generator.
Critical strengths
-
The writing of this manuscript is good and easy to follow. For example, the descriptions of the proposed method are clear.
-
PBRSense outperforms the evaluated baselines on the combined DTC and PolyHaven-315 evaluation for albedo, metallic, roughness, and surface normals.
-
Using PBRSense predictions to guide a frozen 3D material generator reduces material errors in both input and novel views under the evaluated setting. This strengthens the practical significance of the work by showing that the predicted maps benefit a downstream application beyond standalone 2D benchmarks.
Critical weaknesses
-
The core idea of the proposed PBRSense mainly adapts an existing image editing model through attribute-specific prompts, selective fine-tuning, and single-step training. However, the architectural addition, cross-attribute communication, is not very new in generation tasks. In addition, the main architectural addition, cross-attribute communication, provides relatively modest gains over the adapted backbone (Table 1). Thus, the proposed PBRSense has limited methodological novelty.
-
In this work, all experiments use the pre-trained FireRed-Image-Edit-1.1. However, it is not clear whether the proposed adaptation strategy generalizes to other image editing models or whether the strong results depend heavily on this particular pre-trained model. The proposed adaptation strategy should be plug-and-play.
-
The layer-selection study and detailed communication-structure ablations use a 4,000-step training budget, whereas the main results use 20,000 steps. This weakens the evidence supporting the specific design choices, particularly because several reported differences are small and their stability across training runs is not established.
Questions for authors
-
Table 2 compares selective and full fine-tuning at 4,000 steps. Does the same conclusion hold at the full 20,000-step training budget? In addition, what is the effect of single-step training compared with retaining the original multi-step training objective?
-
Do you have evidence that the proposed adaptation strategy is effective with another pre-trained image editing model? Such evidence would materially strengthen the claim that the framework offers insights beyond adapting FireRed specifically.
-
Do the preferred fine-tuning layer range and communication structure remain preferable at the full 20,000-step training budget? Are the relatively small gains from communication consistent across independent training runs?
-
What are the inference latency and peak GPU memory usage of PBRSense at 1024 × 1024 resolution when predicting all attributes, and how do they compare with the strongest baselines on the same hardware?