- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
ReVision repurposes a frozen image generator for dense visual perception through input-conditioned parameter generation. A frozen Qwen3.5-9B model encodes the reference image and instruction, and a query-based hypernetwork generates rank-16 LoRA factors for 112 injection sites in a frozen FLUX.2-klein-base-9B generator. These updates are generated once per sample and remain fixed throughout denoising. Only the hypernetwork is trained, using a flow-matching objective and RGB-encoded targets for semantic, instance, and referring segmentation, depth, and surface normals.
Critical strengths
-
A coherent approach to input-conditioned adaptation of generative perception models. The design combines multimodal understanding with low-rank parameter generation while preserving both pretrained backbones. Generating updates once per input provides a concrete mechanism for conditioning the predictor beyond a fixed task adapter, without requiring per-example optimization at inference.
-
Broad empirical evaluation with useful within-backbone comparisons. The paper evaluates five perception tasks and includes both task-specific and shared multi-task LoRA baselines using the same image generator. Improvements are particularly substantial in several geometry settings: for example, NYUv2 depth AbsRel improves from 5.7/5.9 for the two LoRA baselines to 4.0. The condition-routing ablations also provide evidence that the learned parameter generator uses sample-specific information rather than merely producing an unconditional update.
Critical weaknesses
-
Unclear semantic-segmentation protocol. Appendix D states that Cityscapes prompts list the classes present in each image, but does not explain how these lists are obtained. If derived from ground truth, they provide privileged information that may make the 72.75 mIoU result incomparable with standard evaluations. Results using a fixed list of all 19 classes are needed.
-
Insufficient isolation of the proposed mechanism. ReVision adds a 918.3M-parameter hypernetwork and multimodal conditioning, without clearly matching baseline capacity or access to the same features. Thus, the gains cannot be confidently attributed to instance-specific weight generation. The gradient analysis also does not directly measure conflict in the shared hypernetwork, and latency/memory costs remain unquantified.
Questions for authors
-
Cityscapes protocol: How are the per-image class lists constructed? Are any ground-truth annotations used? Please report results with a fixed prompt containing all 19 classes and clarify whether the external baselines receive equivalent category information.
-
Can you measure cross-task gradient interactions in the shared hypernetwork parameters and compare them with a static multi-task model under matched samples and noise? How should the current gradients with respect to sample-dependent LoRA factors be interpreted as evidence about shared-parameter optimization?
-
Evaluation and computational cost: Please specify the subsets and settings behind Table 6, whose reference results differ from the main tables, and explain Qwen’s instance-existence role and the instance-palette decoding procedure on SA-Co/Gold. What are the end-to-end latency, peak memory, and training cost relative to the static-LoRA alternatives?