- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper explores ReChannel, a more efficient approach for adapting the existing text-to-image (T2I) model FLUX to dense prediction tasks without using a VAE decoder or training an additional decoder. ReChannel retains the VAE encoder on the input side, adapts the FLUX-Klein backbone using task-specific LoRA, and replaces the VAE decoding process on the output side with a shared, token-local linear projection layer. By mapping each token to a pixel patch corresponding to the target task and assembling these patches into the final prediction, the method enables loss computation directly in pixel space. The proposed approach achieves competitive performance and faster inference on tasks such as depth estimation, normal estimation, and image matting.
Critical strengths
The proposed ReChannel method demonstrates good generalizability while improving the efficiency of dense prediction tasks. Since adaptation for each task is performed independently, the method effectively extends the applicability of a single pretrained generative model to a broader range of tasks. The results demonstrate that competitive performance can be achieved without relying on a task-specific spatial decoder.
For the 4B-parameter model, the proposed method significantly outperforms approaches based on latent targets and pixel-supervised frozen VAE decoding in both accuracy and inference speed on the image matting task. These results demonstrate that ReChannel is better suited for tasks requiring fine-grained predictions.
Critical weaknesses
The 33K parameters emphasized in the abstract apply only to single-channel tasks, rather than to the prediction heads of all tasks. Furthermore, this number does not include the parameters introduced by LoRA. The paper does not provide a complete breakdown of the total number of trainable parameters.
The proposed method essentially follows the paradigm of combining a pretrained backbone, task-specific adaptation, and a linear prediction head, which has already been widely explored in computer vision. The main contribution is therefore the application of this established design paradigm to FLUX-Klein. However, the paper does not sufficiently demonstrate whether the observed performance improvements primarily come from the stronger backbone rather than the ReChannel design itself. In particular, compared with Edit2Perc in Table 1, which uses FLUX.1, the FLUX-Klein backbone employed in this work may already provide inherent performance advantages.
The ablation results in Table 5 show that the Frozen + Linear Head configuration performs poorly, indicating that the pretrained generative model cannot directly solve the target tasks through a simple linear projection without task-specific adaptation. The use of LoRA therefore appears to be essential. However, this observation also weakens the authors' central intuition that the pretrained token field already contains task-relevant information that can be directly read out.
Questions for authors
Could the authors provide a complete comparison of the actual number of trainable parameters? If experiments with different LoRA configurations have been conducted, could the authors also report the parameter counts and corresponding performance for these configurations?
Given that the final predictions are obtained by adapting spatial features through LoRA and mapping them to pixel values using a linear head, why is a generative DiT backbone necessary? Could a DINOv3 + LoRA + Linear Readout configuration achieve comparable performance?