- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper introduces a high-quality dichotomous image segmentation (DIS) method with two complementary conditioning sources. Language-Point Dual Prompting (LPDP) uses language and point prompt guidance in order to specify the segmentation target. This provides additional clues to the model when the intended foreground target is ambiguous in the input image. The Detail-Reference Token Injection (DRTI) conditions the velocity predictor network on multi-scale image residuals in order to improve the preservation of fine structures in the segmentation masks. Experiments on DIS5K report higher segmentation scores than previous state-of-the-art methods.
Critical strengths
- Integrating language and point dual prompting capability into high quality DIS is well-motivated, as in some cases the desired result can not be achieved without a prompt, or with only a language prompt.
Critical weaknesses
-
The motivation behind detail-reference token injection is not apparent. It seems that the image details would be lost after pooling the residuals to 8x8. Therefore, it’s unclear how the tokens derived from these 8x8 residual representations should help to preserve the segmentation details.
-
The writing quality of the paper is poor. The entire method section is hard or impossible to understand. It looks overly AI-generated without much human effort. For example, on line 225 it is not clear how each band is normalized and what the pooling operation is. In equation (8) I don’t understand what the channel-mixing operator A is, as it is never defined in the paper. In equation (9) I don’t understand what the vec is. In addition, the implementation details are mixed with the proposed method making it harder to understand the contribution of this work.
-
The ablation study in Table 4 is not clear. The paper does not explain the experiment settings for “No refinement”, “VAE enc. feats”, “DRTI feats.” and “DRTI (in latent)”. This makes it impossible to evaluate the true effectiveness of the proposed DRTI.
Questions for authors
-
What motivates using average pooling followed by bilinear upsampling in the multi-scale residual descriptor computation, rather than simple Gaussian smoothing?
-
How do the authors obtain the mask probability map from VAE-decoded results for the BCE calculation during the training?
-
It appears that 4 sampling steps were used for the quantitative and qualitative comparisons. Have the authors compared 1 step results?
-
Do you use the base or distilled variants of FLUX.2 [klein] for the experiments?
-
Citation formatting is inconsistent throughout the manuscript. Please follow the ICLR recommendation of using the parenthesis style where applicable.