At a high-level, I see two primary critical weaknesses of this work, that each repeat throughout the manuscript. For each, I include specific examples.
W1. Lack of and misrepresentation of novelty. The key contributions have very high overlap with existing work, and many of the claims of novelty stem either from under-representing existing works, or over-representing the work presented in this paper. Specifically:
W1a. Generalization to more VAEs. The first bullet-pointed contribution mentions showing a color subspace's existence in a variety of models (5), when in fact it has already been shown in a variety of models (SD in [1]; FLUX, SD3.5, FLUX.2, Qwen-Image in [2]). The discussion of which models have already been tested also reports [2] as only showing results for FLUX, when in fact, the paper includes 3 more models.
W1b. Misrepresentation of the Encoder Experiments. I find the analysis results to be misleading in terms of explanation of what they mean (section 3.2). First, it is claimed that the linear approximation of the VAE will show why color is readable from the latent channels, but the experiment is closer to showing how, aka the path from image to the latent. Furthermore, in the last sentence, it is indicated that this experiment should verify that the structure originates in the encoder, but I find it unclear why this must be verified, as the encoder is the only place it could have originated (as this is the only component between the image and the latent). If the authors see an alternative, this should be stated explicitly, as it is non-obvious, and it is otherwise unclear why this experiment provides new insights.
W1c. Overrepresentation of the Applications. The proposal of several applications is a claimed contribution, but quantitative results are only presented on numerical color precision, with minimal qualitative examples and no quantitative measurements of how accurately this method applies to color transfer or saturation control.
W1d. Unclear how Insights Differ from Previous Work. While the paper claims novelty from new insights, I find several of the insights to be fundamentally the same as what was shown in previous work. 1) The work claims that some fine-grained details are also encoded in the color channels (section 3.1), because the details change when Δz is large. However, growing z infinitely will eventually push the latent out of distribution, so it is unclear if the artifacts are because other details are encoded on the channels, or the latent is simply OOD. [2] also claimed that modifications should be controlled. 2) [1] already indicated that color directions are close to channels, and the final finding here is also that they are not perfectly aligned is also the finding in [2].
W1e. Writing Overclaims Contributions. In addition to the details described above, the abstract reads like the key findings of other papers were discovered in this work (In this work, we show that the VAEs of text-to-image models share a color subspace aligned with brightness and opponent-colors. Through a linear approximation of the encoder and targeted latent steering, we find this subspace consistently across a broad range of VAEs). The title has a similar problem, implying claim over existing discoveries rather than what is novel to this work.
W1f. Overclaiming the Contribution on Real Images. The work claims that analysis on real images was not done before, and is instead a novelty of this work. However, both [1] and [2] verified the findings on real images, providing no true novelty from the real images used here.
W2. Insufficient comparisons. The results presented are missing many important pieces of information to properly assess if this method is better than SOTA color-modification methods, let alone how if fully compares to them. Specifically:
W2a. Missing Key SOTA Comparison. Although [2] was cited as a heavily related method, it is never compared quantitatively or qualitatively. This is especially problematic given the methodological overlap (see W1), with only small implementation details differentiating the two (how to find the directions, how far to go). There are also several key ways in which this work is disadvantageous compared to [2], including requiring additional training per-color, requiring an extra model (SAM), using a simplified color modification strategy which causes the loss of texture (see Figure 5, elephants), issues that were addressed in [2]. For these reasons, it is especially important that the method provided here shows advantages, to justify the disadvantages.
W2b. Other Missing SOTA Methods. Other key methods are missing as well, including ColorPeel [3] and best of N (a strong baseline, given that color modification methods are somewhat limited).
W2c. Missing baselines. The baseline compared to in this work is giving the model the hex code--this may over-exaggerate the problem in the base model, given that they understand natural language better than codes, and that the method presented here also modifies the prompt to the color name. It would be important to also compare to the out-of-the-box model with the color name.
W2d. Missing non-color comparison. It is important to also understand how much the method modifies non-color attributes, and if there are any other impacts on the images (like changes to diversity). Hence, it would be important to also compare other metrics like structural similarity (e.g. IoU, SSIM, LPIPS), diversity (e.g. pairwise DiNOv2 score), and image quality (e.g. Aesthetics score).
W2e. Weak results. While the method improves upon the currently compared-to methods on CSS3/X11, poor performance on ISCC-L3 shows a lack of generalization.
W2f. Inaccurate Linear Representations. As discussed in the last paragraph in section 3.2, the reliability of the linear approximations to the VAE relies on accuracy. However, Table 2 shows that they typically only explain about 75% of the energy within the network, leaving about 1/4 unaccounted for.
References:
[1] Color in coding in the latent space of stable diffusion models, Arias et al, Color and Imaging Conference Final Program'25.
[2] The latent color subspace, Pach et al, ICML'26.
[3] Colorpeel: Color prompt learning with diffusion models via color and shape disentanglement. Butt et al, ECCV'24.