- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The core question addressed by this paper is how to preserve within-class variation during digital pathology image generation. The paper used a method called Feature-Informed Residual Modulation framework. The propoed framework adds image features as conditions, and further decomposes these image features to inter-class, inner-class (including one discrete morphology mode and one residual morphology) modes.
The proposed FIRM framework is built upon three things:
- A fronzen generic image generator G0, whose backbone is FLUX, is trained to generate a general pathology image.
- An pre-defined orthogonal feature space is computed with directions of diagnostic axis B and a morphology axis P. Then UNI-h features m are projected into these two directions. Additionally, for each morphology vector, the model decompose it into mode (categorical) and continuous features.
- Gated LoRA modules are then finetuned upon G0 using features computed from step 2.
Experiment-wise, the paper compared FIRM with FLUX, LDM, PixCell methods, and showed improved FID, KID, and Coverage with these methods. Especially, Figure 5 showed that the method generate images more similar to the original image manifold.
Critical strengths
-
The question discussed in this paper is meaninful and interesting. The motivation is well-defined, and the limitation for class-conditioned pathology generation is real.
-
The conditioning mechanism, although convolutedly written, is technically conherent and interpretable. And the continouse controlling of the generated image is interesting.
-
The experiments are comprehensive, including useful ablations and downstream classification tasks showing the utility of the generated images.
Critical weaknesses
-
The term “morphology” is used too generic and is not sufficiently validated. For example, in Figure 7(a), changes induced by switching the discrete mode appear to involve substantial intensity variation, rather than obvious morphological changes. I am not necessarily opposed to using “morphology” as an umbrella term for non-diagnostic variation, potentially including both biological morphology and acquisition-related factors such as scanner or site effects. However, doing so actually weakens the interpretation of the imposed orthogonality constraint between B and P. Additionally, morphology itself is often diagnostic, while nuisance variation may also occupy the residual subspace. The paper would therefore benefit from stronger semantic validation of what the learned morphology dimensions actually represent.
-
One of the most interesting contributions of the paper is the decomposition of UNI2-h features into inter-class diagnostic directions, discrete within-class modes, and continuous residual variation. The subsequent use of these quantities to condition a generative model feels somewhat downstream of this representation analysis. If the proposed geometry indeed captures meaningful diagnostic and within-class structure, its quality should arguably be demonstrable directly in feature space, independently of the generator. For example, the authors could evaluate how informative the diagnostic coordinates q_y, morphology coordinates s_i, or their combination are for classification, class separation, or other downstream tasks. This would help clarify whether the contribution comes primarily from discovering meaningful structure in the pathology representation or from the generative modeling architecture built on top of it. A direct evaluation of using decomposed feature representation for classification similar as Table 4 would be useful.
-
Following 2, the proposed decomposition depends heavily on the UNI2-h feature space, but the choice of encoder is not sufficiently justified. As a result, the proposed decomposition may reflect properties specific to UNI2-h rather than a general structure of pathology images.
Questions for authors
-
How do the authors validate that the subspace P specifically represents morphology?
-
Why was UNI2-h selected to construct the diagnostic and morphological geometry? Have the authors performed any comparative analysis among different foundation model features?
-
Can the authors evaluate the proposed decomposition directly, without the generative model? For example, how well do q_y and s_i, or their combination perform in predicting diagnostic labels or separating diagnostic categories?
-
An important ablation appears to be missing: directly conditioning the generator on the original UNI2-h features without the proposed decomposition.
-
[Nit] The feature-space overlap shown in Figure 5 is partly expected from the design of FIRM because it uses real image features as conditions.