[W1] Limited Justification for Using Flow Matching
In the submitted paper, I could not find a clear justification for (i) what makes the class-contrastive objective in TaskRel specifically tailored to flow matching, and (ii) why flow matching is particularly advantageous for synthetic data generation.
The paper motivates its use of flow matching by pointing to the availability of a known target velocity (lines 65–68). However, conventional diffusion training also regresses toward a known target, such as the added noise ϵ [1] or a v-prediction target [2], and closely related comparisons of class-conditional errors on a shared noisy input are already used by Diffusion Classifier [3] and MBTI [4] with conventional denoising diffusion models. As a result, it is unclear which part of TaskRel relies on flow matching. Given the shared LoRA adaptation used in DataDream and the class comparisons already explored in prior work, the additional methodological contribution of TaskRel remains unclear.
Furthermore, the paper does not explain why a flow-matching generator is a better choice for synthetic data generation than conventional diffusion models such as Stable Diffusion (SD) 2.1 [5], on which prior methods, including DataDream, LoFT, and ChimeraLoRA, were developed. In addition, although the baselines are ported to SD 3.5 Medium to enable a common-backbone comparison, they were originally developed for conventional diffusion models. Even though the matched control supports the benefit of class-contrastive training on SD 3.5, it does not resolve concerns about the comparison with the ported external methods. This makes it difficult to determine whether the advantage of TaskRel over the external baselines reflects the proposed method itself or differences in how well the compared methods transfer to SD 3.5.
Finally, the evaluation is limited to SD 3.5 Medium, as mentioned in Section F.2. Consequently, the evaluation establishes neither whether TaskRel is particularly suited to flow matching nor whether its benefits generalize across flow-matching generators.
[W2] Concerns about Experimental Comparability
First of all, the paper provides limited justification for using a randomly initialized classifier as the primary evaluation setting. In a few-shot setting, strong representations from pre-trained models such as CLIP and ImageNet pre-trained ResNet are available, and prior synthetic-data generation methods such as DataDream, LoFT, and ChimeraLoRA primarily evaluate whether generated data can improve such pre-trained models. In contrast, the main results in this paper use a ResNet-50 trained from scratch. While this setting may help isolate the information contained in the generated dataset, the paper does not clearly explain why pre-trained representations are excluded from the primary evaluation, especially in a setting motivated by data scarcity. Although Tables 3 and 8 include pre-trained classifiers, the CLIP comparison (Table 3) includes only LoFT and the matched FM control and omits a real-only baseline, and the pre-trained ResNet-50 comparison (Table 8) includes no external method. This leaves the benefit over real-only few-shot adaptation and the ranking against the other external methods unclear in the pre-trained setting.
Next, the methods differ substantially in their adapter configurations and training procedures, but neither model capacity nor computational cost is fully accounted for in the comparison. TaskRel applies rank-16 LoRA to both the transformer and two CLIP text encoders (CLIP-L and CLIP-G in SD 3.5), whereas the ported LoFT and ChimeraLoRA keep the text encoders frozen. At the same time, ChimeraLoRA uses multiple instance-specific LoRA heads, so the overall parameter budget is not obvious from the reported ranks alone. Furthermore, parameter counts alone do not capture adaptation cost, since TaskRel requires additional computation for class comparisons and relation-map construction. Table 16 estimates the adaptation time for TaskRel at approximately 4.8–5.5 times that of the 50-epoch FM control, but corresponding costs for the external baselines are not provided. The same table also includes a compute-matched FM control, though only on Pets and EuroSAT. On EuroSAT, it closes most of the gap to TaskRel. On Pets, extending the same FM training recipe lowers test accuracy, leaving open whether a better-tuned recipe could use the same computational budget more effectively. Reporting total trainable parameter counts and adaptation time on the same hardware, together with compute-matched comparisons against external baselines, would clarify whether the accuracy gains persist at comparable computational cost.
Moreover, several baselines are evaluated far from their original operating regimes. For example, DataDream was originally trained substantially longer and evaluated with 500 synthetic images per class. LoFT similarly evaluates 500 images per class and uses substantially longer per-image adaptation. ChimeraLoRA was primarily developed under a 4-shot, 500-synthetic-image setting. In contrast, the main comparison here uses 16 real images and only 100 synthetic images per class, while also shortening the adaptation schedules of these baselines. The authors justify these schedules by matching total support-image exposure across methods, as discussed in Section C.2. However, equal exposure does not establish that the shortened schedules provide sufficient training for each method. Since Table 4 shows substantial accuracy changes across synthetic-data budgets, it is unclear whether the reported ranking persists under their established settings.
Finally, the evaluation coverage is narrower than that of prior work. The six datasets considered in this paper include several fine-grained benchmarks, but the main experiments are restricted to a uniform 16-shot setting. (A separate five-shot study is reported on Pets in Table 13, but it does not establish robustness across shot counts and datasets.) Broader prior evaluations include substantially lower-shot and long-tail settings, as well as specialized domains such as medical images. Consequently, it remains unclear whether the gains extend consistently to lower-shot settings, long-tailed class distributions, or specialized domains.
[1] Denoising Diffusion Probabilistic Models (NeurIPS 2020; Ho et al.)
[2] Progressive Distillation for Fast Sampling of Diffusion Models (ICLR 2022; Salimans and Ho)
[3] Your Diffusion Model is Secretly a Zero-Shot Classifier (ICCV 2023; Li et al.)
[4] MBTI: Metric-Based Textual Inversion for Fine-Grained Image Generation (WACV 2026; Chae et al.)
[5] High-Resolution Image Synthesis with Latent Diffusion Models (CVPR 2022; Rombach et al.)
W1/Q3. What does each component do, and why 0.03?
The components control different parts of class-relative supervision. Shared corruption and target make class condition the comparison variable. The hinge requires a true-class error advantage and contributes zero once the current gap meets the margin. The relation map chooses the three competitors. The coefficient sets their influence on positive fitting. Generation then uses the ordinary sampler.
At fixed hinge, margin, comparison count and coefficient, the four-domain mean is 54.18% for FM, 57.48% for uniform competitors, 58.27% for frozen soft and 58.68% for refreshed soft. The independent EuroSAT comparison gives refreshed 68.638±0.215% and frozen 67.605±1.267%, three students per pool. Allocation adds to the main comparison effect.
The fixed-state optimizer diagnostic isolates loss scale. Across 32 identical evaluation batches, raw NLL's median gradient norm is 147.90 times the unit-weight hinge's, triggering clipping in 32 versus 3 batches. Generator-derived NLL scaling reduces clipping to 5 batches. The final scheduler rule c=E[σ2] is a separate calibration against the positive loss's mean weight.
The factor 0.03 sets m=0.03median(ey), a dimensionless fraction of warm-up fitting error. It is a margin multiplier, not a class-sampling multiplier. Changing it changes the active comparisons. We tested half and twice the default with supports, warm-up, graph, horizon and synthesis fixed, using 100 images/class.
All tested margins outperform matched FM at all three student seeds. The benefit survives a factor-of-two change in either direction, and 0.06 adds 5.32 points over the default without extra updates or images. The submitted default remains unchanged. SD describes student variation on fixed generated pools.
Q1/W2. Distinctness, diversity and the weaker domains
We tested discrimination directly on 148 held-out Pets images and 40 EuroSAT images, with all conditions and four shared corruptions per image. Minimum-average-error class accuracy rises 58.11→67.57% and 47.50→65.00%, with hinge activity falling 25.89/25.76 points. The gain extends beyond the supports.
The image audit covers all 396 classes and 100 generated images/class. Entries below are FM→TaskRel class averages. Agreement uses frozen CLIP. P/R/C use DINOv2-L precision/recall/coverage at k=5 against held-out real images [1].
Four domains improve agreement, precision and coverage. Aircraft additionally improves unbiased polynomial-kernel MMD² from 3.406 to 2.966. Downstream recall improves on 76/100 Aircraft and 38/47 DTD classes across three students.
Caltech/Flowers have weaker feature alignment and lower recall. Caltech's synthetic dispersion rises 0.322→0.338, so reduced diversity alone cannot explain every result. TaskRel still improves scratch accuracy over matched FM by 0.257/1.868 points there. With pretrained CLIP, its 96.47%/96.75% exceeds every compared synthetic source on both domains. Feature geometry and classifier utility measure distinct properties.
The accompanying fixed-selection panels cover all six domains, including Caltech and Flowers. Two classes per domain and a common within-class synthetic index were selected with seed 91023, independently of performance. Distributional conclusions use the all-class metrics.
Q2/W2. Cost and external methods
Calibrated FM-50/TaskRel adaptation hours are 1.504/8.284 on Pets and 0.415/1.978 on EuroSAT, including probing. FM extended to those budgets gives scratch accuracy 60.898/68.786%, versus TaskRel's 66.485/69.321%. Pets FM-50 is stronger at 65.595% and remains the relevant comparator. These are fixed terminal points.
Both methods generate at 1.484–1.487 s/image and 16.46 GiB, batch 2, 24 steps and CFG 2, excluding loading/writing. Extra adaptation is paid once, and pools are reused across learners. EuroSAT banks contain 15.811M learned parameters for FM/TaskRel, 187.761M for LoFT and 199.496M for Chimera, counting shared factors once. These are bank sizes, not active capacity or time. Comparable isolated LoFT/Chimera timings are unavailable. Shared-server times are excluded from the calibrated profiles. External rankings concern the disclosed SD3.5 recipes.
Reference
[1] M. F. Naeem et al. Reliable Fidelity and Diversity Metrics for Generative Models. ICML, 2020.