- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Meta-Diff learns a source-to-target relation from several training tasks. A set encoder turns source images into a short vector called a task coordinate. A learned map predicts the target coordinate. A shared diffusion model then generates target images. For a new task, the main method uses source images and the known relation. It uses no target images and does not update model weights. The paper studies this method with Gaussian mixtures, CIFAR-100 image changes, and Office-Home domain transfer. It reports useful distribution changes and studies failures to preserve object identity.
Critical strengths
-
The problem is clearly set and the approach has practical motivations. The paper uses rich source data and cross-task shared source-target relationships to generate target domain samples without target image or backbone updates during deployment, providing a reasonable idea for scenarios where target data is extremely scarce.
-
Controlled experimental system with adequate failure analysis. The GMM experiment distinguishes task identifiability, relationship predictability and transmission benefits through multi-seed and full factorial designs; the authors also truthfully report semantic generation failures in the natural domain, which helps to understand the applicable boundaries of the method.
Critical weaknesses
-
The number-taking question is inconsistent with the final submitted question. The title when picking up the number was "Meta-Diffusion: Transferable Reverse-Dynamics Coordinates for Data-Asymmetric Generation", but the final PDF title was "Bridging the Data Gap: Source-Informed Task-Space Transport for Few-Shot Diffusion". The author needs to explain the change and check whether the title information of the submission system is consistent with that of the paper document; whether it involves procedural violations should be determined according to the specific rules of the conference.
-
There is insufficient evidence for method-independent contributions and semantic generation effects. The lack of a conditional diffusion baseline that also uses source support sets and relation identification, but does not explicitly transfer task coordinates, makes it difficult to determine the independent value of the transfer mechanism. In addition, the distance metric improvement has not been fully translated into semantic generation capabilities, for example, the Office-Home object recognition rate is only 1.67%, limiting the practical significance of the method.
Questions for authors
See weakness.
3 comments
This response didn't solve my problem, so I'll keep the score as it is.
We appreciate the reviewer's assessment. We would like to clarify the contribution established by the revised experiments. Our central question is whether source–target relationships learned across training tasks can support generation for unseen semantic tasks without target observations or adaptation. The results demonstrate source-specific distributional effects on held-out tasks and characterise when those effects depend on source identifiability, relation predictability and source–target discrepancy (Section 5.1, Figures 2–3; Sections 5.2–5.3).
The requested transport-free control provides an important additional finding: the benefits of source-informed joint training do not require the explicit affine map. We have incorporated this result into the paper and present affine transport as a compact target-coordinate parameterisation rather than an independently superior generator (Appendix I.1). The control retains the shared task-space framework, with its set encoder and source-informed joint training, and replaces only the affine parameterisation. The semantic diagnostics likewise distinguish information retained in the task representation from its expression in generated images. A new class-centroid analysis on DomainNet (Appendix I.7, Table 61) shows that class-specific source information is expressed in the generated distribution: in two frozen feature spaces, samples generated from the correct source align with the requested class more than samples from a wrong source or from the relation alone, on each of the three relations and with intervals that exclude zero. The effect is small (3.6% and 4.6% of the real-image alignment in the two feature spaces). These results clarify the scope and contribution of the framework while retaining the zero-target deployment setting and the experimentally demonstrated source-dependent transfer.
Regarding the title, the change was editorial, and the registered title and abstract have been updated to match the PDF.
Response to Reviewer mja4
W1: Title discrepancy
We thank the reviewer for raising this, and we acknowledge the change of title. The title registered with the abstract was “Meta-Diffusion: Transferable Reverse-Dynamics Coordinates for Data-Asymmetric Generation”; the title of the submitted PDF is “Bridging the Data Gap: Source-Informed Task-Space Transport for Few-Shot Diffusion”. We changed the title between abstract registration and the full-paper submission and did not update the registered title, so the OpenReview metadata and the PDF currently differ; we apologise for this inconsistency. The change is editorial: the new title is a more precise description of the same source-informed task-space transport problem, and the method and research question were not changed by it. We will align the metadata with the anonymised PDF through the process the conference permits, and we defer to the Area Chair and Programme Chairs on whether the change is procedurally acceptable. The abstract of the revised PDF has also gained one sentence, which states the result of the transport-free control (E25X W1); we will update the registered abstract to match.
W2: Independent method contribution and semantic usefulness
The concern about a transport-free comparator is valid, and the control we have now run bears it out. The new objective ablation shows that adding a source denoising branch improves CIFAR SW over transport-only training (+0.0224,[0.0183,0.0265]), with the same direction across three seeds, FiLM and DomainNet. But both arms still use AzS+bc, so that experiment does not isolate the effect of explicit affine transport from equally informed, equally supervised direct conditioning. We therefore describe this arm as transport-only training, and we have run the transport-free control that isolates the effect (E25X W1). Conditioned directly on (zS,c) and trained with the supervision of Meta-Diff, it is at least as good as Meta-Diff in energy MMD and identity and is better in SW (control minus Meta-Diff −0.0088,[−0.0122,−0.0056]; −0.0140 and −0.0057 at two further training seeds, each interval excluding zero), and it shows the same dependence on the correct source. We therefore do not claim an independent contribution of explicit affine transport on CIFAR-100. What the evidence supports is source-informed joint training in a shared task space, of which the affine map is one parameterisation. Paper: Existing mechanism and controls: Section 3, Eqs. (2)–(4), pp. 3–4; Section 5.2, Tables 1–2, p. 8. New ablations and the transport-free control: Appendix I.1, Tables 51–52, p. 46. New rebuttal experiment; now reported in Appendix I of the revised manuscript.
The semantic limitation is equally explicit. On Office-Home, generated object identity is 1.67 versus 52.00 on matched real images; bypassing transport with abundant-target coordinates does not repair the failure (1.56 on held-out Clipart categories). Transport error is therefore not a sufficient explanation, but capacity, conditioning, optimisation and data have not been disentangled. We consequently claim source-specific domain/distribution alignment, not object-level semantic transfer. Paper: Section 5.3, pp. 9–10, and Figure 6, p. 10; Appendix D.4, Tables 34–39, pp. 36–38; Appendix F.4, Table 49, p. 43.