- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes ACD-Retrieval for multimodal cross-domain in-context learning when target-domain demonstrations are unavailable. The method centers embeddings separately within each domain, retrieves demonstrations using cosine similarity in source-domain PCA subspaces, and asks the same model to select between zero-shot and demonstration-augmented responses. Experiments treat mathematical disciplines in MATH-V as distinct domains and report improvements in overall accuracy across multiple model families and sizes.
Critical strengths
- The complete framework achieves consistent improvements in overall accuracy across multiple model families and sizes.
- The paper includes preliminary component ablations and results for all evaluated domains, helping readers assess component effects and domain-specific performance.
Critical weaknesses
-
Limited technical novelty and insufficient positioning relative to established methods. The SVD decomposition, cumulative-energy-based dimensionality selection, and principal-direction projection used in the proposed Adaptive Subspace Projection are mathematically equivalent to standard PCA. The specific adaptation consists primarily of domain-wise centering and projecting target queries into source-domain principal subspaces. However, the paper does not mention PCA or clearly distinguish these standard operations from its additional design choices.
Closely related work has already investigated cross-domain reasoning demonstration retrieval [1] and multimodal demonstration transfer without task-specific support data [2], but neither is cited or discussed. The contribution currently appears to be primarily a combination of existing techniques evaluated in the MATH-V cross-discipline setting. Its independent methodological contribution and claimed originality are not sufficiently established.
-
The description of a shared aligned subspace does not fully match the actual construction. The method builds a separate principal subspace for each source domain, without explicitly optimizing source–target subspace alignment or constructing a common projection space across all domains. It remains insufficiently explained whether cosine scores computed in different subspaces are directly comparable and how candidates from different source domains are ranked and merged.
-
Important details of the experimental protocol are unclear. The paper does not clearly specify which samples are used to estimate target-domain means, how demonstration pools and evaluation data are partitioned, whether demonstrations contain reasoning traces, or which data are used for hyperparameter selection. These details affect the interpretation of the setting, the reported results, and the method's practical applicability.
[1] Yan et al. Towards Effective In-context Cross-domain Knowledge Transfer via Domain-invariant-neurons-based Retrieval. 2026.
[2] Fang et al. Why is a Bird's Caption a Good Demonstration? Towards Effective Multimodal In-Context Learning without Dedicated Data. ACM Multimedia, 2025.
[3] Weng et al. Optimizing Knowledge Integration in Retrieval-Augmented Generation with Self-Selection. 2025.
Questions for authors
Please clarify the paper's independent contribution beyond combining existing techniques:
- How does the proposed subspace construction differ mathematically from standard PCA, and why is this connection not explicitly acknowledged?
- Relative to prior work on cross-domain demonstration retrieval, multimodal demonstration transfer, and answer self-selection [1–3], what new mechanism or empirical finding does this paper establish?
- What substantive challenges does the MATH-V cross-discipline setting introduce beyond providing a new evaluation instance of cross-domain ICL?