- Rating
- 4
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
PDST introduces a selective knowledge transfer framework for balanced multimodal learning, distinguishing transferable knowledge from interaction-dependent variation through direct and mediated transfer paths. Path-invariant consensus determines the distillation target, while path discrepancy adaptively controls supervision strength. Extensive experiments across six benchmarks demonstrate strong performance, supported by systematic ablations and representation analyses.
Critical strengths
- Insightful formulation. Rather than treating all cross-modal discrepancies as knowledge deficiencies, PDST introduces path consistency as a criterion for selective transfer. Jointly determining what to transfer and how strongly to transfer it offers a compelling perspective beyond conventional alignment-based distillation.
- Convincing empirical support. Strong results across diverse multimodal benchmarks, together with targeted ablations, transfer-benefit correlations, and representation analyses, provide complementary evidence for the proposed mechanism. Particularly encouraging are the substantial improvements over vanilla distillation and the absence of additional inference overhead.
Critical weaknesses
- Limited theoretical characterization. Proposition 1 provides a geometric decomposition, but the connection between path consistency and semantic transferability remains primarily empirical. A clearer discussion of the assumptions underlying this interpretation would strengthen the contribution.
- Incomplete practical analysis. Direct measurements of unimodal learning balance and additional training costs would help clarify the mechanism and efficiency, although the existing experimental evidence already supports the effectiveness of selective transfer.
Questions for authors
- Could the authors clarify how the mediated transfer path captures modality-conditioned variation without explicitly incorporating the intermediate modality representation?
- Can improvements in individual unimodal branches be reported to further substantiate the modality-balancing interpretation?
- How much additional training computation does the auxiliary transfer framework require?