- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper investigates multimodal learning imbalance from the perspective of feature-space geometry. The authors argue that conventional approaches primarily focus on regulating gradients, learning rates, or modality contributions, while overlooking how parameter updates are translated into effective representation updates. The method is evaluated on four audio-visual and image-text benchmarks: Kinetics-Sound, CREMA-D, Sarcasm Detection, and Twitter-15. The authors report improvements over the selected multimodal rebalancing baselines across eight evaluation metrics. Additional analyses investigate unimodal branch performance, different fusion strategies, feature probe counts, and computational overhead.
Critical strengths
-
The paper provides an interesting perspective by analyzing multimodal imbalance in terms of effective representation updates rather than merely comparing gradient magnitudes or relative modality performance.
-
The proposed method reports improvements across four datasets covering audio, video, image, and text modalities. In addition to fusion accuracy, the paper investigates the performance of individual modality branches, which is relevant to its discussion of modality under-optimization.
-
The narrative is clear and the language is well-articulated.
Critical weaknesses
-
The experimental evaluation is not sufficiently representative of recent developments in multimodal imbalance learning. There is just only one method AMSS and AMSS+ (2025), several highly relevant peer-reviewed methods published in 2025–2026 are missing. Given these omissions, the paper's claim of achieving new state-of-the-art results on all four benchmarks is not sufficiently substantiated.
-
Table 1 contains accuracy values that cannot be obtained from a single Top-1 evaluation under the stated test set sizes in APPENDIX. For example: CREMA-D: 76.93% with 744 test samples. The reported values do not satisfy this discrete constraint, even after rounding to two decimal places. They could arise from averaging multiple runs, evaluation splits, or nonstandard aggregation procedures. However, the paper does not specify the number of runs, report standard deviations, or sufficiently describe the aggregation protocol. Similar irregularities occur in some baseline entries, suggesting that the evaluation protocol requires clarification more generally.
-
The baseline results in Table 1 appear to be identical to those reported in AMSS for 14 overlapping methods. However, the authors do not explicitly clarify whether these results were reproduced independently or directly adopted from the prior work.
-
The computational overhead is considerable. Figure 3(c) reports 205.8 seconds per epoch for FP, compared with 41.6 seconds for Concat and 94.3 seconds for AMSS+. Thus, FP requires approximately 4.95 times the training time of Concat and 2.18 times that of AMSS+, with 46.25% additional GPU memory. The identical reported inference FLOPs do not imply comparable training computation. No matched-training-budget comparison is provided.
-
The presentation of empirical evidence could be improved. Figure 4 compares FP primarily with AMSS+ on CREMA-D, although MMPareto achieves a higher accuracy in Table 1.
-
The Introduction and Related Work sections provide an overly simplified discussion of existing multimodal imbalance learning methods. Moreover, the literature coverage is not sufficiently up to date, with several relevant works published in 2025–2026 being overlooked. This weakens the timeliness and completeness of the literature review and makes it difficult to clearly assess the novelty and positioning of Feature-Pullback relative to recent advances.
-
The experimental section directly presents comparisons with numerous baseline methods in Table 1 without systematically introducing these methods or explaining the rationale behind their selection. Although some approaches are briefly mentioned in the Related Work section, the experimental evaluation lacks a clear description of the compared baselines, their relevant characteristics, and the experimental settings used for comparison. This makes it difficult to assess the representativeness and fairness of the comparisons and weakens the clarity and reproducibility of the experimental evaluation.
Questions for authors
Pease see weaknesses.