- Rating
- 2(−1)
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a new method for MULTI-VIEW FUSION The paper claims that “downstream performance is non-monotonic in the number of fused encoders; later views can be redundant or task-misaligned, causing accuracy to saturate or decline.” And, the authors introduce KAGES (Kernel-Alignment Greedy Encoder Selector), a label-aware method that orders frozen encoders by their marginal gain in centred kernel-target alignment. The paper claims that effective large-pool fusion depends on selecting a compact, task-aligned set of views rather than indiscriminately fusing more encoders.
Critical strengths
- This paper is well organized and easy to follow.
- The quantitative results nicely complement the paper.
Critical weaknesses
- For the main experimental setup, is used—is this a standard practice? Does it effectively substantiate the paper’s claim that "more foundation models mean less"? What would happen if were even larger?
- While the mean values across five seeds are provided, the table lacks standard deviations or confidence intervals. Some improvements are quite marginal (e.g., +0.6 for Pets, +2.5 for DTD). I suggest including standard deviations or the results of a paired test in the main tables—at the very least, it should be clarified whether the observed improvements are robust enough to exceed the variance caused by different random seeds.
Questions for authors
Please refer to Weaknesses.
I recheck this paper, and find the experimental results are not convincing to support the conclusions. Thus, I decide to lower the score to weak reject.