- Rating
- 1(−1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This work addresses pseudo-label ambiguity in few-shot multimodal classification by introducing a competitive ownership resolution mechanism. The key insight is that independently constructed class-wise candidate pools can lead to conflicting labels for the same instance, where the final assignment depends on processing order rather than evidence. The proposed method assigns each multi-claimed instance to its most reliable class via an argmin operation before budget allocation, ensuring order-invariant and conflict-free pseudo-label pools. Experiments on MUUFL and Trento datasets demonstrate accuracy improvements with confidence intervals provided.
Critical strengths
1.The paper rigorously separates the selection decision from the ownership decision. This conceptual clarity, formalized in Proposition 1, provides a principled framework that could be adopted by other pseudo-labeling systems beyond the specific PGPL instantiation tested here.
2.The authors provide matched-seed paired experiments across multiple splits, report confidence intervals, and include extensive diagnostic analyses.
Critical weaknesses
1.The method is evaluated only within the PGPL framework on two relatively small benchmarks.
2.The competitive assignment requires computing scores for all claimants of each multi-claimed instance and performing an argmin operation. While this is tractable for the 11-class MUUFL and 6-class Trento datasets, the computational and memory implications for problems with hundreds or thousands of classes are not discussed.
3.In the figures, several connectors are misaligned, and spacing is inconsistent.
Questions for authors
- Can you report the computational overhead of the competitive assignment step relative to the baseline, particularly as a function of the number of classes and the proportion of multi-claimed instances?
2.The paper demonstrates the method on two datasets from the same domain (hyperspectral-LiDAR fusion). Do you have any evidence that the ownership resolution mechanism transfers to other multimodal settings (e.g., RGB-D, text-image)?
Thank you for asking. The change reflects my reassessment of the significance of the contribution. The additional controls suggest that the gains are largely associated with class-wise admission counts and pool composition. While these results clarify how the method works, I remain unconvinced that the methodological advance is sufficiently substantial for acceptance. My revised rating reflects this concern about the contribution’s significance.