- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper identifies a geometric non-invariance termed coordinate leakage: functionally equivalent parameterizations of an expert-private classifier leave predictions, losses, and shared-parameter gradients intact while rescaling private gradient components. Because full-gradient coordinators rely on gradient norms, inner products, and projection geometries, this private rescaling alters the fusion geometry and yields divergent model updates. To resolve this issue, the authors introduce Canonical-Coordinate Strategy Fusion. CCSF maps private gradients to a canonical reference coordinate, applies the original fusion rule and optimizer in that reference coordinate, and transports the resulting parameter increments back to native storage.
The motivation seems interesting. However, the paper is difficult to follow. The performance improvement is marginal.
Critical strengths
The paper uncovers an overlooked geometric issue in full-gradient multi-strategy fusion: function-preserving reparameterizations of private classifier heads inadvertently alter cross-objective coordination.
Critical weaknesses
- Overall improvements on large-scale datasets such as ImageNet-LT and iNaturalist 2018 are almost the same as the TS-MOF baseline.
- The performance of this method is not good. Many methods proposed in recent years have a better performance.
- The framework is validated within a specific two-stage pipeline (Stage 1 representation frozen; Stage 2 joint fine-tuning of shared decoder alongside LT, BCL, and LOS heads).
Questions for authors
Refer to [Weaknesses].
Thank you for your detailed response and the additional experiments. I appreciate the authors' efforts to address my concerns.
However, I remain concerned about the practical effectiveness of the proposed method. In particular, the performance improvements on large-scale datasets are marginal (0.2% on ImageNet-LT and 0.1% on iNaturalist 2018), which limits the evidence for its practical advantages. While the additional experiments help clarify the methodological contribution, they do not fully resolve my concerns regarding the limited empirical gains.
Therefore, I will maintain my original rating.