- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper presents FedQuadContra (ambiguity-aware contrapositive quadruplet learning framework), a metric learning-oriented framework for federated remote sensing (RS) image scene classification. Different from conventional metric learning objectives, FedQuadContra constructs quadruplets, each of which includes an anchor, a same-class positive, a hard negative, and a contrapositive negative selected from a class distinct from both the anchor and hard-negative classes, to better model high inter-class similarity and intra-class variability present in RS imagery that is further exacerbated under highly non-IID partitioning of distributed data archives. To assess the effectiveness of FedQuadContra, the authors compare it with several federated learning approaches under IID and multiple levels of Non-IID data heterogeneity and across two different network architectures on UC Merced and RESISC45 datasets.
Critical strengths
The presented topic, federated learning across distributed data archives, is timely and highly relevant, especially for remote sensing imagery, while the corresponding challenge mentioned in the paper, class heterogeneity of RS imagery, is one of the main scientific bottlenecks, limiting the use of conventional federated learning for Earth observation, where privacy-preserving deep learning is highly required. However, the proposed solution falls far short of the paper's promise compared to already existing approaches (see critical weaknesses below).
Critical weaknesses
I have two major concerns regarding the paper, which critically harm the clarity and novelty of the study.
First, although federated learning for RS imagery is the paper's main promise, the proposed FedQuadContra framework mainly relies on a metric-learning approach using QuadContra loss applied during local training, along with a classification loss. Accordingly, there isn’t any actual contribution to federated learning, for instance, in parameter aggregation, model sharing, etc. Even though metric learning can be highly beneficial for federated learning, as in MOON, FedDecorr, etc., which is already stated in the paper, such approaches show the effect of corresponding contributions on representation learning over federated learning, for instance, via adding contrastive loss of features from global and local models in MOON. This is not evident in this study. That is why I couldn't understand the reason of why FedQuadContra has been specifically claimed to be effective for federated learning. Furthermore, as can be seen from the main IID results in Tables 1 and 2, the actual performance gain of FedQuadContra is linked to local training rather than federated learning over distributed heterogeneous clients.
Second, even though the main contribution of the paper is concentrated on a new metric-learning approach as explained in the first weakness, I am also not convinced by the novelty of the QuadContra loss over the quadruplets. The ambiguity-aware contrapositive negative addition, as being the main difference compared to conventional triplet loss, is very similar to the well-known batch-all strategy in triplet loss (Hermans et al., arXiv 1703.07737, 2017). In the batch-all strategy, all possible negatives in a mini-batch are considered for a given anchor, which is later extended with multiple hard negative mining. In QuadContra loss, the second hard negative is actually used in the name of contrapositive negative, as it can be seen from Eq. (5). Furthermore, one of the main claims about this negative written in Line 314 (closest eligible sample from a semantic class distinct from both and ) is actually wrong, as Eq. (5) minimizes feature distances with respect to the anchor only, not the hard negative. The paper also includes very limited comparison with other metric learning approaches (only standard triplet loss on one dataset in Table 3).
These two main weaknesses invalidate not only the main federated learning contribution claim of the paper, but also the overall novelty of the proposed framework. Apart from those, there are three other relatively minor weaknesses.
First, even though FedQuadContra is hyperparameter-heavy (3 margin parameters, , ), there is no single sensitivity analysis of any hyperparameters.
Second, Section 3.5 does not provide an actual theoretical analysis; it only shows very trivial hinge-loss inequality statements.
Third, lines 81-103 include two repetitive text blocks. In addition, either some reference hyperlinks are missing (e.g., Buyuktas et al.) or wrongly formatted (e.g., Youssef et al. Youssef et al. (2024)).
Questions for authors
Can you please clarify and experimentally show how FedQuadContra contributes to federated learning for remote sensing image scene classification by referring to the first weakness mentioned above?
Can you please clarify the confusion (closest eligible sample from a semantic class distinct from both and ) written in Line 314 about Eq. (5)?
Can you please clarify the novelty of the QuadContra loss over quadruplets by stating its difference from multiple hard negative mining in triplet loss and by comparing it with recent metric learning approaches?
Can you provide sensitivity analyses of hyperparameters?
We thank the reviewer for the constructive feedback.
1. FL Contribution (W1/Q1)
FedQuadContra contributes to local representation learning under heterogeneous FL, rather than server-side aggregation. Unlike MOON and FedDecorr, it explicitly models competing semantic relationships without exchanging embeddings or prototypes.
Under severe heterogeneity (α=0.05), FedQuadContra outperforms FedAvg by 13.35 and 9.97 percentage points (pp), and RS-CCL by 5.93 and 3.27 pp on UCM and NWPU, respectively. QuadContra + FedAvg (89.20%) also outperforms Triplet + FedProx (84.81%), demonstrating gains beyond proximal regularization.
We acknowledge that IID improvements reflect the general effectiveness of QuadContra. Our contribution is its effectiveness within heterogeneous FL, not its exclusive applicability to FL.
2. Methodological Novelty (W2/Q3)
Batch-all and multiple hard-negative triplet: These methods impose anchor-centered constraints. QuadContra additionally models the relationship between two distinct competing negative classes through D(zn,zc), which is not explicitly constrained by conventional triplet objectives.
Conventional quadruplet learning: We acknowledge existing inter-negative separation formulations (Chen et al., CVPR 2017). Our novelty lies in combining class-diverse ambiguity-aware mining with three complementary relational constraints.
Unlike MOON, FedDecorr, FedRCL, and RS-CCL, QuadContra explicitly constrains the mutual separation of selected competing negatives.
Expanded ablation (UCM, ResNet-18, α=0.05):
Random third-class selection and removal of the inter-negative term reduce accuracy by 3.80 and 2.10 pp, respectively, demonstrating benefits beyond adding a fourth sample. Direct comparisons with batch-all and conventional quadruplet objectives remain valuable additions.
3. Clarification of Eq. (5) (Q2)
The contrapositive negative is selected as
c∗=argminj:yj=ya,yj=ynD(za,zj).
Line 314 refers to the closest eligible sample to the anchor, excluding both anchor and hard-negative classes. It does not imply minimizing distance to the hard negative. The inter-negative relationship is modeled during optimization through Eq. (6). We will clarify this wording.
4. Hyperparameter Sensitivity (Q4)
Table 2: Independent Hyperparameter Sensitivity Analysis on UC Merced (ResNet-18, Dirichlet skew = 0.05). Unlisted parameters for each sweep are kept at their default values (α=0.2, β=0.2, γ=0.2, λQC=0.1, μ=0.01).
5. Theoretical Analysis
Section 3.5 characterizes geometric separation rather than federated convergence. Multiple anchor-centered constraints can be satisfied even when distinct negative embeddings coincide. QuadContra additionally enforces
D(zn,zc)≥D(za,zp)+β
when the corresponding hinge loss is zero, excluding such configurations. We will rename Section 3.5 "Geometric Interpretation of Multi-Relational Separation" and clarify its scope.
6. Presentation Issues
We will remove the duplicated text in Lines 81–103, correct the missing and duplicated citations, and verify reference entries and hyperlinks.
We appreciate the reviewer's feedback and believe these clarifications and expanded ablations strengthen the methodological positioning and empirical justification of FedQuadContra.