- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes CoRD-Fed. It combines object-region feature distillation from a larger local detector with category-specific rescaling of federated classifier updates. Experiments use Faster R-CNN + FPNand resnet on DIOR and DOTA, Dirichlet label skew, and partial participation. The principal claim is that preserving update magnitude prevents confidence collapse.
Critical strengths
The combined framework has measurable empirical benefit on two datasets. Table 1 (p. 7) reports gains over FedAvg of 2.26 AP on DIOR and 5.27 on DOTA, with higher small-object recall. This supports investigating the combination, although the margins over the strongest baseline are much smaller: 0.39 and 0.46 AP.
The module ablation is useful. Table 2 separates region distillation and TERCA, rather than attributing the complete improvement to aggregation alone. This is consequential because either component can improve the baseline.
Critical weaknesses
The core idea of the paper is very similar to FedMRUR[1], but the paper did not mention it.
The paper conflates update magnitude with classifier confidence. The abstract says cancellation “shrinks classifier norms and severely attenuates prediction confidence” (p. 1), but the method restores the norm of an update, not the resulting classifier. An update can oppose the existing weights. A larger weight norm also need not increase the correct-class logit or improve calibration. The causal chain from cancellation to confidence collapse is therefore not established.
Rescaling a conflicting average is not conflict resolution. TERCA claims a direction that “suppresses conflicting gradients” ( lines 282–284), yet its direction is exactly FedAvg's. A scalar cannot identify or remove a harmful client's directional contribution.
The experiments do not establish the claimed federated advantage of the combined design. Section 4.1 specifies a larger local teacher and ImageNet initialization, but does not explain its detection training or access to client data. The evidence for the claimed synergy is also mixed: RDChannel alone exceeds RDChannel + TERCA in AP and recall (Table 3, p. 8), despite the claim “Combining both achieves optimal performance across all metrics” (p. 8). The complete system's gain does not by itself validate the proposed interaction between local knowledge transfer and global confidence preservation.
Line 140 "Sec. ??:". Missing referenced section.
[1] An, Xuming, Li Shen, Han Hu, and Yong Luo. "Federated learning with manifold regularization and normalized update reaggregation." Advances in Neural Information Processing Systems 36 (2023): 55097-55109.
Questions for authors
See above