- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper studies adversarial training under long-tailed distributions and argues that tail-class robustness degrades because posterior supervision becomes unreliable in unstable regions of representation space. The proposed method, FEPT, reweights an EMA teacher posterior using a score that combines support distance, local density, and posterior sensitivity, and supplements tail classes with support transferred from related head classes. Experiments on CIFAR10-LT, CIFAR100-LT, and TinyImageNet-LT report improved tail and worst-class robustness over existing methods.
Critical strengths
None
Critical weaknesses
W1. Motivation is not established. The paper claims that posterior support unreliability causes tail robustness degradation but never demonstrates it before introducing the method. The diagnostics that appear later (Fig. 2, Table 10) measure the same quantities FEPT optimizes, so they cannot show that this phenomenon causes the problem. Beyond performance numbers, the paper also gives little insight into how the method works: it never shows which samples are down-weighted, what is transferred from head classes, or which failures of prior methods FEPT fixes.
W2. Terminology obscures a simple method. The method combines a nearest-neighbor distance under a local-PCA-based anisotropic metric, a kernel density estimate, and the norm of the posterior gradient into a reweighting score, then mixes in prototype-shifted support from head classes. Terms such as free energy, Riemannian metric, and transport add nothing beyond these operations and make the method harder to follow. The paper also does not explain why these particular factors are needed or why they are combined in this form, so the score reads as a combination of heuristics rather than a justified design.
W3. The role of the theory is unclear. Theorem 1 is a standard Lipschitz margin argument whose tail-specific conclusion follows directly from the assumed form of L_y, and Theorem 2 is a generic bias–variance decomposition that holds for any weighted average. It is unclear what these results contribute to the paper. What specific insight about FEPT do the authors intend them to provide? If they are meant only as intuition, it would be better to state that intuition briefly or remove the theorems altogether. (In my view, formalizing an intuition is not the same as theoretical analysis. A theoretical result is valuable when it provides guidance that the intuition alone does not, which is not the case here.)
W4. Baseline results are inconsistent with prior work. The PAT entries, including standard deviations, are copied directly from the original PAT paper, even though the experimental settings of the two papers appear to differ in several respects. This contradicts the statement that all results follow the same protocol. Moreover, all other baselines are substantially higher than the values reported in the PAT paper. For example, AT-BSL PGD accuracy with ResNet-18 is 23.84 vs. 10.98 on TinyImageNet-LT. As a result, PAT appears much weaker than it actually is.
W5. A possible evaluation flaw may explain the discrepancy in W4. Mixing model.train() and model.eval() is a common mistake in adversarial training, so I raise this as a possible concern. In the supplementary code, pgd() calls model.train() before returning. As a result, adversarial examples are generated in eval mode but classified in train mode, and test data updates the BatchNorm statistics saved in the checkpoint. If this code produced the reported results, the PGD numbers for FEPT and the re-run baselines may be inflated, while the copied PAT numbers are not. This would account for why only PAT appears much weaker than in prior work.
Questions for authors
None