- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
RaP validates both fresh updates and accumulated surrogate gradients using a trusted server objective. It targets Byzantine-robust FL under general client selection and intermittent availability, reporting gains on CIFAR-10 and private ECG data.
Critical strengths
Protecting historical state is a useful observation, supported by Table 3. The CIFAR evaluation covers four selectors and five conditions over five runs, with RaP achieving the highest reported mean accuracy throughout.
Critical weaknesses
- Incorrect convergence derivation. On p.34, lines 1807–1810 contain . Dividing by should produce , but lines 1815–1817 omit it. This nonvanishing heterogeneity residual invalidates the stated derivation of F.5. F.6 also converts the fixed residual into an additive communication count without the required sample-size/accuracy condition.
- Unresolved comparison fairness. Algorithm 2 requires available, non-selected clients to compute surrogates. Communication-adjusted curves do not establish equal computation or final table budgets, and equivalent baseline access to server data/updates is unclear. Under Uniform Random Grad, Fresh-only reaches 0.804 versus BANT's 0.100, leaving most of that gap unexplained by the surrogate. Matched-budget comparisons and baseline tuning details are needed.
- Bias correction is not established. Mixing current and historical directions does not itself demonstrate reduced selection bias. The proof bounds the surrogate as a perturbation rather than establishing improved alignment or convergence. Its sufficient conditions restrict CIFAR's to approximately or less, versus 0.15 in experiments. Table 3 supports usefulness, but does not isolate bias correction from extra information or scaling effects.
- Insufficient targeted robustness tests. Main comparisons use 20% Byzantine clients without reporting malicious-majority cohort frequencies. No surrogate-only attack with honest fresh updates or attack explicitly adapted to trial-function validation is reported. The CIFAR availability sweep lacks matching reduced-availability baselines; ECG baseline missing-response handling is unspecified.
- Unclear technical increment. The differences from BANT and Bylinkin et al. (2025) need explicit algorithmic and analytical comparison. Applying conventional robust aggregators to the same surrogates is a missing control for whether trial-function validation is essential. Honest-majority-free aggregation alone does not distinguish RaP from the cited trial-function literature.
Questions for authors
Please refer to weakness.