-
The contribution of the proposed works need to be positioned more carefully, as some components have already been on related works. For example, Surrogate upload by distribution matching is FedDM [1], Buffer selection by herding toward a class mean is the exemplar selection of iCaRL [2], [3] combines standard class-balanced sampling with logit adjustment. Also, FedCIL [4] consolidates the global model on the server with generated data, and MFCL [5] and LANDER [6] train data-free generators on the server for FCIL. Condensed data as continual-learning memory was already evaluated in the DM paper [7] that ReSCENE builds on. ECoral [8] condenses exemplars for federated class-incremental learning and is the closest prior work, yet it is mentioned only once in Appendix B and never compared. Can the authors discuss and compare with [5, 6, 8] and clarify what the contribution is beyond "keep the uploaded surrogates and replay them"?
-
The data held by the server is reported in table 4b is larger than the original dataset. Specifically, table 4b shows 98,087 synthetic images on CIFAR-100 (50,000 samples on training set) and 194,355 on TinyImageNet (100,000 on training set). Temporal herding may removes only about 20 to 40% of the pool (as B/|P| around 0.6 to 0.8), but it still a heavy data size. The claim "a small condensed surrogate" in the abstract should be considered carefully.
-
The paper say IPC is fixed "regardless of how much local data the class has". This raise a question that when a client holds fewer than 10 images of a class, it still produces 10 surrogates per round from them, which is expansion rather than condensation. The authors need to clarify this detail.
-
The privacy experiment in Table 13 is not a fair comparison, and it may indicate leakage rather than robustness. Specifically, the proposed method keeps 55.13 AA at σ=5, which may be due to 25 noisy steps on pixel gradients cannot remove a real image used as the starting point. Also, the baselines are switched to GroupNorm, which lowers their σ=0 accuracy, while ReSCENE keeps BatchNorm. The authors should add empirical privacy evaluation, such as nearest-neighbour similarity between surrogates and client images, membership inference, or visualizations, since dataset condensation has been shown not to provide privacy for free [9].
-
The motivation contradicts the results on plasticity. The introduction criticizes prior methods because they "hold back new learning". However, table 6 shows that ReSCENE has the lowest final-task accuracy among the strong methods.
-
The paper claims that existing methods never optimize classes of different tasks against each other. However, replay methods such as iCaRL [2], GLFC, Re-Fed and FedCBDR do train old-class exemplars together with new classes, so they do learn cross-task boundaries. This need to be considered carefully.
-
The efficiency claims does not clearly show the server cost and report best cases. Table 12 gives total computation only for CIFAR-10 at task 2, the cheapest point on the cheapest dataset, and even there ReSCENE costs about 4.2× FedAvg. Communication is reported the same way, as "Up to 179× smaller upload" holds only on CIFAR-10 but maybe on Imagenet, it may be worse. The authors should add more experiments to clarify this point, and add this into limitation section if needed.
-
The authors should explain how ReSCENE works on asynchronous and client-specific task sequences, and very task sequence (500 to 100 tasks for example) and evaluate it under the heterogeneous task-sequence settings. The author may check [10] for references.
-
The paper claim reduce the computing and resource at the client side. It should be much better if the authors can provide the test under real resource-limited hardware.
[1] FedDM: Iterative Distribution Matching for Communication-Efficient Federated Learning - CVPR 2023
[2] iCaRL: Incremental Classifier and Representation Learning - CVPR 2017
[3] Long-tail Learning via Logit Adjustment - ICLR 2021
[4] Better Generative Replay for Continual Federated Learning - ICLR 2023
[5] A Data-Free Approach to Mitigate Catastrophic Forgetting in Federated Class Incremental Learning for Vision Tasks - NeurIPS 2023
[6] Text-Enhanced Data-free Approach for Federated Class-Incremental Learning - CVPR 2024
[7] Dataset Condensation with Distribution Matching - WACV 2023
[8] Exemplar-Condensed Federated Class-Incremental Learning - https://arxiv.org/abs/2412.18926
[9] No Free Lunch in "Privacy for Free: How does Dataset Condensation Help Privacy" - arXiv 2022
[10] HERO: A Heterogeneity-Aware Benchmark Library for Federated Continual Learning - NeurIPS 2026