- Rating
- 4
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents a new federated learning for INF problem, which clearly separates client private information with shared parameters, and the zero-shot inference for new data outperforms the baseline models. Authors have conducted a very comprehensive evaluation of the proposed model using image, audio signals , video , and occupancy filed, and test various privacy attack scenario. Over all this is a very interesting and thorough study.
Critical strengths
This study has conducted thorough tests of the proposed model using various types of data modalities, different attacks for privacy .
Critical weaknesses
When comparing the proposed model with baseline models, the number of parameters of each model should be provided to give a fair comprehension of different models, as well as communication load during federated learning. While the related work is provided, direct comparison of the proposed model with most relevant models in details (e.g, encoder, hypernetwork, decoder architecture) will clarify the novelty of the model,.
Questions for authors
How is the model performance compared to centralized model with exact the same model configuration?
3 comments
The authors have addressed my concerns sufficiently .
We sincerely thank the reviewer for confirming that our responses have addressed the concerns. We greatly appreciate the time and effort devoted to reviewing our work.
We sincerely thank the reviewer for the thoughtful and constructive feedback. To address these concerns, we now report the parameter counts and communication costs of each method, provide a component-wise comparison with closely related approaches, and present the model's performance under centralized training.
Q1)
We provide a detailed comparison of the trainable parameters and federated communication costs of FedFields and the relevant baselines in table below.
Model size and communication in federated training, and Kodak PSNR of the resulting model (dB).
Architecture comparison and novelty. FedFields is built for a setting that the most related methods were not designed for: learning one amortized neural-field encoder across clients that cannot share their data. Trans-INR and ANR are amortized but centralized designs. A transformer trained from scratch encodes each signal into a set of tokens; from these tokens, Trans-INR generates the weights of a decoder for that signal (6-layer transformer of width 768, 5-layer MLP decoder), and ANR's decoder attends to them at every query (6 + 6-layer transformer of width 512, 5-layer MLP decoder). FedMeNF is federated but not amortized: it learns only the initialization of a SIREN and fits it to each signal by optimization. FedFields brings the two properties together through three design decisions.
A pretrained encoder, adapted rather than retrained. The encoder combines DINOv2 ViT-B/14, adapted through LoRA, with a small convolutional branch. Federation therefore trains and exchanges only small heads and LoRA weights, 38× fewer parameters than ANR and 31× fewer than Trans-INR (See the Table above), instead of a full model trained from scratch.
One shared decoder, modulated at every query point. A single SIREN (6 layers, width 256) is shared by all signals. A small hypernetwork predicts its neuron-wise shifts from the latent representation interpolated at each query point. No decoder is generated per signal and no query attends over all tokens, so the knowledge shared across clients sits in one compact network.
Separation of shared and signal-specific parts. The content of each signal stays in its latent representation on its client, and only the shared network is exchanged. In the paper's attacks (App. A.7), FedFields' exchanged updates did not reveal recognizable signal content, whereas those of federated per-signal networks did.
With these choices, FedFields reconstructs unseen signals zero-shot in a single forward pass. Under identical federated training, it is ahead of ANR and Trans-INR on Kodak (39.26 vs. 33.17 and 25.63 dB) while exchanging far fewer parameters. We will add this comparison to the paper.
Q2)
The results for centralized training are presented in table below.
Centralized training (PSNR, dB)