- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies differentially private synthesis of longitudinal image pairs and associated structured records. DPLongSyn builds on a publicly trained deformation-based generative framework, combines DP record synthesis with parameter-efficient private adaptation of the transition model, and produces follow-up images by applying record-conditioned deformations to public source images. Experiments cover two brain MRI benchmarks and one facial-expression benchmark at multiple privacy budgets, evaluating image and record fidelity, longitudinal consistency, downstream classification, and membership inference.
Critical strengths
-
The paper addresses a meaningful problem with a well-motivated design. Longitudinal synthesis requires generated observations to exhibit changes that agree with their associated records, beyond the realism of individual images. Using public data to supply source appearance and a transition prior, while concentrating private learning on records and conditional transitions, is a sensible approach to this requirement. The separation of the two private mechanisms from subsequent public-data post-processing also makes the end-to-end privacy reasoning clear.
-
The reported experiments provide encouraging comparative evidence across two domains. DPLongSyn achieves higher record–transition correlation than the evaluated baselines across the reported dataset–budget settings, as well as the highest mean follow-up AUC in Table 2 and progression AUC in Table 3. At , for example, the follow-up AUC on CelebV-HQ improves from 0.503 for the strongest evaluated baseline to 0.608, and the ADNI progression AUC improves from 0.522 to 0.559. Training classifiers on synthetic releases and testing them on held-out real data provides evidence of utility beyond distributional image metrics. The evaluation across multiple classifier families is also useful.
-
The controls and ablations support specific aspects of the method and expose relevant tradeoffs. Figure 3 shows improved record–transition consistency after private adaptation, an advantage for updating normalization parameters together with the conditioning MLP over the tested alternatives, and a tradeoff between record fidelity and transition consistency under a fixed composed privacy budget. Table 25 holds the DP records and selected public sources fixed when comparing transition models, and appropriately reports that private adaptation does not consistently improve FID or follow-up classification. Table 7 additionally provides explicit numerical privacy accounting for DPLongSyn.
Critical weaknesses
-
The adapted baselines’ private-training configurations are not specified in enough detail to fully reproduce and assess the comparison. Appendix B.5 identifies the public pretraining cohorts, target privacy levels, sampling rate, training steps, and several adaptations. However, the submission does not report the adapted neural models’ total and privately trainable parameter counts or clearly list their private update scopes. It also does not provide baseline numerical accounting tables comparable to Table 7, including the applicable noise multipliers, clipping norms, and mechanism-level budget allocations. These omissions limit independent verification of the reported common privacy setting and interpretation of how the private optimization strategies differ. This is particularly relevant because Figure 3(b) demonstrates sensitivity to the choice of trainable parameters. Different parameter counts do not by themselves invalidate comparisons between complete methods, but the actual configurations should be available.
-
The basis for selecting the baseline training schedules and checkpoints is insufficiently documented. Appendix B.5 specifies a DP-SGD sampling rate of 0.5 and 300 optimization steps for the smaller datasets, whereas DPLongSyn uses a different schedule in Table 7. Different schedules can be appropriate and need not be matched mechanically. However, the paper does not provide the validation or convergence evidence motivating the baseline choices, nor does it clearly specify the corresponding public-pretraining and private-training checkpoint-selection procedures. Appendix B.4 gives a public-validation criterion for DPLongSyn, but the baseline description does not provide equivalent detail. This leaves uncertainty about whether the adapted methods received training configurations appropriate to the changed resolution and dataset sizes.
Questions for authors
-
Model capacity and private update scope (Weakness 1): Please report the total and privately trainable parameter counts for DPLongSyn and each adapted neural baseline component, and specify which modules are updated or frozen during private training after public pretraining.
-
Baseline privacy calibration (Weakness 1): Could you provide numerical accounting settings for the adapted baselines, analogous to Table 7? Please include clipping norms and noise multipliers for DP-SGD components, mechanism-level budget allocations, and the composed privacy budgets at the stated , and clarify whether the implemented sampling procedures match the respective accountants’ assumptions.
-
Training schedules and checkpoint selection (Weakness 2): Please explain how the baseline public-pretraining and private-training horizons and checkpoints were selected, and provide any existing validation or convergence evidence supporting the sampling rate and 300-step private-training schedule in Appendix B.5.
-
Explanation of high FID values: The absolute FID values in Table 1 are relatively high. Could you discuss the likely reasons for these values in your experimental setting and what they imply about the fidelity of the generated follow-up images? Please also explain how the high FID of the zero-deformation public-image control in Table 25 informs this interpretation.
4 comments
A gentle reminder
Dear Reviewer ctS7,
We've taken your feedback into careful consideration in our response. Could you please check whether our response has properly addressed your concern? If so, could you please kindly consider increasing your initial score accordingly? Certainly, we are more than happy to answer your further questions.
Thank you for your time and effort in reviewing our work!
Best Regards,
Authors
Thank you for the clarifications and additional experiments. I’m keeping my original rating.
Thank you very much for your feedback and for maintaining your positive rating. We really appreciate your time and effort!
Responses to Reviewer ctS7
We thank the reviewer for the careful reading and thoughtful comments. We address the reviewer's questions in the following and have revised the paper accordingly. The changes are marked in blue in our revision. We hope the responses below address the reviewer's concerns.
W1, Q1, and Q2: The baselines’ private training configurations and numerical privacy accounting.
We have expanded Appendix B.5 to report the private update scopes and numerical privacy accounting for all baselines. Below, we provide these configurations for ADNI at ε=8 and δ=10−5.
All DP-SGD stages use Poisson sampling, consistent with the assumptions of the corresponding privacy accountants. We also provide the corresponding accounting details for all three datasets at ε∈2,8,32 in Appendix B.5.
W2 and Q3: Training schedules and checkpoint selection.
Training schedule. For the four baselines, we follow the original papers' 150 training epochs. However, using a sampling rate of q=0.05 on our smaller private datasets results in small batches and noisy updates. We therefore increase the sampling rate to q=0.5 to reduce the impact of DP noise, while keeping the number of training epochs fixed at 150, resulting in 300 updates. We recalibrate the noise multiplier to maintain the same privacy budget.
To evaluate this choice, we compare the adapted baseline schedule with DPLongSyn's schedule on ADNI at ε=8, recalibrating the noise multiplier for each schedule to maintain the same privacy budget.
Both baselines achieve substantially better FID under the adapted schedule, supporting our choice of training configuration.
Checkpoint selection. For public pretraining, we use fixed training horizons of 150 epochs for DP-Indep, DP-TabImage, DP-ImageTab, and DP-JointDM, and 50 epochs for DP-JointMERF. All methods use the final public checkpoint to initialize subsequent training. Similarly, for private DP-SGD training, we use the final checkpoint after 300 updates.
We have included these training and checkpoint selection details in Appendix B.5 in the updated version.
Q4: Explanation of high FID values.
The relatively high FID values are largely due to the domain gap between public source images and real follow-up images. As shown in Table 29 (Matched transition controls), even when we directly use real public images as the generated follow-ups without any deformation, the FID against real private follow-up images remains high (88.9 on ADNI and 132.3 on OASIS-3). This suggests that the high FID reflects a distribution mismatch between public and private images. We have also visually inspected the generated images and found their visual quality to be reasonable, although we could not include examples in the paper due to dataset usage restrictions.
We thank the reviewer again for the helpful comments. If our responses have addressed your concerns, we would appreciate it if you could consider raising your rating. We would also be happy to address any further questions you may have.