- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies a pretrain-once, adapt-many approach to SAR-to-optical image translation. GeoSET first trains a SAR encoder with robustness to speckle perturbations, then performs conditional generative pretraining on approximately 3.2 million curated SAR–EO pairs, and finally adapts to downstream datasets through full fine-tuning or LoRA. The method combines a natural-image generative model, SAR-specific encoding, and large-scale multisource data to reduce the need to build separate translation models for each new dataset. The main text reports perceptual-quality improvements across benchmarks and reductions in trainable parameters, memory, and adaptation time with LoRA.
Critical strengths
1. The main value of this work is a complete approach to shared pretraining and downstream adaptation. SAR encoding, paired-corpus pretraining, and dataset adaptation are connected coherently, and the main results cover multiple public benchmarks. Full fine-tuning reaches an FID of 24.5 on SAR2EO versus 52.7 for the best non-GeoSET method in the table, while LoRA reaches 87.9 on SpaceNet6. These results demonstrate practical effectiveness. The authors also acknowledge that pixel metrics are not consistently better and interpret the outputs as plausible SAR-conditioned optical appearances, making the performance claims easier to assess accurately.
2. The lightweight adaptation results also fit the motivation. In Table 4(b), LoRA updates approximately 0.60 percent of the generator parameters and takes about 0.98 hours per dataset, suggesting a practical benefit from sharing the pretrained model across tasks. Table 5 includes comparisons using the same FLUX.2 backbone, so the improvements cannot all be dismissed as a consequence of switching to a larger foundation model. Although the cumulative ablation does not fully separate the individual factors, it is more informative than comparisons only against methods using different backbones.
Critical weaknesses
1. Independence between downstream test scenes and the pretraining corpus is a key condition for interpreting the transfer results. Table 1 gives sources and counts, and Section 4.1 gives downstream splits, but the main text does not clearly explain whether overlap was checked using geographic footprints or original scenes. The same area could enter through different sources, neighboring tiles, or observations at different times; a split based only on files or sample identifiers would not necessarily resolve this. There is no evidence here establishing actual overlap, but for a paper emphasizing transfer across datasets, this condition directly affects whether the results demonstrate transfer to new scenes or adaptation to another observation of an already encountered scene.
2. The independent contributions of the main design choices remain insufficiently separated. Table 5 shows that the complete recipe works, but adding pretraining introduces both domain data and training steps, so the value of more in-domain training is not the same as the distinct value of multisource design. The relationship between SAR encoding and speckle augmentation raises a similar question: Stage 1 in Section 3 already uses perturbation training, while Table 5 introduces the encoder and augmentation as successive additions. Readers need to know which stages use perturbations and which weights change in each row to interpret the incremental gains. The results support the engineering value of the complete system; establishing the distinct contribution of each component requires a clearer connection between the experimental settings and the conclusions.
Questions for authors
1. Please clarify the actual separation rules between pretraining data and downstream test sets. Were geographic footprints, original scenes, and repeated observations across sources checked? Do both Stage 1 and Stage 2 follow the same constraints? These details directly affect the interpretation of transfer across datasets.
2. Please specify how the encoder is trained in the “+ SAR encoder” row of Table 5 and at which stages “+ Speckle aug.” introduces perturbations. A concise description of the settings changed and held fixed between the rows would resolve the configuration ambiguity.
3. Do the existing analyses distinguish the effects of data volume, additional training, and source diversity? If not, would the authors limit the corresponding claim to the benefit of the complete pretraining recipe? The response can clarify the scope of the existing evidence and align the contribution statement with the available results.
Response to Reviewer A2Z5
We thank the reviewer for requesting clearer data-separation rules and component analysis. C2 provides the shared overlap audit; below, we clarify Table 5 and report additional Stage-2 controls.
W1 / Q1. Pretraining–test separation
C2 reports EO/SAR screening, geographic checks, and conservative re-scoring. The flagged SAR-1M files are absent from every GeoSET training list. SpaceNet6 has geographic overlap with TerraMesh, despite different sensors and 10 m versus 0.5 m GSD; its results therefore do not establish transfer to unseen locations. Coordinates are unavailable for several benchmarks, and the audit does not exhaustively exclude shared original scenes or repeated observations across sources for both stages. We will state these limits explicitly.
W2 / Q2. Settings of the Table 5 rows
“+ SAR encoder” already uses Stage-1 speckle perturbations; “+ Speckle aug.” adds them in Stages 2 and 3.
Stage 1 trains the SAR encoder and channel-specific stems with the decoder trunk fixed. Stage 2 trains the generator with both encoders and the decoder frozen. In every row, Stage 3 trains rank-16 LoRA adapters for 20,000 updates × batch 16. The three pretrained rows share the corpus and Stage-2 update count. This cumulative comparison measures the perturbation-trained encoder as a unit; it does not isolate encoder training from Stage-1 perturbations. We will clarify this in Table 5.
Q3. Source composition and training exposure
The following controls share the backbone, Stage-1 SAR encoder, and speckle augmentation in all applicable stages. Short Stage-2 runs use 30,000 updates × batch 64; all rows use the same rank-16 LoRA adaptation on all target training pairs for 20,000 updates × batch 16.
Source composition. GUSO improves all reported metrics over omitting Stage 2. At matched training exposure, the full corpus further improves the reported SpaceNet6 metrics, including building IoU 0.316 → 0.332; SAR2EO changes are small and mixed. This supports the tested source mixture, without separately isolating diversity from source content or unique-pair counts.
Training exposure. The longer full-corpus run improves SAR2EO metrics and SpaceNet6 LPIPS/IoU (0.332 → 0.361), while SpaceNet6 FID slightly favors the short run (86.2 versus 87.9). Both update count and batch size increase, so this comparison measures greater exposure rather than update count alone.
Target-domain exposure. The downstream-union row gives the strongest SAR2EO results but lower SpaceNet6 building IoU (0.278 versus 0.332). Both domains are included, so these are held-in-domain results. This row uses the union for Stage 2, followed by separate target adapters; the joint model in our response to Reviewer Mngz, W3 instead uses the union for one shared Stage-3 adapter. We will distinguish these protocols and scope attribution to the tested source mixtures and training recipe.