- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper addresses satellite image transmission under uncertain downlink budgets, prioritizing task-relevant regions over background content. The proposed Region-Progressive Latent Compression (RPLC) partitions latent representations into spatially masked channel-slice units and serializes them into a single ROI-first bitstream that supports decoding at complete-unit boundaries. At the ground station, a lightweight network completes unreceived ROI latents, while an aligned historical image guides background reconstruction through a Reference ControlNet. Pixel locking prevents the historical reference from modifying the reconstruction inside the transmitted ROI mask. Experiments compare RPLC against 24 baselines with different supported bitrate ranges on 256 fMoW test images, with additional reference-free evaluation on 128 DIOR images. At approximately 0.0089 bpp, the paper reports strong ROI reconstruction quality, 66.0% category retrieval accuracy under a paired-gallery protocol, and 81.48% Mask IoU under prompted segmentation. The appendices provide byte accounting, truncation audits, component ablations, mask perturbation experiments, and reference-mismatch tests.
Critical strengths
-
The target-first transmission objective is implemented as a concrete, auditable bitstream. Section 3.3 and Appendix C specify how the hyperprior, mask packet, frame headers, and regional payloads are transmitted, and include their costs in the reported bitrate. The first prefix averages 292 bytes, including 100 bytes of fixed structures, so substantial overhead is not omitted from the ultra-low-rate results. The 41,216 byte-cut checks, together with actual decoding checks at 256 interior truncation points, provide meaningful support for the encode-once, progressively decodable design. This is the paper’s strongest systems contribution.
-
The ROI reconstruction advantage is supported by several complementary comparisons. Table D.3 shows that the first RPLC prefix achieves better LPIPS, DISTS, MS-SSIM, and CLIP than the StableCodec ROI-crop baseline at a lower bitrate, although its FID is worse. Table D.4 provides paired confidence intervals against JPEG2000 Maxshift, and Table 1 supports the usefulness of ROI prioritization and latent completion. The reference-free DIOR results further indicate that the gains do not arise entirely from historical imagery. Importantly, the main ROI reconstruction metrics evaluate the pixel-locked region, where historical-reference pixels cannot directly explain the improvement.
Critical weaknesses
-
The principal downstream results do not yet establish reliable preservation of current-target task information. The reported 66.0% result uses a gallery containing the original counterpart of every reconstructed query. Moreover, DINOv2 is used both in the completion loss and as the retrieval feature extractor. This is a useful test of representation preservation, but it is not equivalent to held-out category generalization. The authors appropriately disclose these limitations; nevertheless, they limit the strength of the application-level evidence. Appendices D.5 and G.2 partially address this concern with a classifier trained on a disjoint split. However, the reported baseline comparison primarily involves Maxshift, without corresponding results for the uncompressed images and strong learned ROI-crop baselines. Consequently, the 21.09% classification accuracy is difficult to interpret in terms of retained task performance or competitiveness. Historical information also contributes substantially: in Table G.2, removing the reference decreases category retrieval from 65.63% to 48.83% and held-out classification from 21.09% to 15.23%. Furthermore, reconstruction metrics are evaluated only inside the model-selected transmitted mask, excluding missed target regions. Evaluation against manual segmentation masks partially addresses this issue, but uses reference-assisted reconstructions and ground-truth box-and-point prompts. Overall, the evidence is stronger for reconstructing the selected ROI than for preserving the information of the complete current target.
-
The incremental contribution of the historical-reference branch is not sufficiently isolated. Selective regional transmission and partial-latent refinement have precedents, including GIT-SSIC and context-based trit-plane coding. The contribution therefore rests substantially on the proposed integration and its demonstrated benefits. The ordering and component ablations provide useful evidence, but the interpretation of the reference-branch control remains problematic. Appendix G.3 replaces the historical image with an all-zero guide while retaining a branch trained with historical references. The resulting degradation establishes that the trained branch depends on its input, but does not exclude contributions from additional capacity or training: the zero guide may itself be out of distribution. Thus, the claim that the gain is not due to added capacity is stronger than this experiment supports. The paper does include ROI-crop baselines with access to historical images. Nevertheless, a more direct control is missing: keeping the RPLC current-image reconstruction, mask, and aligned reference fixed, how much does Reference ControlNet improve over simply pasting or blending the aligned historical background? This would distinguish the benefit of access to historical information from the benefit of the proposed reference-conditioning mechanism.
Questions for authors
-
Independent downstream evaluation: Could you report results under the same held-out classifier for uncompressed images, RPLC with and without references, and representative strong learned ROI baselines? Please use a consistent configuration or explicitly identify differences in bitrate and alignment. This would materially affect my assessment of task utility.
-
Preservation of the complete target: Using the existing manual annotations, could you report reconstruction metrics on a fixed ground-truth target region, together with segmentation results with and without historical references? Results on target pixels outside the transmitted mask would be especially informative. This would establish whether the advantage extends beyond regions successfully selected by the onboard model.
-
Reference-branch contribution and temporal validity: With the current-image bitstream and aligned reference held fixed, how much does Reference ControlNet improve over direct background compositing or blending? Please also clarify whether reference selection strictly requires an acquisition earlier than the current image and report the temporal-gap distribution. These details affect both the contribution assessment and the validity of the historical-reference deployment setting.
5 comments
Author response to Reviewer N3h7 (part 2/4)
Q2: Preservation of the complete target: Using the existing manual annotations, could you report reconstruction metrics on a fixed ground-truth target region, together with segmentation results with and without historical references? Results on target pixels outside the transmitted mask would be especially informative.
R2: Yes. On target pixels outside the transmitted mask, RPLC k = 1 is better than all baselines at the same rate on all six metrics and the reference improves all six; in segmentation, the reference adds 6.44 pp Mask IoU at k = 1.
- The transmitted mask, which is also the pixel-locked region, recalls 76.95% of the ground-truth target pixels, and inside it the outputs with and without the reference are identical. On the complete ground-truth target, RPLC k = 1 is better than Maxshift, the JPEG2000 ROI crop and DiT-IC on all eight metrics (Table I, response to Tt1G). The remaining 23.05% of target pixels (Table VI) are generated by the reference-guided decoder.
Table VI. Target pixels outside the pixel-locked ROI.
| Method | bpp | PSNR ↑ | LPIPS ↓ | DISTS ↓ | MS-SSIM ↑ | CLIP ↑ | FID ↓ |
|---|---|---|---|---|---|---|---|
| RPLC k=1 | .0089 | 20.13 | .0181 | .0140 | .9887 | .9836 | 8.88 |
| RPLC k=1, no reference | .0089 | 19.91 | .0208 | .0149 | .9847 | .9814 | 10.28 |
| RPLC k=2 | .0130 | 21.13 | .0154 | .0123 | .9904 | .9866 | 7.99 |
| RPLC k=5 | .0225 | 23.61 | .0102 | .0089 | .9931 | .9926 | 4.91 |
| DiT-IC q1 | .0089 | 18.76 | .0213 | .0167 | .9829 | .9768 | 11.29 |
| OneDC | .0107 | 19.71 | .0185 | .0145 | .9854 | .9822 | 8.95 |
| JPEG2000 Maxshift | .0088 | 19.45 | .0346 | .0252 | .9817 | .9645 | 17.88 |
| JPEG2000 ROI crop | .0089 | 15.58 | .0492 | .0356 | .9648 | .9530 | 22.73 |
| MS-ILLM ROI crop | .0122 | 22.03 | .0236 | .0165 | .9864 | .9773 | 12.21 |
| StableCodec ROI crop | .0125 | 22.21 | .0188 | .0133 | .9875 | .9859 | 8.64 |
- RPLC is better than the same-rate baselines on these pixels. RPLC k = 1 is better than Maxshift, the JPEG2000 ROI crop, DiT-IC and OneDC (20% more bits) on all six metrics (against Maxshift, PSNR +0.68 dB [0.44, 0.91], LPIPS −0.0165 [−0.0226, −0.0110]). The MS-ILLM and StableCodec ROI crops code the whole box with 37–40% more bits and lead in PSNR; at k = 2 (4% more bits than the StableCodec crop), RPLC is better than both crops on every metric except PSNR.
- The reference improves these pixels, whereas copying the archive into them does not. The reference improves all six metrics (PSNR +0.22 dB [0.06, 0.38], LPIPS −0.0027 [−0.0039, −0.0017], FID −1.39 [−2.75, −0.74]). Filling these pixels from the aligned archive instead is worse in LPIPS, DISTS, MS-SSIM, CLIP and FID under every colour matching (LPIPS .0248–.0430 vs .0181); even an oracle fit on these pixels, which exceeds RPLC in PSNR (21.69 vs 20.13 dB), is worse in the other five.
Protocol. 254 of 256 images contain such pixels (3.5% of the frame). PSNR is computed over these pixels; the other metrics use the 512 × 512 frame in which only these pixels come from the reconstruction, so their values are small and comparable only across rows.
Author response to Reviewer N3h7 (part 3/4)
R2 (continued): segmentation with and without the reference.
Table VII. Prompted segmentation against the manual masks (RPLC with / without the reference).
| Method | bpp | Mask IoU | Boundary F1 |
|---|---|---|---|
| RPLC k=1 | .0089 | 81.48 / 75.04 | .452 / .293 |
| RPLC k=2 | .0130 | 81.83 / 77.65 | .476 / .373 |
| RPLC k=5 | .0225 | 84.21 | .546 |
| Aligned archive alone | – | 74.91 | .346 |
| OneDC | .0107 | 77.84 | .396 |
| StableCodec ROI crop | .0125 | 70.15 | .342 |
| MS-ILLM ROI crop | .0122 | 66.03 | .252 |
| JPEG2000 Maxshift | .0128 | 62.41 | .162 |
- With the reference, RPLC k = 1 is above every baseline. It exceeds the StableCodec ROI crop by 11.33 pp IoU [9.03, 13.61], the MS-ILLM ROI crop by 15.45 pp [13.21, 17.74] and OneDC by 3.64 pp [1.78, 5.52] (Wilcoxon p ≤ 1e-5).
- The reference helps at low k, mainly at the target boundary. It raises IoU by 6.44 pp at k = 1 [5.34, 8.44], 4.18 at k = 2 [2.83, 5.57], 2.57 at k = 3 [1.35, 3.76] and a non-significant 1.29 at k = 5 [−0.01, 2.50]; Boundary F1 rises by 15.9, 10.3, 5.8 and 2.4 pp. Without the reference, RPLC k = 1 (75.04) is below OneDC (77.84) and above the StableCodec ROI crop (70.15).
Protocol and interpretation. SAM ViT-H is prompted with the official box and center point (the paper's script, identical for every method) and scored against the manual masks. The prompt gives SAM the target location, so these numbers measure shape preservation given the location, not detection. The reference matters more here than in the target metrics because SAM uses the whole box, including the target pixels outside the locked ROI and the context, both of which the reference helps reconstruct.
Revision. Section 4.2 ("Complete target") summarizes the ground-truth target, box and outside-lock results, and Table 1 reports segmentation with and without the reference; the full results are in Appendices D.4 (Tables D.6, D.7) and D.5.
Author response to Reviewer N3h7 (part 1/4)
Dear Reviewer N3h7, thank you very much for the precise and constructive review. We are encouraged by your positive comments on the concrete, auditable bitstream, which you consider the paper's strongest systems contribution, and on the complementary comparisons that support the ROI reconstruction advantage. Your questions also led us to correct two points of the paper: the zero-guide claim and the presentation of the paired gallery. We organize our response by your three questions, which together cover both weaknesses.
Q1: Independent downstream evaluation: Could you report results under the same held-out classifier for uncompressed images, RPLC with and without references, and representative strong learned ROI baselines? Please use a consistent configuration or explicitly identify differences in bitrate and alignment.
R1: Yes. Under one held-out classifier, RPLC k = 1 with the reference is above the baselines at the same rate and not significantly different from the strongest learned baselines with 20–40% more bits; the reference adds 7.8 pp at k = 1. Table V evaluates every condition with the same DINOv2 classifier and the same CLIP classifier and lists each rate.
Table V. Held-out top-1 (%), RPLC with / without the reference (same stream).
Updated Nov 17: Table V now has both classifiers for every condition; only empty cells were filled, and the conclusions are unchanged.
The reference helps at low k. It raises k = 1 accuracy from 13.3% to 21.1% with DINOv2 (McNemar p = 0.007) and from 22.7% to 29.3% with CLIP (p = 0.014). It is significant up to k = 2 with DINOv2 (p = 0.036) and up to k = 3 with CLIP (p = 0.0003), not beyond.
Against strong learned baselines, RPLC is on par or better with fewer bits. With DINOv2, RPLC k = 1 is not significantly different from OneDC (p ≥ 0.25) or the StableCodec ROI crop (p = 0.12), and is above the MS-ILLM ROI crop and DiT-IC (p < 0.001) as well as AEIC, the JPEG2000 ROI crop and Maxshift. With CLIP it is above OneDC (+7.8 pp [1.6, 14.1], p = 0.02), full-image StableCodec (p = 0.0002), AEIC, DiT-IC, the MS-ILLM ROI crop and Maxshift (p < 1e-4) and the JPEG2000 ROI crop (19.1%), and not significantly different from the StableCodec ROI crop (+5.9 pp [−0.4, 12.1], p = 0.086).
The result does not come from sharing DINOv2 with the completion loss. The CLIP ViT-L/14 classifier is never used by RPLC; its linear layer is trained on a disjoint fMoW split (58.9% top-1 on its validation split). Under it, RPLC k = 1 retains 53% of the uncompressed accuracy (59% with DINOv2).
fMoW classification mainly measures site identity, so we use segmentation as the main test of current-target information. The aligned archive alone, with no current pixels, reaches 30.5% / 48.4%, above every compressed condition, because fMoW categories describe land use that rarely changes; even pasting the uncompressed current ROI into the archive lowers CLIP accuracy to 41.8%. In classification, the reference's gain therefore largely reflects the site prior carried by the archive. In retrieval and segmentation, which depend more on the current target, the archive (instance R@1 53.1%, Mask IoU 74.91) is below RPLC k = 1 with the reference (63.7%, p = 0.014; 81.48, p = 1.2e-12).
Configuration. All RPLC outputs use the deployed decoder of Section 3.5 (archive aligned by ECC+RAFT to the reference-free reconstruction), and RPLC with and without the reference is decoded from the same stream (0.0089 bpp at k = 1). Every condition uses the same crops (official box, 15% square margin); the ROI-crop baselines also composite their crop onto the archive. The 21.09% vs 15.23% of Table G.3 came from the controlled run of Appendix G.4 (ECC alignment only, 0.00952 bpp staged stream); Section 4.2 now uses the deployed numbers, and every downstream result is reported with and without the reference.
Revision. Table 1 (Section 4.2) uses one classifier for every condition and lists each rate; Sections 4.1 and 4.2 were revised; Appendix D.5 gives the full Table V (Table D.8), the CLIP test, McNemar tests and the archive-only control, and Tables D.5 and G.3 are labeled as an earlier classifier and the controlled run.