- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper studies autoencoder reconstruction under spatial data imbalance. Here, rare intensities at fixed pixel locations get averaged out, causing blur. It proposes two components. The first is a self-information (SI) loss: MSE plus an L1 term weighted by batch level, per location surprisal. The second is Sample Propagation (SPP), which carries the hardest samples into the next batch. Experiments cover a synthetic pendulum, three real datasets and four autoencoder families. The paper reports lower MSE and higher PSNR, with competitive SSIM.
Critical strengths
- The paper frames location wise intensity imbalance as a distinct failure mode of autoencoders. This matters for scientific imaging, where content is sparse and labels are scarce.
- Neither component changes the architecture or inference cost. Both are tested on four autoencoder families and three real datasets.
Critical weaknesses
- The key ablation is missing. The SI loss is MSE with a L1 term. L1 alone reduces blur. Yet the paper never compares against uniformly weighted L1. It also omits L1 weighted by a simple proxy, such as variance or a foreground mask. So the gains cannot be attributed to the self-information weighting.
- The comparison may not be fair. Some baselines seem to fail. With MAE, VGG and Watson reach SSIM of only 0.05–0.11. CE reaches only 5–8 dB PSNR. Section 4 says hyperparameter ranges are in the appendix, but none are given. J and the baseline settings are also missing.
- The main text and appendix often disagree. Such as the captions of Tables 13 14 15 use a different memory definition from the main text. The Appendix part does not appear to have been carefully checked before submission. Such as several bold marks in Table 13 highlight worse results, not the best ones.
Questions for authors
Questions that could change my assessment: How does MSE + λ·L1 with uniform weights perform? How does variance or mask weighted L1 perform? Please report search ranges, selected values and J for all methods. Did baselines get the same tuning budget? Background pixels get weight α = 0.05 in the SI term. Does this cause false positives in the background? Please report background error separately. Clarifications: How do results change with a dataset level histogram? How do they change with B = 16 or 256? The main text defines M = B/k, so SPP2 has the largest memory. Tables 13 14 15 instead describe “memory of size k.” Which is correct?
Response to Reviewer jpBC
We thank the reviewer for recognising spatial imbalance as a distinct failure mode and the architecture-agnostic design. Page (p.) and line (l.) numbers refer to the revised PDF. The new experiments are in Appendix B (pp. 27–33).
W1. Missing ablation: uniformly weighted L1, and L1 weighted by a simple proxy. We agree that this ablation was missing. We added the requested controls with the same code path, sample weighting, λ and training settings as SI; only the per-pixel L1 weight changes (Appendix B.1, Table 16, p. 27): (i) MSE + a·L1 with a equal to the mean SI weight, so the total L1 weight matches; (ii) the per-location batch variance; (iii) a foreground mask. SI beats the mask on every block. Against MSE + a·L1, over three seeds (Table 21, p. 31), SI is better on Galaxy and Pendulum in every seed and ties on Mitosis on average metrics. These metrics are dominated by the background; on the rare foreground content, SI lowers the error by 5–36% against the constant weight (Table 17, p. 27). So where the gain appears, it comes from where the weight is placed, not from adding L1. Variance is the strongest proxy but measures something else: it weights a location in every image, while SI weights the value in the current image. A star that appears in one image sits at a near-zero-variance location yet is the rarest value there (Appendix B.2, Fig. 15, p. 29); this is why SI is better on Galaxy and Mitosis. Qualitatively, SI recovers isolated stars that the control smooths away, while on Mitosis both are similar (Figs. 13–14, p. 28). A λ sweep on all 12 settings is in Table 18 (p. 30).
W2. Fairness of the comparison: failing baselines and tuning budget. We partly agree: the collapses are known failure modes of these losses, but the baselines deserved the same tuning budget, which we now give them. CE assumes Bernoulli targets and collapses on mostly dark images with continuous intensities (Galaxy, and MAE on all datasets). VGG and Watson are perceptual and do not constrain absolute intensity, so alone with an MAE they reproduce structure poorly. These are known failure modes, not under-training; all methods share the architecture, optimiser, epochs and batch size. To rule out a tuning artefact, we gave the baselines the same budget as SI (four values of their main hyperparameter; Appendix B.4, Table 22, p. 31): focal γ, LDAM margin, equalization threshold, and CE, VGG and Watson combined with L2 on the MAE. Adding L2 removes their collapse, but the best tuned baseline stays below SI on every MAE block.
W2 (cont.). Hyperparameter ranges, J and baseline settings are missing. We agree and apologise. We use J = 150, α = 0.05 and the λ per architecture in Table 8 (p. 19), now stated in Appendix A.3 (p. 15, l. 798–801). Table 22 (p. 31) lists the search grid and best configuration of every tuned method; all use learning rate 10⁻³, 1000 epochs and B = 128. We also added an ablation over J (see Questions).
W3. Disagreement between main text and appendix; wrong bold marks. We agree; these were errors in the appendix, now fixed. The main-text definition is correct: sppk propagates M = B/k samples, so spp2 has the largest memory; the captions of Tables 13–15 (pp. 24–26) are corrected. All appendix tables are now generated by a Python script from a single results file, with bold computed rather than marked by hand, which fixes the Table 13 errors.
Questions. Uniform and variance- or mask-weighted L1: see W1. Search ranges, selected values, J and tuning budget: see W2. We also added an ablation over J ∈ {16, 64, 150, 255} (Table 19, Fig. 16, p. 30): J = 16 is too coarse and 64–255 differ by at most 0.3 dB on Galaxy and Mitosis. Does the α = 0.05 floor cause false positives in the background? We respectfully disagree, and added a measurement to check it: background pixels keep the full MSE term plus at least α of the L1 term, so their error is still penalised; only their relative weight is lower. Table 17 (Appendix B.1, p. 27) splits the error into background and foreground: SI's background error rises by 19–30% relative to the uniform control but stays of the order of 10⁻⁴, while its foreground error drops by 5–36%. A foreground mask lowers foreground error further but raises background error 2.8–24× relative to SI, the failure the reviewer describes.