- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates the contribution of low-resolution training data to models evaluated on high-resolution inputs. The authors consider a mixed-resolution learning setting, motivated by practical constraints such as storage limitations. The results suggest that using more low-resolution data can improve high-resolution classification performance, particularly when high-resolution training samples are scarce.
Critical strengths
- The paper addresses an important problem in machine learning, that data may be collected at heterogeneous resolutions. The assumption that high- and low-resolution observations are unpaired is realistic.
- The authors provide quite comprehensive theoretical analysis based on KL divergence,this offers an interesting perspective on understanding the contribution of observations at different resolutions.
- The experimental contains image and audio classification, including a multi-institutional medical dataset. The comparison provides useful observations regarding distribution shifts.
- The supplementary investigates more impacts on other parameters.
Critical weaknesses
- I think there is a discrepancy between the paper's theoretical and empirical evaluation. The theory measures parameter shifts between resolutions of the same observation, but the experiments measure downstream accuracy after adding distinct low-resolution samples. I found their link is still unclear.
- The proposed mixed-resolution strategy resembles data augmentation in training (e.g., multi-scale, corruption-based data augmentation). The experiments didn't show the benefits of this strategy. As the paper lacks direct baseline comparisons to standard downsampling or resolution-degradation applied to existing high-resolution samples, it remains unclear whether the performance gains are driven by increased dataset size.
- The experimental evaluation relies on simple, low-resolution classification benchmarks (like 32×32 CIFAR). To convincingly demonstrate general applicability, the paper requires experiments on genuinely high-resolution, complex datasets, for example such as 3D medical imaging, video, where resolution degradation physically destroys task-relevant fine structures.
Questions for authors
The authors can see the weaknesses for questions.
2 comments
Dear Reviewer mo2V. We thank you again for your review. As the discussion period is coming to an end, we would be grateful for your feedback on whether our response and the revised PDF have addressed your concerns, or if there are any points that would benefit from additional clarification.
We thank the reviewer for appreciating the realistic problem setting and the comprehensive theoretical analysis.
W1: You are completely right, we have addressed this in W1 Reviewer Bb5J W1
W2: You are right that this is not mentioned in the paper. To make it more clear, we have added a sentence in the Empirical Setup section that mentions our data augmentation explicitly; this was lacking in our original submission. To summarise our data augmentation, the Subset experiments include several data augmentation approaches to ensure we obtain good performance, and such that the improvements in the Ratio experiments can be isolated to the addition of the low-resolution samples. Appendix D.2 details that we add randomcrop, random erasing, and color jitter that all degrade the data in ways similar to downsampling. We further also train with CutMix and Mixup.
W3: You are right that many of our results are based on experiments on CIFAR10 and CIFAR100. We emphasise that we also report results based on the real-world medical fed-isic2019 dataset that is 224×224 in dimensions and is therefore genuinely high-resolution. Overall, we believe the empirical evidence is sufficient to demonstrate that incorporating low-resolution data during training can provide meaningful benefits when high-resolution data are scarce.
We believe that we have addressed all of your concerns, and if so hope you would consider updating your recommendation accordingly.