- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces Reference Region Alignment (RRA), an operator applied around downsampling operations in ConvNets aiming to make general them translation and roto-reflection equivariant. The method is evaluated on standard ResNet for image classification on CIFAR and ImageNet and semantic segmentation on PASCAL-VOC The paper reports 100% consistency under circular shifts, rotations and reflections, improved consistency under standard translations, and competitive accuracy compared with conventional sampling and approaches such as APS, LPS and LPF.
Critical strengths
- RRA introduces no additional trainable parameters and can be combined with standard sampling operators.
- RRA is evaluated on several datasets, including classification and segmentation tasks, and reports perfect circular shift-consistency and improved standard-shift consistency, while maintaining competitive accuracy.
Critical weaknesses
-
The method is introduced as an adaptation to sampling operators in CNNs. However, in experiments involving rotations and reflections, RRA is additionally applied to the input. This appears to serve as canonicalization, addressing the fact that standard convolutions are not rotation/reflection equivariant, but this point is not discussed in the paper. With valid input canonicalization, applying RRA around internal sampling operators is unnecessary to obtain classification invariance. It therefore necessary to compare the method against other canonicalization approaches such as [1]. Additionally, it is unclear whether input RRA is enabled for the accuracy and shift-consistency results in Tables 2 and 3, or only for the rotation/reflection evaluation mentioned in the text. In the latter case, this makes it difficult to assess its effect on accuracy. Additionally, Rotation/reflection consistency is also not reported for the other baselines.
-
The paper does not engage with more recent anti-aliasing approaches such as [2,3]. In particular, [3] guarantees invariance to both integer and fractional circular translations, whereas the evaluated LPF approach [4] provides more limited guarantees. Additionally, [3] demonstrates that adaptive sampling approaches can be vulnerable to fractional translations, an issue that is not discussed or evaluated here.
-
In some cases the gains of RRA compared to the other baselines appears to be small, for example the accuracy in Table 2 and S-Consistency in Table 3. The paper does not report standard deviation of the results in Tables 2-4 although the experiments are repeated for 5 seeds.
[1] Equivariant Adaptation of Large Pretrained Models, Mondal et al., 2023.
[2] Alias-Free Generative Adversarial Networks, Karras et al, 2021
[3] Alias-Free Convnets: Fractional Shift Invariance via Polynomial Activations, Michaeli et al, 2023
[4] Making convolutional networks shift-invariant again, Zhang, 2019
Questions for authors
- Is RRA applied on the input in the results reported in Tables 2 and 3? if not, can you report how does applying RRA on the input affect the accuracy?
- Can you report an input-only RRA baseline and compare with other canonicalization methods? Specifically, is input-only RRA is sufficient for translation and roto-reflection invariance?
- Can you report rotation/reflection consistency for the competing methods in Tables 2-3?
- How does RRA perform compared to the other baselines under fractional translations, such as those considered in [3]?
- Can you report the standard deviation of the results reported in Tables 2 and 3?
[3] Alias-Free Convnets: Fractional Shift Invariance via Polynomial Activations, Michaeli et al, 2023
2 comments
I thank the authors for their responses. Unfortunately, my main concern remains unresolved. The authors clarify that the roto-reflection consistency results, reported only in the text, were obtained using input-level RRA, whereas the accuracy results in Tables 2 and 3 were obtained without it. Thus, no classification accuracy is reported for the configuration used to obtain roto-reflection consistency, leaving the effect of input-level RRA on accuracy unclear. Since roto-reflection invariance is a central claimed contribution, I consider this an important gap in the evaluation and therefore maintain my original score.
We sincerely thank the reviewer for the constructive feedback and valuable suggestions. We address the specific questions below.
Q1. Input RRA in Tables 2 and 3
RRA was not applied to the input in the experiments reported in Tables 2 and 3; it was incorporated only around the internal sampling operations. Input-level canonicalization was used separately for the roto-reflection consistency evaluation, since standard convolutions are not inherently rotation/reflection equivariant. We acknowledge that evaluating the effect of input-level RRA on classification accuracy would provide valuable additional insights. We appreciate this suggestion and intend to investigate it in the next iteration of our work.
Q2. Input-only RRA and canonicalization baselines
We agree that evaluating an input-only RRA baseline and comparing it with existing canonicalization methods would help distinguish the contributions of input-level and layer-level alignment. In principle, valid input canonicalization can provide classification invariance to the transformations it canonicalizes, whereas internal RRA is designed to preserve transformation consistency at sampling operations. A controlled comparison of input-only, layer-only, and combined configurations would provide a clearer understanding of their respective contributions. We appreciate the reviewer highlighting this important experimental direction and intend to incorporate these comparisons into the next iteration of the work.
Q3. Rotation/reflection consistency of competing methods
The baseline results in Tables 2 and 3 were taken directly from their respective original publications rather than obtained through reimplementation or retraining. The competing methods primarily address shift invariance/equivariance and do not explicitly claim or report rotation/reflection consistency under a comparable evaluation protocol. Consequently, these results were not available for inclusion in our comparisons. We agree that evaluating the competing methods under a common rotation/reflection protocol would provide a more comprehensive assessment and appreciate this suggestion for the next iteration of our work.
Q4. Fractional translations
We thank the reviewer for highlighting this important direction and drawing our attention to the work of Michaeli et al. (2023). Our present formulation of RRA focuses on discrete integer translations and roto-reflections, while fractional translations have not been investigated theoretically or experimentally. Therefore, we cannot make claims about its performance relative to existing methods under fractional translations. We acknowledge the relevance of recent alias-free approaches, including Karras et al. (2021) and Michaeli et al. (2023), and recognise the importance of positioning RRA within this broader literature. We appreciate this suggestion and will consider fractional-translation robustness and comparisons with these methods in the next iteration of our work.
Q5. Standard deviations in Tables 2 and 3
All RRA experiments were repeated across five random seeds, and the corresponding standard deviations are already reported in the manuscript text. However, the baseline results in Tables 2 and 3 were taken directly from their respective original publications, where standard deviations were not consistently available. Reporting comparable standard deviations for these methods would therefore require reimplementing and rerunning the baselines. We hope this clarifies the distinction between our experimental results and the previously published baseline scores.