- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes Representation Error Residual (RER) blocks for parameter-efficient convolutional networks. A convolutional representation is mapped back to the input space through a weight-tied transposed convolution; the resulting reconstruction residual is projected through a separate 1 × 1 convolution and batch normalization and added to the forward representation. The evaluated architecture also includes an outer residual shortcut and a depth-dependent novelty-strength schedule. On CIFAR-100, the paper reports 80.95% accuracy with 3.78M parameters for RERNet-L8, compared with 81.10% and 11.23M parameters for ResNet-18. Experiments also cover CIFAR-10, Oxford-IIIT Pet segmentation, qualitative novelty maps, and inference costs on one GPU. The intended contribution is a compact architecture that trades additional computation for a smaller parameter footprint.
Critical strengths
-
A simple and testable architectural idea. Tying the reconstruction operator to the forward convolution avoids the parameter cost of a separate decoder. The novelty projection can be incorporated into a conventional residual network, making the proposal concrete and easy to investigate. The paper also usefully distinguishes its feedforward construction from iterative predictive-coding inference (§2.2).
-
A promising measured parameter–accuracy trade-off. Table 1 reports nearly the same CIFAR-10/100 accuracy as ResNet-18 using approximately one third of its parameters. Reporting MACs and measured latency, alongside parameter count, makes the computational trade-off visible rather than implying that fewer parameters automatically mean fewer operations. The segmentation experiment provides an additional, albeit less competitive, test of the learned backbone.
Critical weaknesses
-
The experiments do not isolate the contribution of the reconstruction residual. Table 1 varies network width and depth, but the provided materials do not report controlled comparisons that disable the novelty contribution within otherwise unchanged RER blocks, replace reconstruction residuals with projected inputs, or use matched-capacity residual blocks. Consequently, the benefit could arise from architectural differences or the additional transformation rather than the proposed residual mechanism. This matters because the information-preservation interpretation is the central explanation for the results. Weight tying alone does not establish that the transpose reconstructs precisely the information captured by the forward mapping; normalization and nonlinearity further complicate this interpretation. Appendix A.2 explicitly discusses leaving normalization uncorrected in the reconstruction, but supplies no quantitative validation. Figure 3 shows structured maps, which is suggestive, but cannot establish complementary information or an accuracy contribution. Controlled ablations would directly address this concern; a formal preservation theorem is not necessary.
-
The experiments do not establish an advantage over residual baselines at matched parameter budgets. Table 1 reports substantially fewer parameters and similar accuracy for RERNet-L8 relative to standard ResNet-18, but does not show whether a narrower residual model at approximately 3.8M parameters would perform similarly. The evaluation protocols also need to be aligned with the reported results: the supplied
train_cifar.pyevaluates the official test split after every epoch and saves the checkpoint with the highest test accuracy, whereastrain_mobilenetv2.pyselects its checkpoint on a held-out portion of the training set. It is unclear which of these procedures produced each Table 1 entry. Clarifying this mapping and providing comparisons under a common validation-based selection protocol would strengthen the evidence. The tables also omit run-to-run variation, limiting interpretation of the 0.15 percentage-point CIFAR-100 gap.
Questions for authors
-
Can you compare the full RERNet-L8 with (a) α_i = 0 for all RER blocks while retaining their original forward structure, nonlinearities, and shortcuts, and (b) a projected-input branch without the reconstruction term? Setting the constructor's
alpha_max=0currently substitutesResidualBlockand changes the pre-addition activation, so it would not isolate the novelty contribution. Please report parameter/compute differences and whether the benefit is consistent across runs. -
Which checkpoint-selection procedure produced each Table 1 result? With a common held-out validation protocol and multiple independent runs, how does RERNet-L8 compare with a residual network narrowed to approximately the same parameter budget?
-
Could you map the supplied training configurations to Tables 1–2, including the MobileNet-V2 variant and classifier head, and reconcile them with Appendix A.1? For example, the classification wrapper sets αmax=1, while the segmentation entry point uses the RERNet default of 0.5 and defaults to AdamW rather than the stated SGD pipeline.
We thank the reviewer for their careful evaluation and constructive feedback.
Weakness 1: The contribution of the reconstruction residual is not isolated
We evaluate the following variants:
These experiments highlight that the reconstruction-error term provides a benefit beyond the additional projection and the underlying forward transformation.
Weakness 2: Normalization complicates the information-preservation interpretation
We agree that BatchNorm is not merely a neutral operation in this context. Its affine transformation and normalization statistics can affect the relationship between the forward feature pathway and the reconstruction-error pathway. We avoid interpreting the reconstruction pathway as an exact inverse or claiming that it guarantees information preservation. Instead, we describe it as a learned reconstruction-based correction that provides an additional representation of the discrepancy between the block input and its reconstruction.
The reconstruction pathway can attenuate, counteract, or reinforce particular components of the direct feature contribution, depending on the learned reconstruction weights, novelty projection, BatchNorm parameters, and activation pattern. Changes to the features therefore independently affect the direct feature representation and the reconstruction-derived correction. This is to fulfill the primary motivation of performing more work per parameter.
Weakness 3: Comparisons with matched-parameter residual networks are missing
Our intention was to only test over popular standard architectures; modifying channel counts without a representative ablation for the architectures risks selection bias and introducing failure modes which are not attributable to the prior works hence it was considered beyond the scope of this study.
Weakness 4: Training protocols are inconsistent
We chose a training pipeline which achieves state-of-the-art reported results for the tested ResNet variants. We acknowledge in the appendix that the stated MobileNet-V2 comparison uses a different policy as it failed to scale with the same training pipeline that was used for all RERNet and ResNet variants; we provided code to train it both ways. We did not wish for the table to underrepresent known reported accuracies for the tested architectures hence we describe the best results reproducible from our code.
Weakness 5: Run-to-run variation is not reported
We have added mean and standard deviation for RERNet variants over 5 runs. We limited multi-run experiments to CIFAR-100 which is the harder baseline. Variations between runs is low so we believe single CIFAR-10 results are reasonably representative of model results.
Questions for Authors
Q1. Can you compare the full RERNet-L8 with (a) αi=0 and (b) a projected-input branch?
An RER-free (effectively αi=0) RERNet-L8 model achieves 79.03$\pm$0.29 on CIFAR100. A residual-free RERNet-L8 model achieves 80.25$\pm$0.40 on CIFAR100.
Q2. Which checkpoint-selection procedure produced each Table 1 result?
We report the accuracy of the best performing checkpoint on the test set across training epochs. We provide an alternative MobileNet-V2 training policy as it failed to scale with the same training pipeline that was used for all RERNet and ResNet variants.
Q3. Can you map the supplied training configurations to Tables 1–2 and reconcile the differences in αmax and optimizer settings?
For classification, we use the SGD-based training pipeline described in Appendix A.1. For semantic segmentation, we use AdamW. This choice is motivated by the different optimization characteristics of dense prediction tasks, where the model produces spatially distributed predictions and gradients are influenced by pixel-level class imbalance and the interaction between encoder and decoder components. AdamW provides adaptive parameter-wise updates and decoupled weight decay, which we found suitable for optimizing the segmentation architecture.
The segmentation implementation also uses the default RERNet value of (\alpha_{\max}=0.5), whereas the classification wrapper explicitly sets (\alpha_{\max}=1.0). These are task-specific configurations rather than a single shared training setup.
We revised the experimental description and Appendix A.1 to explicitly distinguish the classification and segmentation configurations, including the optimizer, learning-rate schedule and novelty scaling parameters.