- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies residual transport, which is caused by replacing the variance in a BatchNorm layer while retaining its source mean. The authors verify a signed, channel-wise shift and evaluate its prediction on disjoint calibration and evaluation images. Moreover, they use interventions, sign reversal, and channel permutation to examine its effect on downstream predictions. Based on above observations, they propose Residual-Balanced BN (RB-BN). Experiments over a series backbone show the promising results.
Critical strengths
- The paper uses disjoint calibration/evaluation splits, signed interventions, and exact-vector channel permutations, which provide useful evidence that the identified transport has a channel-dependent effect on downstream predictions.
- RB-BN follows from an explicit expectation-preservation constraint and requires no gradient-based optimization or tuned mixing weight.
Critical weaknesses
- On CIFAR-10-C and CIFAR-100-C, sequential RB-BN only matches sequential AdaBN within the reported uncertainty.
- RB-BN preserves the average output of the frozen BN layer on target data. In contrast, AdaBN uses the target mean to center the features. It is unclear why preserving the original output is more beneficial for adaptation. Although the experiments support the proposed residual transport mechanism, they do not fully explain why this preservation objective should improve prediction performance.
Questions for authors
- The ImageNet-C calibration splits use a fixed number of images per WNID. Does constructing these splits require class labels, and do the conclusions hold under class-agnostic unlabeled sampling?
- What evidence links the benefit of local residual compensation to the final all-layer performance, rather than merely showing that the injected channel-wise shift affects the frozen network?