- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies how much an oriented object detector’s accuracy changes when the input image is rotated by 90°, 180°, or 270° and the predictions are rotated back. Instead of reporting one average number, the authors split the accuracy loss into a quarter-turn cost C (average loss on the 90° and 270° views), a half-turn cost H (loss on the 180° view), and a chirality Q (difference between the two quarter turns), arguing that these respond to different parts of training. To test this, they train a YOLO11-OBB detector on DOTA, an aerial-image benchmark with 15 object classes, under four augmentation settings that differ only in whether vertical flips and rotation augmentation are used (horizontal flips are always on), with three seeds each. They find that adding vertical flips, which together with horizontal flips produce a 180° rotation, removes H but leaves most of C, while adding rotation augmentation removes both; in other words, each cost disappears only when training covers that rotation. They also show that even when rotation-trained models lose no accuracy on rotated views, about 12% of their predictions have no matching prediction on the rotated view, so accuracy under rotation and rotation-equivariance are different properties.
Critical strengths
-
The experiment is designed so that the augmentation is the only thing that changes: All four training settings start from the same checkpoint, share every hyperparameter, and are compared within a seed, so a difference in C or H between two cells can only come from the augmentation.
-
It catches a measurement trap that would mislead anyone using the usual metric. Two models can score identically on rotated images while producing different detections; the paper shows this is what happens after rotation training. So “accuracy doesn’t drop under rotation” cannot be interpreted as “the model is rotation-equivariant”. That is a nice clarification.
Critical weaknesses
-
The abstract is very long with ~20 numbers and never states the one-line result or takeaway very clearly. The body reads like a lab notebook and is hard to follow.
-
Training on a rotation removes the cost of that rotation, which the authors admit is what coverage predicts, and the advice (use vertical flips and rotation) is already standard. The non-obvious findings (negative chirality, ReDet’s half-turn cost, 12% disagreement after rotation training) are not explained properly, not sure if I am missing to understand these properly though.
-
The vertical flip removes 17% of C under macro weighting but 58% under instance weighting, and the chirality reversal holds under macro only. The paper reports both weightings but never states which readers should treat as primary, and the abstract uses the macro numbers alone.
Questions for authors
-
Please report C per class in the H and HV cells, and state which weighting you consider primary. If the flip-resistant part of C comes from two or three low-instance classes, then it becomes more about those classes than the general detector right?
-
Could you run a cell with degrees ∈ {0, 90, 180, 270} exactly, with no interpolation? If coverage alone removes C it should match HR/HVR; if it does not, continuous rotation also contributes something beyond coverage
Thank you for the revisions and clarifications. However, I still find the paper difficult to follow, and the exact right-angle training control is still incomplete, so I maintain my original score.