- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes FrSIoU for oriented bounding-box regression by combining semantic guidance with a fractional-order history-based modulation mechanism. The semantic component introduces feature-level similarity into IoU-based regression, while the fractional component is intended to stabilize abnormal angular gradients using historical semantic-geometric similarity. The method is evaluated on multiple oriented detection benchmarks and reports consistent improvements, including gains on high-precision localization metrics.
The overall direction is interesting and the empirical results are promising. However, I have several concerns regarding the theoretical analysis underlying the proposed gradient stabilization mechanism and whether the experiments sufficiently isolate the claimed contribution.
Critical strengths
The semantic-geometric coupling is intuitive and potentially useful. Instead of treating semantic supervision as an independent auxiliary objective, the method directly uses semantic consistency to modulate geometric regression. The evaluation also covers multiple datasets and detector architectures, which provides useful evidence of generalization.
Critical weaknesses
1. The angular-gradient analysis in Sec. 3.1 seems to rely on a geometric assumption that does not hold throughout the claimed optimization regime.
Eq. (2) is derived under the assumption that the intersection of two center-aligned OBBs is a parallelogram. However, as the angular error approaches zero, the intersection is no longer a parallelogram, which is also implicitly acknowledged by the boundary-condition analysis in Appendix C. Therefore, the statement that “the angular derivative grows as the angular error decreases” does not appear to hold generally over the whole convergence process. More specifically, the derived expression is valid only within a particular intersection topology and should not be extrapolated to the zero-angle limit. This issue weakens part of the motivation for the subsequent gradient-stabilization mechanism. The authors should clarify the valid angular range of the analysis and, ideally, verify the claimed gradient behavior using the exact rotated-IoU computation rather than the parallelogram approximation.
2. The Semantic IoU formulation may suppress useful geometric gradients in semantically ambiguous cases.
The proposed SIoU loss multiplicatively gates the geometric IoU term using the semantic score. Consequently, when the semantic score is close to one while the geometric IoU is still very low, the loss and its gradient with respect to box parameters can both become very small. This may be problematic in scenes containing repeated or visually similar objects, where a predicted box can have high semantic similarity to the target while being geometrically far from the correct instance. In such cases, the semantic term may prematurely suppress the localization gradient and prevent effective parameter updates. The paper should explain how this failure mode is avoided and provide empirical evidence, for example by analyzing cases with high semantic similarity but low IoU.
3. The interpretation of the fractional modulation as a gradient-stabilization mechanism needs further justification.
For some valid parameter settings, a stationary sIoU sequence can still produce a modulation weight smaller than one. This behavior may be desirable when several consecutive sIoU values are already close to one, because reducing the update magnitude near convergence is reasonable. However, the same behavior can also occur when several consecutive sIoU values remain consistently low, in which case further suppressing the update may be undesirable because stronger correction is arguably needed. Therefore, the current interpretation that the fractional signal distinguishes improving and deteriorating optimization states appears incomplete. The authors should clarify whether the method is intended to model temporal trend, similarity level, or both, and analyze how it behaves for high-quality and low-quality stationary trajectories
4. The comparison with existing gradient-stabilization methods is insufficient.
The main motivation of FrSIoU is to address abnormal gradients in rotated IoU optimization, but closely related methods such as Gradient Calibration Loss directly study and correct the same type of angular-gradient instability. GCL explicitly analyzes the negative correlation between rotated-IoU gradient magnitude and angular error and proposes gradient calibration to stabilize convergence. The paper would be significantly stronger with a controlled comparison against GCL and other dynamic reweighting approaches. Without such comparisons, it is difficult to determine whether the observed gain is specific to the proposed fractional-order mechanism or can be achieved by simpler gradient calibration or history-based weighting strategies.
5. The gradient derivation in Appendix A is unclear with respect to historical states.
Appendix A differentiates historical IoU states with respect to the current angular parameter and interprets the resulting expression as a weighted combination of historical geometric gradients. However, in standard iterative training, historical sIoU values are usually computed using previous network parameters and stored as detached values. If this is the actual implementation, their gradients with respect to the current parameters should be zero. If, instead, the method retains previous computation graphs and differentiates through the optimization history, this would imply a substantially different implementation and nontrivial memory cost. The paper should clearly explain how the historical states participate in automatic differentiation and ensure that the theoretical derivation is consistent with the actual implementation.
Questions for authors
Besides of the above weaknesses, there are two minor concerns:
1. Eq. (11) appears to contain an error.
As currently written, the coefficient recurrence in Eq. (11) does not generate the coefficients subsequently used in Eq. (12). The coefficients in Eq. (12) are consistent with the standard Grünwald–Letnikov recurrence, suggesting that Eq. (11) likely contains a typographical or algebraic error.
2. Two important hyperparameters of the fractional formulation are insufficiently specified and analyzed.
The fractional order and the number of historical steps directly determine the coefficients and temporal behavior of the proposed fractional operator, yet the paper does not clearly report their values in the experimental configuration and provides no ablation study for either parameter. Since both are central to the claimed memory and stabilization effects, their implementation values, sensitivity, and impact on performance should be explicitly reported.