- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies class-incremental object detection with YOLOv8 and proposes two components. ESPReg penalizes parameter changes along historical feature directions using calibrated covariance eigenvalues. CAD distills the teacher’s most confident old-class channel at each prediction location, weighted by its confidence. Experiments on Pascal VOC and MS COCO report improvements over several incremental detection baselines, together with analyses of feature drift and cross-task class confusion.
Critical strengths
- Studying incremental learning with single-stage detectors is a worthwhile direction. Both components can be incorporated into the training objective without introducing an additional inference module, which makes the approach practically appealing;
- The evaluation covers two standard benchmarks and several incremental protocols, including multi-step learning on VOC. This gives a broader picture of the method than a single base-to-new transition;
- The component ablation and feature-drift analysis are useful. Tab. 4 suggests that ESPReg and CAD are complementary, while the within-YOLO comparison in Table 5 provides additional evidence that ESPReg reduces representation changes.
Critical weaknesses
- I think the derivation gives a reasonable local motivation for ESPReg, but its scope needs to be stated more carefully. Eq. 3 to Eq. 6 consider a single layer while keeping its input fixed. During incremental training, upstream layers also change, so the input to that layer will generally change as well. Furthermore, Eq. 8 replaces the raw eigenvalues in the derived bound with clipped, normalized weights, assigning the same weight to all dominant directions. The resulting penalty is therefore different from the quadratic quantity originally derived. It would help to explain what connection to the drift bound remains after these changes, and how this supports the claimed stability of the full feature extractor;
- CAD preserves one selected old-class probability at each location. I think the paper needs to explain more clearly why this choice should improve competition between old and new classes. An old-class score can remain close to the teacher’s prediction while a new-class score becomes larger, so preserving that one channel does not directly preserve the classification margin. The evidence in Fig. 1 also needs clarification: its caption describes average post-softmax confidence scores, whereas Sec 6.3 interprets the change from 73% to 42% as a reduction in misclassification rate. These are different measurements. A confusion matrix based on matched detections would provide more direct evidence that CAD reduces old-to-new classification errors;
- Meanwhile, I have a concern about the result. Under the standard class-wise mAP definition, if old, new, and all use the same predictions and evaluation settings, All should be their class-count-weighted average. In Tab. 1, ESP-YOLO reports 80.4 for Old and 77.1 for New in the 15 + 5 setting, which would give approximately 79.6 overall, rather than the reported 75.0. Similar discrepancies appear in Tab. 3 and Tab. 4. One possible explanation is that Old/New are task-aware scores while All is task-agnostic, as the discussion in Sec. 6 suggests. If so, this distinction needs to be explicit, and the comparison with published baselines needs to use the same protocol. Reporting per-class AP from one shared task-agnostic evaluation would resolve much of this uncertainty.
Questions for authors
- How does the single-layer drift analysis extend to changing upstream representations, and what relationship to the bound remains after eigenvalue clipping?
- Are the values in Figure 1 confidence averages or detection error rates? Can the authors report old-to-new confusion using matched detections?
- Are Old/New evaluated with task information while All is evaluated without it? Are the published baseline scores obtained under the same settings?
- Do all YOLO baselines share the same initialization and pseudo-labeling procedure? How do ESPReg and CAD compare with the two simpler controls described above?
Above all, if the author can solve all of my questions. I would like to consider to rise my scores.