- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper introduces a framework to evaluate cross-view generalization in fine-grained driver-behavior recognition. By decoupling the evaluation into three distinct properties: local linear recoverability, class-relational organization (RDM), and cross-view decision compatibility, the authors reveal that successful classifier recovery (refitting the head on frozen features) merely establishes accessible class information, but does not guarantee preserved representation geometry or portable decision rules.
Critical strengths
The main strength of this work is its rigorous and exhaustive empirical validation across both general foundation models and task-specific models. This comprehensive analysis yields several key insights:
-
The Illusion of Head-only Fine-tuning: High recovery accuracy (e.g., 94.1% for DINOv2) often masks severe overfitting to specific populations. Under strict driver-disjoint evaluation, performance drops precipitously, proving that the model merely "re-draws boundaries" for seen drivers rather than learning truly view-invariant features.
-
Geometry Does Not Equal Decision Compatibility: Even when the class-relational geometry is highly preserved across views (e.g., high RDM similarity within the same dataset), a shared classifier still exhibits severe view-asymmetry. This insight fundamentally clarifies that preserving structural distances in the feature space does not equate to aligned decision boundaries.
Critical weaknesses
None
Questions for authors
Q1 (Algorithmic Improvements): since the paper demonstrates that frozen features neither preserve portable decision rules nor maintain class-relational geometry, what is the most promising direction for algorithmic improvement?
Q2 (Practical Evaluation Protocol): how to translate the proposed comprehensive diagnostic framework into a lightweight and standardized evaluation metric for routine use?
Algorithmic directions and practical evaluation
We thank the reviewer for recognizing the rigor of the empirical comparisons and for raising two constructive questions. The revision treats the findings as an exploratory investigation of when class-discriminative information can be recovered locally but fails to support an unchanged decision at a different camera or driver population.
Q1. What algorithmic improvement follows? We do not claim that our experiments establish a new adaptation algorithm or identify the unique cause of failure. They identify where an algorithm would need additional evidence: T4-local seen-support recovery averages 73.46% while heads transported from the other cameras average 15.22% on that same receiver; source-fitted heads reach 27.55% there under a different fitting history. Combined with population-conditioned recovery, this suggests testing action-relevant versus driver/context-dependent cues and learning decisions robust to mounting-position changes. A discriminating next experiment would hold the receiver, support budget, driver breadth and preprocessing fixed while comparing pretrained and source-task-trained representations and targeted driver/context interventions. These are proposed tests, not completed improvements.
Q2. Can the diagnostic analysis become lightweight and standardized? The revised Discussion gives a practical minimum evaluation sequence, not an unvalidated universal score: (i) evaluate the unchanged source decision at the intended installation camera; (ii) with a declared small labeled budget, evaluate camera-local fitting and the unchanged fitted head/scaler on other receiving views; and (iii) repeat on drivers outside the fitting support, recording whether target statistics were used. Report the source, local and transported accuracies on named receiving cohorts, alongside labeled images per class (k), contributing drivers (m) and normalization access. Geometry and more expensive diagnostics can then be added when the functional results warrant explanation. We cannot yet establish a single predictive metric or optimal operating threshold.
The revised Results foreground the directional T4/SF3D observation, the local-versus-transport separation and the support-population results. Discussion 6.4-6.5 now explain evaluation usefulness and testable algorithmic directions. We appreciate the reviewer prompting this clearer distinction between empirical discovery, prospective mechanism studies and practical use.