- Rating
- 4
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes OSFAL, a framework for AS-ReID that addresses the challenges arising from heterogeneous spectral modalities and camera views. OCSFA aligns features from different spectral modalities through modality-specific orthogonal transformations and mean translations, with identity-wise modality-view prototype consistency used to guide the alignment. LLCVL analyzes layer-wise feature statistics to automatically identify a suitable intermediate layer for applying cross-view contrastive supervision, without introducing additional modules at inference time. Experiments on WHU-MARS under multiple evaluation protocols demonstrate the effectiveness of the proposed framework. OCSFA provides substantial improvements over the baseline, and LLCVL brings further gains when combined with OCSFA.
Critical strengths
- A well-motivated and complementary approach to two distinct sources of heterogeneity. The paper explicitly addresses both cross-spectral discrepancies and cross-view variations, which are important challenges in AS-ReID. OCSFA reduces spectral discrepancies through structured feature alignment, and LLCVL adaptively determines where cross-view supervision should be applied.
- On WHU-MARS-1000, OCSFA improves Rank-1 accuracy from 29.3% to 33.4%, and the complete OSFAL framework further reaches 34.3%. The component ablations suggest that OCSFA accounts for a substantial portion of the improvement and that LLCVL provides complementary gains. The evaluation across multiple protocols and spectral-modality pairs also offers a broader assessment of the method than a single aggregate result. Overall, the empirical findings support the practical value of the proposed design.
Critical weaknesses
None
Questions for authors
- Although the ablation studies show that LLCVL improves the baseline and provides further gains when combined with OCSFA, a comparison with applying the same supervision at fixed intermediate layers would more directly demonstrate the value of the adaptive selection mechanism. This limitation does not undermine the overall effectiveness of OSFAL demonstrated by the experiments.
- Could the authors report the additional computational overhead introduced by OSFAL compared with the baseline, such as training time, GPU memory consumption, and any additional computational costs associated with OCSFA and LLCVL? This information would help readers better understand the practical trade-off between the performance improvements and the additional cost of the proposed framework.
Response to Reviewer rBZB
Thank you for the constructive questions. We conducted a fixed-layer comparison and a computational-overhead profile.
Q1. How does LLCVL compare with supervision at fixed layers?
We applied the same supervision separately at each of the 12 ViT blocks on WHU-MARS-1000. All results below are from Epoch 120 under matched training settings.
Adaptive LLCVL demonstrates superior and more balanced performance across multiple key metrics. It achieves the highest scores in mAP, Rank-1, and Rank-5, outperforming all fixed-block strategies. While Fixed Block 9 yields a slightly higher Rank-10 score, LLCVL maintains a strong Rank-10 performance while significantly excelling in the more critical top-ranking metrics.
Q2. Computational overhead. We profiled matched variants on WHU-MARS-1000 using four RTX 3090 GPUs and a global batch size of 256.
The measured FLOP and memory overheads are modest. Relative to UAD, OSFAL increases the accounted computation by 0.5610 TFLOPs per global training step (+1.08%) and peak allocated memory by 0.464 GiB per GPU (+3.9%). LLCVL adds almost no counted FLOPs or peak memory; most of the increase comes from OCSFA. Even during the adaptive selector's startup phase, the observed peak was 12.517 GiB per GPU, only about 0.668 GiB (+5.6%) above UAD. These FLOP figures include an estimate of the forward Cayley solves but not their backward solves or other uncounted operations, so we report them as accounted subtotals rather than complete training FLOPs.