- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Uncertainty-Aware Selective Invariant Learning (USIL) for visible-infrared person re-identification under low-light conditions. USIL consists of three main components: Uncertainty-Aware Selective Invariant Modeling (USIM), Uncertainty-Guided Low-Light Enhancement (UGLE), and Distributional Cross-modal Retrieval-Risk Regularization (DCRR). USIM estimates spatial reliability using bidirectional selective state-space modeling, while UGLE uses reliability estimates to modulate feature compensation and feature aggregation. DCRR introduces a distributional cross-modal retrieval-risk regularizer to emphasize potentially problematic ranking cases during training. The proposed method is evaluated on SYSU-MM01, RegDB, and LLCM. The reported results improve over the IRL baseline across the evaluated benchmarks and retrieval settings.
Critical strengths
-
This paper addresses the VI-ReID challenge that local features vary in identity relevance under illumination degradation and cross-spectral mismatch. Reusing a shared reliability representation for feature compensation and descriptor aggregation provides a well-motivated and coherent design.
-
By combining spatial reliability estimation (USIM/UGLE) with sample-level ranking risk (DCRR), the proposed method attempts to link local feature quality to downstream retrieval errors rather than optimizing enhancement in isolation.
Critical weaknesses
-
Key benchmark results do not validate the complete method. Appendix E.2 states that the reported RegDB and LLCM results are pre-fix runs that “do not validate post-fix DCRR results.” Since the corrected procedure adds local reliability supervision, these results cannot establish that the complete method consistently outperforms IRL across all three benchmarks.
-
The tail-risk motivation of DCRR is insufficiently justified. The proposed method applies symmetric Dirichlet weights to a sorted set of sample risks before computing an upper quantile of the resulting weighted aggregates. Because symmetric Dirichlet weights are exchangeable, sorting the risks does not change the distribution of the weighted sum. Although the paper establishes basic properties of this surrogate, it does not sufficiently explain why this construction specifically controls the high-risk tail of individual sample risks or demonstrate its advantages over established alternatives such as CVaR-based objectives.
-
Missing required AI use statement: The paper omits the required “AI use statement” section specified in the submission format. The authors should include this statement to ensure compliance with the submission requirements.
Questions for authors
-
Have the corrected DCRR method, including local reliability supervision, been evaluated on RegDB and LLCM? If so, what are the results compared with IRL under the same protocol?
-
What empirical evidence supports the claim that the proposed objective effectively focuses on high-risk samples? How does it compare with standard alternatives such as top-k or CVaR-based risk minimization?
-
Could the authors report the end-to-end parameter count, FLOPs, training time, and inference latency of USIL compared with IRL, ideally including a parameter-matched baseline?
-
Beyond the existing module-level ablations and hyperparameter sensitivity analyses, can the authors isolate the effects of the L+ term, local reliability supervision, and the risk-feedback pathway on retrieval performance?
5 comments
Response to Reviewer MDR7
Q2. Mathematical Validity and Empirical Comparison of DCRR (W2+Q2)
We thank the reviewer for this rigorous observation. We agree that symmetric Dirichlet weights are exchangeable; therefore, sorting the batch risks neither changes the distribution of their weighted aggregate nor preferentially assigns larger expected weights to higher-risk samples.
Conservative Aggregate-Risk Formulation. Importantly, Eq. (11) includes an additional worst-case pseudo-risk (()). For () observed risks, the implemented aggregation is
+w_{N+1}r_{\max}, \qquad \mathbf w\sim\operatorname{Dirichlet}(\mathbf1_{N+1}),$$ with the exact conditional expectation $$\mathbb E[Q] =\frac{\sum_{i=1}^{N}r_i+1}{N+1} =\bar r+\frac{1-\bar r}{N+1}.$$ This introduces a nonnegative upward shift relative to the empirical mean. Nevertheless, ($L^{+}$) regularizes an upper quantile of stochastic aggregate retrieval risks, rather than the upper tail or CVaR of the original sample-risk distribution. Accordingly, we do not claim a per-sample tail-risk guarantee. **Retrieval-Oriented Optimization.** Eq. (9) constructs differentiable cross-modal ranking-violation risks, while the non-detached ($L^{+}$) branch propagates gradients through pairwise similarities to identity descriptors. Together with the separate risk-prediction and reliability-feedback objectives, this provides a retrieval-oriented regularization pathway without implying guaranteed preferential optimization of the hardest samples. **Controlled Empirical Comparison.** To evaluate the practical contribution of Dirichlet aggregation, we compare five risk-aggregation configurations on RegDB (VIS→IR, epoch 140): no aggregation, mean-risk, top-($k$), $\mathrm{CVaR}_{0.9}$, and Dirichlet aggregation. The no-aggregation configuration disables only ($L^{+}$) while retaining the remaining risk-related objectives, corresponding to the Full USIL w/o ($L^{+}$) configuration in our independent DCRR ablation (Q4). As summarized in Table R2, Dirichlet achieves 90.98% Rank-1 and 82.44% mAP, compared with 90.73%/82.28% without aggregation, yielding additional gains of +0.25/+0.16 percentage points. It also outperforms $\mathrm{CVaR}_{0.9}$ (90.70%/81.64%), top-($k$) (90.55%/81.68%), and mean-risk (90.41%/81.51%). The independently evaluated empirical hard-risk CVaR is 0.2005 for Dirichlet, lower than the reported values of 0.2365–0.2374 for the three alternative aggregation objectives. These results support the empirical effectiveness of Dirichlet aggregation under the evaluated protocol without establishing theoretical control over individual risk tails. Table R2. Controlled comparison of risk aggregation objectives on RegDB (VIS→IR, epoch 140). | Risk aggregation | Rank-1 (%) ↑ | mAP (%) ↑ | Hard-risk CVaR ↓ | | ----------------------------------- | ------------ | --------- | ---------------- | | No aggregation (($\lambda^+=0$)) | 90.73 | 82.28 | 0.2376 | | Mean-risk | 90.41 | 81.51 | 0.2365 | | Top-$k$ risk | 90.55 | 81.68 | 0.2373 | | $\mathrm{CVaR}_{0.9}$ | 90.70 | 81.64 | 0.2374 | | $\color{red}{\textbf{Dirichlet (Ours)}}$ | **$\color{red}{90.98}$** | **$\color{red}{82.44}$** | **$\color{red}{0.2005}$** | Note: Retrieval metrics are averaged over the ten official RegDB train/test splits. Empirical hard-risk CVaR is reported to four decimal places. The no-aggregation configuration disables ($L^{+}$) while retaining the remaining risk-related objectives. **Manuscript Revisions.** We clarify Dirichlet exchangeability, the exact expectation, and the scope of stochastic aggregate-risk regularization in Sec. 3.4 and Appendix B.5. We also revise the Abstract, Introduction, contribution statement, and Conclusion to avoid unsupported per-sample tail-risk guarantees. The empirical risk-aggregation comparison is summarized in Sec. 4.3, with the complete results provided in Table R2 of this rebuttal. The incremental effect of ($L^{+}$) is independently summarized in Q4.Response to Reviewer MDR7
Q3. Architectural Effectiveness and Full-Model Computational Efficiency (Q3)
We thank the reviewer for requesting a comprehensive evaluation of computational efficiency. USIM employs bidirectional selective state propagation to jointly model spatial identity cues and estimate their reliability for subsequent feature enhancement and aggregation. Theorem 1 establishes () scaling with spatial sequence length under fixed feature and state dimensions. However, this operator-level property does not imply that the complete USIL model is faster than IRL.
Controlled Architectural Comparison. To further assess the effectiveness of this design, we replace only the USIM context operator with residual CNN, spatial attention, and lightweight Transformer alternatives while retaining the remaining components and matched training/evaluation protocols. As shown in Table R4, bidirectional Mamba achieves the highest Rank-1 and mAP on both SYSU-MM01 All-search and RegDB VIS→IR.
Table R4. Controlled comparison of spatial modeling operators within USIL (Rank-1 / mAP, %).
| Spatial Modeling Operator | SYSU-MM01 All-search | RegDB VIS→IR |
|---|---|---|
| Residual CNN | 73.42 / 70.58 | 89.22 / 79.61 |
| Spatial Attention | 75.41 / 71.24 | 90.59 / 81.66 |
| Lightweight Transformer | 76.10 / 72.22 | 90.29 / 82.14 |
Note: All variants retain the same backbone, reliability head, UGLE, DCRR, and training/evaluation protocols, replacing only the USIM context operator.
Compared with the strongest non-Mamba alternative for each metric, bidirectional Mamba improves Rank-1 and mAP by 0.90 and 0.96 percentage points on SYSU-MM01 All-search, respectively. On RegDB VIS→IR, the corresponding improvements are 0.39 and 0.30 percentage points, relative to spatial attention for Rank-1 and the lightweight Transformer for mAP. These results support the effectiveness of bidirectional Mamba relative to the evaluated alternatives without implying universal architectural superiority.
Full-Model Computational Overhead. Beyond the architectural comparison, we evaluate the reproduced IRL baseline and full USIL under matched inference settings. As shown in Table R5, USIL increases the parameter count from 181.223M to 181.349M (+0.126M, +0.07%) and FLOPs from 41.584G to 42.446G (+0.862G, +2.07%). Inference latency increases from 25.79 to 28.46 ms (+2.67 ms, +10.35%), while throughput decreases from 38.77 to 35.14 FPS (−3.63 FPS, −9.36%). These measurements quantify the computational overhead of the complete USIL inference model relative to IRL.
Table R5. Computational overhead of full USIL relative to the reproduced IRL baseline.
| Metric | IRL | Full USIL | Δ (USIL − IRL) |
|---|---|---|---|
| Params (M) ↓ | 181.223 | 181.349 | +0.126 (+0.07%) |
| FLOPs (G) ↓ | 41.584 | 42.446 | +0.862 (+2.07%) |
| Inference (ms) ↓ | 25.79 | 28.46 | +2.67 (+10.35%) |
| FPS ↑ | 38.77 | 35.14 | −3.63 (−9.36%) |
Note: Computational metrics are reported for the complete inference models under matched evaluation settings. Absolute differences are calculated as Full USIL minus IRL, and relative changes are computed with respect to IRL.
Accuracy–Efficiency Trade-off and Parameter Matching. Full USIL introduces only a marginal parameter increase of 0.126M (+0.07%) and an additional 0.862G FLOPs (+2.07%) compared with IRL. Its inference latency increases by 10.35%, while throughput decreases by 9.36%. Thus, the improved retrieval performance comes with modest additional parameter and arithmetic costs and a measurable runtime trade-off, rather than an unconditional inference-speed advantage. The closely matched parameter counts provide a parameter-scale-comparable comparison with IRL, although the two models retain different computational operations.
Training-Time Scope. We do not infer training-time efficiency from parameter counts or FLOPs without matched wall-clock measurements.
Manuscript Revisions. We clarify the architectural motivation in Sec. 3.2 and summarize the controlled operator comparisons and measured full-model accuracy–efficiency trade-off in Sec. 4.3. This distinguishes the effectiveness of bidirectional Mamba within USIL from the additional computational cost of the complete framework.
Response to Reviewer MDR7
We sincerely thank the reviewer for recognizing the motivation behind USIL, particularly its shared spatial reliability modeling and the connection between local identity-cue quality and cross-modal retrieval risk. We appreciate the constructive concerns regarding cross-dataset validation, the mathematical interpretation of DCRR, computational efficiency, component attribution, and AI-use disclosure. We address each point below.
Q1. Corrected Cross-Dataset Validation (W1 + Q1)
We thank the reviewer for highlighting the inconsistency between the pre-fix and corrected configurations in Appendix E.2. After rechecking the training records, we distinguish two configurations: USIL, which disables explicit stripe-level reliability supervision, and USIL⁺, which enables it. Both retain the same USIM–UGLE–DCRR architecture and otherwise matched training settings. Importantly, USIL already performs spatial reliability modeling and reliability-guided enhancement; USIL⁺ introduces an additional explicit supervision constraint on the relative reliability of body regions rather than a new spatial modeling module.
Additional Cross-Dataset Evaluation. To directly assess the corrected training procedure, we report USIL⁺ results on SYSU-MM01, RegDB, and LLCM while retaining the original USIL results for transparency.
Table R1. Comparison of USIL and USIL⁺ across six retrieval settings (Rank-1 / mAP, %).
Evidence and Scope. USIL⁺ consistently improves Rank-1 and mAP over USIL across all six retrieval settings and also outperforms the reproduced IRL baseline on these metrics. These controlled comparisons provide additional empirical support for the effectiveness of explicit stripe-level reliability supervision across all three benchmarks. We note that some SYSU-MM01 Rank-10 values decrease relative to USIL; therefore, our conclusion is specifically restricted to the consistent Rank-1 and mAP improvements, without claiming universal improvements across every metric or independent training seed.
Manuscript Revisions. We retain both configurations in Tables 1–2, clarify their distinction in the table notes, and update their training configurations in Appendix E.2. The original component-wise ablation in Table 3 remains unchanged to avoid conflating configuration-level improvements with the existing module-level attribution.