W1. Incomplete Positioning Against Thermal and RGB-T Domain Adaptation
-
The related-work discussion does not adequately cover the extensive literature on unsupervised domain adaptation for thermal and RGB-T semantic segmentation. The paper briefly mentions Chen et al. (2022) and Gan et al. (2023), but omits several more direct precedents.
-
HeatNet already introduced a two-stage teacher-student framework with cross-domain feature alignment for transferring daytime RGB knowledge to nighttime RGB-T segmentation. MS-UDA subsequently proposed successive RGB-to-RGB, RGB-to-thermal, and thermal-to-thermal adaptation. It used predictions from an RGB segmentation model as pseudo-labels and CycleGAN-generated nighttime thermal images to reduce both spectral and day-night domain gaps. Thus, the combination of synthetic thermal data, pseudo-label transfer, and staged adaptation was already explored in thermal segmentation by 2021.
-
More recent work has further developed this direction. Gan et al. perform RGB-to-thermal adaptation without thermal annotations or registered RGB-T pairs. Night-TTA employs cross-modal ensemble distillation for nighttime adaptation. Kwon et al. introduce masked mutual learning, cross-spectral prototypes, and self-supervised pseudo-labeling while retaining thermal-only inference. UMDA similarly combines day-to-night generation, pseudo-label supervision, and cross-modal self-distillation.
-
The paper should position ThermOV against this progression rather than treating thermal UDA mainly as conventional fixed-category adaptation. Although these methods are not open-vocabulary methods, they are the closest methodological precedents for nearly every adaptation component used by ThermOV.
[1] Vertens, Zürn, and Burgard, “HeatNet: Bridging the Day-Night Domain Gap in Semantic Segmentation with Thermal Images,” IROS, 2020.
[2] Kim, Shin, Park, and Kweon, “MS-UDA: Multi-Spectral Unsupervised Domain Adaptation for Thermal Image Semantic Segmentation,” IEEE RA-L/IROS, 2021.
[3] Chen et al., “Light Transport Induced Domain Adaptation for Semantic Segmentation in Thermal Infrared Urban Scenes,” IEEE T-ITS, 2022.
[4] Gan, Lee, and Chung, “Unsupervised RGB-to-Thermal Domain Adaptation via Multi-Domain Attention Network,” ICRA, 2023.
[5] Liu et al., “Test-Time Adaptation for Nighttime Color-Thermal Semantic Segmentation,” IEEE TAI, 2024.
[6] Kwon et al., “Boosting Cross-Spectral Unsupervised Domain Adaptation for Thermal Semantic Segmentation,” ICRA, 2025.
[7] Chen et al., “Unsupervised Multi-Modal Domain Adaptation for RGB-T Semantic Segmentation,” CVIU, 2026.
W2. Limited Methodological Novelty Beyond Standard UDA and Consistency Learning
-
The proposed training strategy largely combines standard input-level and output-level domain-adaptation techniques. At the input level, Stage I converts RGB images to grayscale, adds manually defined category-dependent intensity offsets, and applies conventional image perturbations. Earlier thermal UDA methods already used synthetic thermal or day-to-night thermal generation to reduce the input-domain gap. Compared with learned translation or physically motivated thermal generation, the proposed transformation is considerably simpler and is not validated against real thermal-image statistics.
-
At the output level, Stage II first generates pseudo-labels on unlabeled target images and then trains an EMA teacher-student model using differently augmented views. This is a standard self-training and consistency-learning structure. Mean Teacher introduced EMA-based teacher targets, FixMatch combined weakly augmented pseudo-label generation with strongly augmented student training, and MIC and UniMatch extended similar consistency principles to domain adaptation and semantic segmentation. Therefore, the main novelty appears to be applying a conventional UDA pipeline to a SAM3-based thermal-only OVSS setting.
[8] Tarvainen and Valpola, “Mean Teachers Are Better Role Models,” NeurIPS, 2017.
[9] Sohn et al., “FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence,” NeurIPS, 2020.
[10] Hoyer et al., “MIC: Masked Image Consistency for Context-Enhanced Domain Adaptation,” CVPR, 2023.
[11] Yang et al., “Revisiting Weak-to-Strong Consistency in Semi-Supervised Semantic Segmentation,” CVPR, 2023.
W3. Unconvincing Benchmark Performance
-
The empirical results are not strong enough to support a broad state-of-the-art claim. ThermOV clearly improves over the unadapted SAM3, but it is not consistently the best method even in Table 1. On TIR-SS, EBSeg† reaches 62.50 mIoU, which is higher than ThermOV’s 62.14. EBSeg† also achieves 76.10 mAcc, substantially above ThermOV’s 68.80. The claimed 0.54-mIoU improvement is obtained only relative to Mask-Adapter† at 61.60, which is not the strongest baseline. Therefore, the paper does not establish consistent superiority over supervised thermal adaptation.
-
The improvement also cannot be clearly attributed to a proposed method. Stage-I pseudo-thermal adaptation alone improves SAM3 by only 0.72 mIoU on FMB and 2.55 on TIR-SS. Most of the gain comes from conventional target-domain pseudo-label training and teacher-student consistency. Without same-backbone UDA baselines, it is unclear whether ThermOV performs better than simply applying an established self-training method to SAM3.
W4. Weak Validation of the Pseudo-Thermal Generator
-
The main components, such as LoRA adaptation, pseudo-label training, EMA teacher-student consistency, and prompt consistency, are established techniques. The main technical distinction is their application to thermal-only OVSS.
-
Moreover, the pseudo-thermal generator is based on grayscale conversion and manually selected class-dependent brightness offsets. Thermal appearance depends on temperature, material emissivity, weather, sensor response, automatic gain control, and imaging polarity. The paper provides no quantitative or perceptual evidence that the generated images resemble real thermal data. There is also no ablation separating grayscale conversion, category priors, and appearance perturbations.
W5. Limited Reliability & Reproducibility Reporting
- Several implementation details are also unclear, including the pseudo-label confidence threshold, candidate-mask merging, overlap resolution, background assignment, and final multiclass prediction procedure.