- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
IRest-VL jointly performs composite infrared degradation diagnosis and generates executable restoration programs. It constructs program supervision through experience-accumulated Bayesian optimization, which warm-starts TPE with previously successful configurations. A shared multimodal backbone supports two decoupled outputs: structured degradation attributes and transitions, and restoration code generated without a serialized diagnosis prefix. Experiments compare output designs across five backbones and evaluate diagnosis, restoration, supervision-construction efficiency, and program execution.
Critical strengths
-
The task formulation is useful and clearly motivated. Combining degradation diagnosis with explicit, parameterized restoration programs provides interpretable outputs and allows generated programs to execute without repeated MLLM calls.
-
The decoupled design has consistent empirical support. Matched comparisons across five backbones show improved aggregate OOD diagnosis and shorter outputs while largely maintaining restoration quality.
Critical weaknesses
-
Compositional generalization remains very limited for longer pipelines. Almost all OOD diagnosis gains come from two-degradation cases. For three-degradation OOD inputs, structured models achieve only 0–0.13% exact accuracy.
-
Adding diagnosis leaves restoration quality nearly unchanged. A structured diagnosis-only baseline and separate ablations of the prediction head and valid-path decoder would better isolate the contribution.
-
Evaluation is limited to controlled synthetic degradations. Cross-dataset reuse retains the same controlled degradation pipeline. It does not establish robustness to unknown real-sensor artifacts or changing acquisition conditions.
Questions for authors
See weaknesses.
6 comments
Response to Reviewer dcuo (following)
W2.3 Valid-path decoding. We have added a new ablation in Appendix H.4.2/Table 20 that compares the complete decoder with two alternatives. “Allow repeated primitives” removes the non-repetition constraint while retaining a maximum length of 5. “Fixed-start greedy” first uses independent attribute argmax to determine the set of present primitives and assigns each primitive its most likely severity, without adding or removing primitives through global scoring. It then selects the node with the largest sum of outgoing transition probabilities as the single starting point and repeatedly chooses the highest-probability unvisited successor until all primitives are covered.
Allowing repeated primitives reduces ID/OOD full accuracy from .6193/.2811 to .1003/.0000, showing that the non-repetition constraint is important for producing structurally valid paths. Fixed-start greedy decoding obtains .5309/.1608. Although it performs better than the repeated-primitive variant, it remains substantially below complete valid-path decoding. These results show that both the non-repetition constraint and global enumeration with joint attribute-transition scoring contribute to OOD full diagnosis.
| Decoder | ID/OOD | ID/OOD | ID/OOD Full |
|---|---|---|---|
| Full valid path | .8713/.7547 | .5660/.5601 | .6193/.2811 |
| Allow repeated primitives | .8179/.7110 | .5519/.5145 | .1003/.0000 |
| Fixed-start greedy | .8172/.7015 | .4983/.5336 | .5309/.1608 |
W3: We additionally collect 100 real noisy infrared images: 44 from JFAD, 5 from the TNO, and 51 from the TRNeRF. Each image contains stripe noise, random noise, blur, or a combination of these degradations. We compare the methods using MUSIQ and CLIP-IQA.
| Method | MUSIQ ↑ | CLIP-IQA ↑ |
|---|---|---|
| Original image | 26.4093 | .3506 |
| Guided filter (best single tool) | 22.2888 | .3640 |
| GLM-5.2 | 27.0529 | .3464 |
| Qwen3.8-Max | 27.2750 | .3376 |
| GPT-5.6-sol | 29.2612 | .3587 |
| Claude Sonnet 5 | 27.9741 | .3463 |
| Direct AR Qwen3.5-0.8B | 28.3252 | .3607 |
| IRest-VL-Qwen3.5-0.8B | 28.0313 | .3720 |
On these real images, IRest-VL obtains the highest CLIP-IQA (.3720), while GPT-5.6-sol obtains the highest MUSIQ (29.2612). The two no-reference metrics favor different methods, but IRest-VL is among the strongest on both and outperforms the guided filter on both metrics. Direct AR and IRest-VL have similar restoration scores because the decoupled architecture primarily targets OOD diagnosis generalization and diagnosis--restoration interference. Appendix K/Fig. 7 provides qualitative examples in which IRest-VL identifies plausible degradation components and adapts the selected lightweight tool and its arguments across images. This added evaluation provides evidence on observed real artifacts, while the limited public data do not cover all degradation combinations and application orders.
With the deadline approaching, we just wanted to gently ask if our response has resolved your concerns or if there are any remaining questions. We would be glad to provide further clarifications if needed.
Response to Reviewer dcuo
Thank you for your insightful comments and helpful suggestions.
W1: We thank the reviewer for highlighting this issue. It is worth noting that full diagnosis accuracy is a strict conjunctive metric. For L=3, all three primitive types, three severities, two directed transitions, and the complete order must match the reference; any local error makes the full prediction incorrect. Attribute and transition F1 instead give credit for partially correct local predictions.
For IRest-VL-Qwen3.5-0.8B on OOD L=3, attribute F1 is .7260 and transition F1 is .3805, whereas exact full accuracy is .0013. Thus, local degradation evidence has not disappeared, but errors compound when the complete path is reconstructed. The valid-path score sums local log probabilities, equivalently multiplying their probabilities, so exact joint agreement becomes increasingly difficult as the pipeline grows.
The low OOD full accuracy at L=3 does not mean that the proposed method is ineffective. First, IRest-VL achieves higher attribute and transition F1 than Direct AR for both L=2 and L=3. Second, its full diagnosis accuracy is also higher than Direct AR at L=2. Third, although both methods obtain nearly zero full accuracy at L=3, IRest-VL still achieves higher attribute and transition F1. This comparison shows that exact full diagnosis at L=3 is difficult for both approaches rather than being a failure specific to IRest-VL. Appendix H.1/Table 14 reports the complete length-specific results.
W2: Following your suggestions, we added all three analyses.
W2.1 Diagnosis-only branch. We have added a row to Table 6 that removes the restoration-code generation head from IRest-VL. Diagnosis only obtains ID/OOD full accuracy of .6186/.2512, whereas diagnosis plus restoration obtains .6193/.2811, indicating a modest OOD benefit rather than task interference after decoupling.
W2.2 Diagnosis-head architecture. We have added a new diagnosis-head ablation in Appendix H.4.1/Table 19. Under the same backbone, training data, and decoding protocol, it compares MLP, MSA+MLP, 5Query, 25Query, and MSA+5Query. MLP applies masked-average pooling followed by the shared MLP and task-specific prediction heads, without the MSA block. MSA+MLP adds MSA before pooling. In 5Query, one learnable query per degradation type extracts type-specific features; 25Query adds one query for each directed transition; MSA+5Query first applies multi-head self-attention to the visual tokens.
First, among the three heads without MSA (i.e., MLP, 5Query, 25Query), 5Query has the strongest overall diagnosis: it leads full accuracy and transition F1 on both ID and OOD splits while remaining competitive on attribute F1; MLP and 25Query each surpass it on attribute F1 in only one split. Second, adding MSA improves both corresponding heads, showing that contextualizing the visual tokens before prediction is beneficial. Third, once MSA is included, MSA+MLP and MSA+5Query are broadly comparable and trade off small gains across diagnosis and restoration, suggesting limited additional benefit from the richer query structure after contextualization. We therefore use MSA+MLP as the default configuration.