- Rating
- 3(+1)
- Confidence
- 3(+1)
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes an agent-based framework for visible-infrared video fusion under time-varying degradations. The framework consists of four components. A Sentinel Agent localizes the points at which the degradation state changes, and an Expert Agent predicts the severity of five degradation types (low light, over-exposure, fog, blur, and noise) for the corresponding segment. A Fusion Mixer then merges the task vectors of degradation-specific VideoFusion experts according to the predicted severities to generate segment-specific fusion parameters. Finally, a Feedback Agent detects failed segments in the fused output and triggers re-diagnosis and re-fusion. The Expert Agent is obtained by fine-tuning Qwen3-VL with LoRA on a 20K burst-level dataset built from synthetic degradations. The authors report improvements in fusion quality, temporal consistency, and object tracking performance on HDO, M3SVD, VT-MOT, and their newly constructed DIVD dataset.
Critical strengths
The core idea is fresh and intuitive. The framework diagnoses the type and severity of degradation in each temporal segment and adjusts the fusion model accordingly, which is meaningful because the design directly reflects the characteristics of the degradation. In particular, using the diagnosed severities as merging weights for degradation-specific expert models allows a segment-specific fusion model to be constructed at inference time without additional training. This is a practical way to handle compound degradations, and it has the potential to be extended to other backbones and low-level vision tasks.
Critical weaknesses
-
The contributions of the proposed method appear somewhat limited, both as a framework and as an agentic system. From the framework perspective, the paper relies heavily on existing techniques such as VideoFusion, Task Arithmetic, and TIES-Merging, and its distinguishing contribution seems to lie mainly in using the VLM-predicted severity scores as merging weights. From the agent perspective, the three proposed agents appear closer to VLM-based classifiers or regressors operating under fixed prompts and rules. Since when and which module to invoke is also determined by predefined rules, it is difficult to identify any process of autonomous planning or tool selection. In addition, the design of the severity labels, which serve as the basis for the merging weights, appears somewhat arbitrary. Native degradations in the original videos are estimated with fixed threshold rules, while the severity of synthetic degradations is defined as the normalized strength of the applied operator. As a result, there seems to be limited evidence that severity values across different degradation types correspond to the actual degree of image quality degradation.
-
The experimental validation appears limited in terms of both its scope and its baselines. First, the instruction data for the Expert Agent, the training data for the degradation-specific experts, and the DIVD evaluation set are all constructed with the same degradation operators, and the performance of the Sentinel Agent and the Expert Agent is measured only on DIVD. As a result, it remains unclear whether the proposed method generalizes to real-world settings where natural degradations vary over time. Second, several key comparisons appear to be missing. Without a comparison against a single VideoFusion model fine-tuned on all five degradation datasets jointly, it is difficult to determine whether agent-based diagnosis and expert merging are actually necessary. There is also no oracle experiment that feeds the ground-truth severity scores of DIVD into the Fusion Mixer, which makes it difficult to assess how much diagnosis errors affect the final fusion performance. Finally, the paper does not state whether the compared methods were further trained on the same degraded data, so the reported improvements may reflect a combination of additional training on degraded data and the contribution of the proposed method itself.
Questions for authors
-
Can you provide a per-degradation analysis on natural degradation data showing whether the severity scores reflect the actual characteristics of each degradation (e.g., brightness reduction for low light and saturation for over-exposure)?
-
Can you provide the number of failures detected and re-fusions triggered by the Feedback Agent on each dataset, along with the performance change before and after re-fusion? In addition, can you provide comparisons against a single VideoFusion model fine-tuned jointly on all five degradation datasets and an oracle setting using the ground-truth severity scores?