- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes LITE-Event for low-light video understanding using synchronized RGB and event inputs. It combines frozen visual encoders and an LLM with gated fusion and a support-conditioned hypernetwork that generates low-rank interface updates. The authors construct synthetic pretraining data, a real-event adaptation dataset, and RealDark-Bench for evaluation.
Critical strengths
-
The paper addresses a practical problem: using complementary event information when RGB observations become unreliable under low light.
-
The evaluation includes real low-light recordings from sources disjoint from the adaptation data. The overall improvements over RGB-only, enhancement-based, and event-only baselines provide evidence that the combined system is useful.
Critical weaknesses
-
All reported QA evaluations use benchmarks or test splits constructed by the authors. Although the target recordings come from disjoint sources, no results are reported on existing public benchmarks under their original evaluation protocols. This makes it difficult to assess how much the results depend on the particular data selection and annotation process.
-
LITE-Event is evaluated only with CM3AE encoders and Llama-3.1-8B-Instruct. Comparisons against Qwen and InternVL do not establish that the proposed interface also works with those backbones.
-
Generalization varies considerably across data sources. On HUE, LITE-Event achieves 65.3%, below InternVL3 at 78.7% and Qwen3-VL at 77.3%. The authors acknowledge this limitation, but the explanation based on appearance-heavy scenes is not experimentally established.
-
The main external baselines use either RGB or events, whereas LITE-Event receives both. These comparisons therefore do not fully separate the benefit of additional sensory information from that of the proposed method.
Questions for authors
- Is there evidence that the gains persist with another encoder or LLM backbone?
- How does LITE-Event compare with a strong RGB–event fusion baseline using the same encoders, LLM, and training data on RealDark-Bench?
5 comments
W3. Diagnosing the HUE Generalization Gap
We thank the reviewer for this observation and agree that our original explanation of the HUE result required further evidence. We therefore analyzed all 75 HUE questions by category to determine where the performance gap arises.
The gap is strongly concentrated in object-recognition questions. On the 37 object questions, LITE-Event achieves 59.5% (22/37), compared with 81.1% (30/37) for InternVL3 and 78.4% (29/37) for Qwen3-VL. These object questions account for 8 of the 10 additional errors relative to InternVL3 (80%) and 7 of the 9 relative to Qwen3-VL (77.8%).
| HUE subset | LITE-Event | InternVL3 | Qwen3-VL |
|---|---|---|---|
| Object (37) | 59.5 | 81.1 | 78.4 |
| Non-object (38) | 71.1 | 76.3 | 76.3 |
| Overall (75) | 65.3 | 78.7 | 77.3 |
When object-recognition questions are excluded, the gap decreases from 13.3 to 5.3 percentage points relative to InternVL3 and from 12.0 to 5.3 points relative to Qwen3-VL. Thus, the weaker HUE result is not a uniform source-wide degradation, but is primarily localized to the object-recognition subset.
We will revise the manuscript accordingly, replacing the broader “appearance-heavy scenes” explanation with this empirically supported characterization and explicitly discussing object recognition on HUE as a limitation.
W4/Q2. Separating Multimodal Input from Support-Conditioned Adaptation
We thank the reviewer for raising this important concern. We evaluated the adaptation baselines from Table 3 on RealDark-Bench using the same RGB-event inputs, frozen visual encoders, frozen LLM, and training data as LITE-Event, thereby separating the benefit of additional sensory information from that of the proposed support-conditioned adaptation.
| Model / Adaptation | Input | Accuracy (%) |
|---|---|---|
| Projector from scratch | RGB + Event | 75.50 |
| Fine-tuned projector | RGB + Event | 80.83 |
| Static LoRA projector | RGB + Event | 82.67 |
| LITE-Event (RGB-only) | RGB | 80.17 |
| LITE-Event (Event-only) | Event | 82.00 |
| Full LITE-Event | RGB + Event | 85.00 |
The results disentangle the two effects. First, multimodal sensing contributes to performance: full LITE-Event improves over its RGB-only and event-only variants by 4.83 and 3.00 percentage points, respectively. Second, when both modalities and the training setup are held fixed, LITE-Event still outperforms the strongest controlled RGB-event baseline, Static LoRA, by 2.33 points (85.00% vs. 82.67%; 510 vs. 496 correct answers). This is consistent with the 2.40-point advantage previously observed on EventLang-Dark.
Thus, the gain cannot be attributed to access to both RGB and event inputs alone. Multimodal fusion provides one source of improvement, while support-conditioned adaptation provides an additional gain over a static RGB-event adapter.
Thank you to the authors for the detailed experiments, I still have a few concerns:
- In the added experiments, after Qwen3-VL-8B-Instruct is fine-tuned with LoRA, why is it lower than the original backbone? I think this is counter-intuitive, and I hope the authors can provide the detailed parameter configuration of LoRA and explanation.
- I see that the authors have not updated the paper. If the paper can be updated, it will be more convincing. If the authors can resolve these concerns, I will raise my score.
We thank the reviewer for the detailed feedback and for recognizing the practical motivation of our work. In response, we conducted additional experiments addressing backbone generalization, matched RGB-event adaptation baselines, and the performance gap on HUE. These analyses provide further evidence for the proposed adaptation mechanism while clarifying its limitations across data sources. We also acknowledge the need for evaluation on independently established benchmarks and discuss the scope of our current evaluation below.
W1. Evaluation Beyond Author-Constructed Annotations
We thank the reviewer for raising this important point. We agree that evaluation on an independently established benchmark under its original annotation and evaluation protocol would provide an additional test of generalization.
To our knowledge, we are not aware of an established benchmark that simultaneously provides real low-light RGB video, temporally aligned event streams, and video-level reasoning annotations, which is the input/task setting studied here. This gap motivated the construction of RealDark-Bench.
Importantly, while the QA annotations are constructed by us, the underlying recordings are not. RealDark-Bench is built from four independently collected public RGB-event datasets, EventVOS, SDE, RELED, and HUE, comprising 600 questions across seven reasoning categories. All questions are independently verified by three annotators, with agreement from at least two required for inclusion. Moreover, all four recording sources are disjoint from EventLang-Dark, and no RealDark-Bench sample is used for training, support construction, model selection, or tuning. We also report results separately for all four constituent datasets rather than relying only on aggregate accuracy, thereby exposing performance variation across recording sources.
We agree that the author-constructed QA annotations and the absence of a fully independent benchmark with the same input/task formulation remain limitations. We will make this scope explicit in the revised manuscript and identify evaluation on independently established low-light RGB-event reasoning benchmarks, as they become available, as an important direction for future work.
W2/Q1. Generalization to a Second LLM Backbone
We thank the reviewer for highlighting the need to test whether the proposed adaptation mechanism generalizes beyond Llama-3.1-8B-Instruct. We therefore implemented LITE-Event with a second LLM, Qwen3-VL-8B-Instruct, while keeping the frozen visual encoders, RGB-event fusion interface, support-conditioned hypernetwork, and training protocol unchanged.
To isolate the contribution of the adaptation mechanism, we also evaluated a controlled static RGB-event LoRA baseline under the same Qwen backbone and experimental setup:
With the Qwen3 backbone, LITE-Event achieves 78.33% (470/600) compared with 69.50% (417/600) for Static LoRA baseline, an improvement of 8.83 percentage points, or 53 additional correct answers. The improvement is observed across all seven question categories.
Thus, although absolute accuracy varies across LLMs, support-conditioned adaptation improves over static RGB-event LoRA with both tested backbones: +2.33 pp with Llama and +8.83 pp with Qwen. This provides direct evidence that the adaptation gain is not specific to a specific LLM backbone.
We will include this second-backbone evaluation in the revised manuscript. This experiment establishes generalization across LLM backbones, while generalization to alternative visual encoders remains to be evaluated.