- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
ECLAR repairs low-light RGB tokens inside a frozen vision encoder using event-conditioned residual adapters and clean-reference supervision while preserving the native visual interface. The authors introduce SDE-VQA-Bench with 8,357 questions. ECLAR improves Qwen3-VL-2B by 11.91 Macro points, with additional support from cross-backbone experiments and representation metrics.
Critical strengths
- The method trains only 4.89M parameters, preserves the native interface, and improves both Qwen3 and InternVL, demonstrating practical value.
- The authors evaluate both question-answering performance and visual representation recovery, and use an equal-parameter control to support the additional benefit of real event information.
Critical weaknesses
- Missing controlled ablations of single-site versus multi-site repair and supervision objectives, together with differing Event-MLLM training settings, make the core design’s contribution difficult to isolate
Questions for authors
- Under matched training conditions, how much does four-site repair improve over single-site repair and final-token fusion?
Thank you for your careful review and constructive comments. We appreciate your emphasis on distinguishing the contribution of the repair architecture from that of the training settings. Your feedback has helped us strengthen the experimental analysis. Below, we provide additional comparisons and clarify the purpose and scope of the two Event-MLLM experiments.
1. Four-site repair versus single-site repair and final-token fusion
Following your suggestion, we added a direct architectural comparison with matched parameter budgets, backbone, training data, and optimization settings. The first four variants below share final-token supervision and auxiliary objectives (F+A), with intermediate representation alignment omitted. We additionally report the complete ECLAR result from the original manuscript, which includes intermediate alignment (M).
Under shared F+A supervision, four-site repair improves over single-site repair at layer 1 by 5.23 percentage points, single-site repair at layer 4 by 1.64 points, and final-token fusion by 10.68 points. Differences are calculated from unrounded scores. These controlled comparisons support the benefit of the tested multi-site in-encoder repair architecture. The full ECLAR result is included as a reference for the complete method.
2. Event-MLLM training settings and comparison protocols
Thank you for highlighting the importance of comparable training conditions. Our manuscript includes two complementary Event-MLLM experiments: an official-code reproduction and a separate retraining experiment that aligns the backbone and training data with ECLAR. We clarify their respective purposes below.
Official-code reproduction — Appendix H and Table 2(c). We reproduce both training stages using Qwen2.5-VL-3B, the released training data, and the released-code configuration. To assess reproduction fidelity, we also evaluate the reproduced model on the original tasks using the official inference and scoring routines.
As reported in Table 14, the reproduced multiple-choice accuracy is 32.90%, compared with the published 34.48%, and multiple-choice F1 is 79.78%, compared with 80.35%. Counting accuracy is 72.06%, compared with 71.08%, while counting MAE is 0.5834, compared with 0.6127. These results support comparable original-task performance. This experiment is reported separately because its backbone and training-data exposure differ from those of ECLAR.
Backbone- and data-aligned retraining — Appendix B.5 and Table 2(a). We additionally retrain the public Event-MLLM alignment-stage architecture using the same Qwen3-VL-2B backbone and SEE-600K training data as ECLAR, with both trained for three epochs. Both settings freeze the VLM backbone and exclude language-model instruction tuning.
This experiment provides a comparison using the same backbone and training data while retaining method-specific representation objectives, preprocessing, and optimization settings. These differences are documented in Appendix B.5. Accordingly, we present it as a method-level comparison, rather than attributing the entire performance gap to fusion location alone.
Together, the two experiments provide evidence of faithful reproduction and a comparison with aligned backbone and training data. We will make their distinction and the remaining training differences more prominent in the revised manuscript so that the scope of each comparison is clear.
Thank you again for helping us improve the clarity and rigor of the paper. We hope these results and explanations clarify the comparisons, and we would appreciate your feedback on any concerns that remain so that we can address them during the discussion.