- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The authors propose , a way to reuse an HTA-pretrained event encoder on other input representations. It works with a Cross-Representation Adapter (CRA) that builds the patch kernel and LoRA-style updates from hand-written channel descriptors. CRA is trained to match HTA features while the backbone stays frozen. Experiments on N-Caltech101, DSEC, DDD17 and MVSEC cover classification, segmentation, depth and retrieval. They show gains over a Hyper-RED baseline that copies the HTA patch kernel to each input channel.
Critical strengths
- Extensive experiments. The evaluation covers 3 tasks (classification, segmentation, depth), 5 dataset-task settings, 4 seen representations and 2 unseen ones. It also includes retrieval and qualitative results.
- Well-designed ablations. The adapter comparison uses parameter-matched controls, and ID-CRA isolates the effect of descriptor conditioning from model capacity.
Critical weaknesses
- The practical motivation is unclear. Every representation is computed from the raw events, and every dataset here provides them, so a user could simply convert to HTA. HTA wins on nearly every metric in Tables 2 and 3. Because the loss pulls everything toward HTA, the adapter can at best match it.
- The baselines are insufficient, and the comparison is not budget-matched. Both models are fine-tuned with the same small learning rates (1e-6 to 2e-5). OmniE2, however, first gets 60k extra CRA updates on the same training data, with a patch learning rate of 1e-4. It is therefore unclear whether the gains come from descriptor conditioning or simply from extra training of the input layer.
- The results may not be statistically reliable. All results come from a single run. The HTA input bypasses CRA, yet its results differ between rows (65.58 vs. 64.86 mIoU on DDD17), which suggests run-to-run noise as large as many of the reported gains.
Questions for authors
Please refer to the Weakness part.
Thanks for the author's detailed reply. I have increased my rate