- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper addresses the concern that prediction may require deep representations to retain excessive low-level details. It introduces mirrored hierarchical cross-attention between the encoder and decoder, together with timestamp-driven ROPE to capture temporal dependencies. The method is evaluated across multiple tasks, and controlled topology ablations support the effectiveness of the mirrored connectivity on video classification task.
Critical strengths
-
The motivation is clear and convincing. It provides a useful perspective on representation learning through hierarchical information flow.
-
The mirrored hierarchical cross-attention directly addresses the stated motivation, and the topology ablations provide evidence of its effectiveness.
-
The explicit treatment of timestamps is well motivated for video and continuous time multimodal streams.
-
The evaluation covers video classification, text-to-motion, and text-to-speech, demonstrating applicability beyond a single task.
Critical weaknesses
-
Encoder–decoder skip connections are well established. But the comparison with closely related methods are insufficient to clearly establish the novelty of the proposed method.
-
There is no direct evidence that shallow layers handle low-level details while deep layers learn more abstract representations. The single visualization does not provide a sound evidence.
-
The method does not demonstrate consistent performance improvements across benchmarks. The video classification and text-to-speech results show competitive performance in some settings, but not a clear overall advantage.
-
The topology ablations primarily focus on video classification with no corresponding ablations for text-to-motion or text-to-speech, leaving the effectiveness to these generation results unclear.
-
The paper lacks ablations of the proposed ROTE, making it difficult to determine their individual contributions.
-
The main text states that “full-causal attention” allows access to the “full caption and motion history,” whereas the appendix specifies that motion positions “attend causally within a 2 s window.” Several essential details like the data composition, model configurations, and training schedules, are not clearly summarized in the main text. The confusing distinction and poor organization make the paper hard to follow.
Questions for authors
-
What distinguishes the proposed mirrored hierarchical cross-attention from closely related designs?
-
Could the authors provide solid evidence supporting the claim that skip connections allow shallow layers to retain low-level details while deep layers learn more abstract features?
-
Given that the method does not show consistent performance advantages across benchmarks, how do the authors interpret these results as evidence of its effectiveness?
-
Does mirrored connectivity also improve on text-to-motion and text-to-speech?
-
How does timestamp-driven RoTE compare with rotary embeddings based on frame or token indices under otherwise identical settings?
Dear Reviewer wp1N,
Thank you very much for your time and effort devoted to reviewing our submission!
We would like to respectfully bring to your attention a possible discrepancy between the review comments and the content of our manuscript. Our paper introduces SynMIC, an agentic framework for synthetic multimodal in-context learning. Upon carefully reading your comments, we noticed that some of the technical details discussed in the review seem to refer to a different work, possibly titled RoTE, which introduces mirrored hierarchical cross-attention and timestamp-driven RoPE for video classification. To the best of our understanding, these technical components and research topics differ substantially from those presented in our submission.
Given these differences, we wonder whether there might have been an inadvertent mix-up with the review of another submission. We fully understand that such situations can occasionally occur, and we would be sincerely grateful if you could kindly double-check whether the review was intended for our manuscript.
We would also be more than willing to address any questions or concerns you may have regarding our work during the rebuttal and author–reviewer discussion period. At the same time, given the limited time remaining in the discussion period, we are worried about that there may not be sufficient time to thoroughly address too many new questions or concerns that might arise. Should any of your subsequent concerns overlap with those raised by other reviewers, we sincerely hope that our responses to their comments may also help provide useful clarifications.
Thank you again for your time, understanding, and consideration!
Best regards,
Authors