- Rating
- 2
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper investigates how organizing audio and visual inputs affects omni-modal reasoning, rather than claiming general benchmark superiority. It distinguishes four reasoning requirements and compares Single, Parallel, Sequential, and Interleaved organizations. Chain of Modality uses a Planner to choose an organization, a frozen Reasoner to answer, and distribution fusion for parallel branches. Training-free planning and planner-only LoRA supervision are evaluated on topology-sensitive subsets and full benchmarks, with additional cross-model transfer. The central contribution is a diagnostic account of organization-dependent failures and an attempt to learn corrective routing.
Critical strengths
- The paper frames a focused, testable problem. Table 1 contrasts evidence requirements, while Tables 5–6 show higher local attention accompanying improved accuracy on temporal reasoning but lower accuracy on temporal hallucination. This is useful evidence against a universally beneficial interleaving policy, without establishing attention as the sole cause of the accuracy changes.
- The intervention retains the Reasoner and tests both training-free and learned planning. Random-selection controls (Tables 12–13), cross-backbone transfer (Table 8), and full-benchmark results (Table 7) give the proposal substance beyond selected qualitative demonstrations. Full-benchmark improvements are modest and WorldSense is essentially unchanged, consistent with the paper's narrow scope.
Critical weaknesses
- The baseline and fixed-organization comparisons need reconciliation. Section 5.1 calls the vanilla baseline the 'A-V organization', rather than unambiguously specifying its executable topology. If this denotes A→V in Table 10, the DailyOmni/WorldSense baseline scores of 29.0/27.8 in Table 7 differ from 38.7/28.4 in Table 10; the former pair instead matches that table's Interleave scores.
- The displayed strict RoPE implication is not established by the stated bound. On p. 5, B depends on query/key coefficients and oscillatory partial sums; the long-term-envelope interpretation alone does not imply |B_int(1)| > |B_seq(T)| on p. 6.
Questions for authors
- For Tables 7, 10, 12, and 14, please reconcile the sample sets, prompt variants, and executable modality organizations.
- What additional assumptions justify the strict distance inequality for the evaluated models, beyond a long-term-envelope interpretation, and how are chunk positions mapped to actual position IDs?