- Rating
- 3
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes TableMoE, a multimodal table-reasoning framework that combines four connector experts: a pretrained General expert and three experts aligned to HTML, JSON, and table-redrawing code. A token-level router selects and fuses two experts for each visual token, and the mixture is further adapted using answer-level reinforcement learning with Multi-GRPO and SC-RPO. The experiments show consistent aggregate improvements over the matched SFT baselines, while the routing analysis suggests that the General expert is dominant and that a fixed General+JSON pair retains much of the learned-routing performance.
Critical strengths
-
Reward-based adaptation improves the matched SFT baselines across all six main benchmarks. Both RL variants use the same four-expert architecture as Det-SFT and Soft-SFT, making these comparisons informative for assessing the contribution of answer-level reward adaptation.
-
The paper includes several analyses of the learned routing behavior. Spatial routing visualizations, expert-exclusion experiments, and fixed-pair interventions provide information beyond aggregate benchmark accuracy and help distinguish gains from adapting the expert mixture from the contribution of individual spatial routing decisions.
Critical weaknesses
- The incremental value of fine-grained token-level adaptive routing is not convincingly established. A fixed General+JSON pair retains most of the learned-routing performance on Dev300, despite changing a large fraction of token-level expert assignments. Since token-level spatial routing is a central architectural component of TableMoE, the absence of a simpler adaptive baseline, such as selecting one expert pair per image, makes it difficult to determine whether token-level routing itself provides a meaningful advantage.
Questions for authors
-
Why is Top-2 routing used throughout the model? What motivates selecting exactly two experts for each visual token?
-
Given that a fixed General+JSON pair retains most of the learned-routing accuracy, does token-level adaptive routing provide a measurable advantage over a simpler image-level adaptive routing strategy that selects one expert pair per image?
-
Do different datasets show different preferences for particular experts, and do these preferences relate to differences in table structure or task characteristics?
-
Several writing and implementation details would benefit from clarification:
- Several baselines and datasets appear to be missing their corresponding citations. In particular, a number of literature-reported methods in Table 1, including SynTab-LLaVA, CoReTab, MM-Table-R1, Table-R1, HIPPO, Turbo, and TableDART, do not appear to have corresponding references. The Qwen2.5-VL backbone and TableVQA-Bench also seem to be uncited.
- Line 134: What is the motivation for using a bias-free router, , rather than including a bias term?
- Line 144: How are the routed visual representations incorporated with the question tokens into the language model input? For example, are they concatenated in the input sequence or combined in another way?
- Line 146: What is the intuition behind sampling an ordered pair without replacement during training? Is this primarily intended to introduce exploration during RL training, since deterministic Top-2 routing would otherwise produce no routing variation?
Summary of Revisions (Updated Manuscript)
We have revised the manuscript to incorporate the additional experiments and clarifications discussed during rebuttal.
The main updates are: