- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
MoEcraft initializes sparse experts from checkpoints along an RL trajectory and jointly calibrates the router and expert adapters.
Critical strengths
The paper includes cross-family results, three trajectory seeds and measured serving costs.
Critical weaknesses
The presentation falls below an acceptable standard: Figures 1 and 5 compress essential labels and annotations into tiny text, while Tables 1 and 20 crowd multiple attributes and measurements into layouts that require excessive effort to decipher.
The authors use AI assistance with figure layout, but the resulting visuals need substantial redesign. More fundamentally, the experiments do not establish the value of trajectory harvesting: a single-terminal-checkpoint interpolation baseline reaches 55.92 versus 56.95 for the proposed method, without a paired multi-seed comparison establishing that advantage.
Most improvement occurs during additional RL calibration, yet no matched dense continuation baseline isolates the benefit of sparse conversion from simply training longer. None of the closest published adapter-MoE pipelines is reproduced. The “capacity-aware” rank rule is also unsupported by converted-model rank sweeps.
Reproducibility is particularly weak: training code and run-level configurations are withheld, the Best-8 selection criterion is unrecorded, and parts of the routing analysis lack underlying measurement metadata. Finally, the workstation-efficiency argument rests on a conversion requiring 92.9 GiB and a model with 9.10B resident parameters. The paper offers a complicated construction without convincing evidence that its distinctive components justify that complexity.
I think this paper shoulded be rejected.
Questions for authors
Please refer the weaknesses.