- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes MoRE, a refinement framework for a pretrained language-based trajectory predictor. Five frozen numerical forecasting models provide cached predictions, which are converted into coordinate-space rewards. These rewards are aggregated using a mean-minus-standard-deviation objective and combined with a ground-truth reward. The policy is refined through reward-guided optimization interleaved with supervised learning, using LoRA and the top 1% of training samples ranked by base-policy entropy. Experiments on ETH–UCY, SDD, GCS, and NBA report improved best-of-20 forecasting accuracy, supplemented by collision and spacing measurements, behavioral-subset analyses, and ETH–UCY-to-SDD transfer evaluation.
Critical strengths
- The reported improvements extend across several datasets and evaluation settings.
- The framework provides a practical way to introduce coordinate-space feedback without deploying the numerical experts.
Critical weaknesses
- The necessity and complementarity of the five-expert combination are insufficiently established. The paper assigns different forecasting roles to the five models, but these roles largely follow their architectural descriptions rather than a direct assessment of complementary capabilities and errors. Table 9 provides useful single-expert, leave-one-out, replacement, and addition experiments. However, the best listed single-expert configuration, MoFlow, achieves 0.206/0.307 compared with 0.204/0.285 for the five-expert configuration, and the robustness of this difference across training seeds is unknown. The study also does not establish whether a smaller expert subset would provide comparable benefits. Thus, the results favor the selected combination at the reported point estimates, but do not sufficiently explain why these five experts are warranted or whether the gains specifically arise from complementary forecasting knowledge. A clearly specified ground-truth-only reward baseline, followed by matched-budget comparisons with a strong single expert and smaller expert subsets, is needed to substantiate the central contribution.
- The interpretation of expert consensus as transferring complementary forecasting knowledge needs stronger distribution-level evidence. Appendix A.6 correctly shows that the mean expert reward is, up to a candidate-independent constant, negative MSE to the average cached expert trajectory. The UWO penalty discourages unequal expert assessments, but disagreement can represent valid alternative futures rather than unreliable guidance. Consequently, the reward is plausible as a regularizer, while preservation of complementary multimodal knowledge is less clearly demonstrated. The mean-aggregation and distillation controls are useful, but best-of-20 errors and collision statistics do not determine whether improvements retain plausible mode coverage or suppress legitimate alternatives. An analysis relating expert disagreement to prediction correctness and mode coverage would materially strengthen the motivation. The absence of variability across training seeds also limits confidence in the reported differences between expert configurations.
- The statistical reliability of the reported improvements is unclear. The paper does not report means and variances across independent training runs. The authors should repeat the main experiments and key ablations with different random seeds, keeping the data splits and evaluation protocols fixed, and report the mean and variance of ADE/FDE.
Questions for authors
See above weaknesses