- Rating
- 4
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes NFL-World, a multimodal world model that integrates synchronized American football video and player-tracking data. It combines modality-specific representation learning, token compression, and causal Transformer-based predictive fusion to learn game-state representations. Experiments demonstrate improvements in play classification, similar-play retrieval, and next-second player-motion prediction.
Critical strengths
S1: Addresses an interesting multimodal sports-understanding problem using real-world NFL data.
S2: Evaluates three downstream tasks with multiple baselines, ablations, and scaling analyses.
S3: Token compression substantially reduces fusion computation while maintaining competitive performance.
Critical weaknesses
W1: The evaluation focuses on representation-based classification, retrieval, and one-second forecasting, without demonstrating longer-horizon simulation, counterfactual reasoning, or planning capabilities.
W2: Experiments cover only the 2025 NFL season, without cross-season generalization or independent expert validation of the annotation-derived retrieval relevance.
W3: NFL-World fine-tunes its fusion components for classification, whereas several competing pretrained models are evaluated using frozen representations, making it difficult to isolate architectural improvements.
Questions for authors
See the above
2 comments
I am familiar with the research direction, and the authors have addressed my concerns. Therefore, I maintain my score.
Response to Reviewer Bnd5
We thank the reviewer for the supportive review and for recognizing the merits of our work. We answer each point in the order raised. We have uploaded a revised paper; all changes are marked in blue.
W1. No longer-horizon simulation, counterfactual reasoning or planning
Table 1. Forecasting error at 2 to 5 seconds (TEST RMSE in yards).
W2. A single season, and no expert validation of retrieval relevance
W3. Fine-tuned NFL-World against frozen baselines
In classification, NFL-World still scores highest when it is completely frozen and read by exactly the same probe as the baselines. We froze the NFL-World model entirely and trained the same attentive probe used for BDB, with the identical recipe, over 5 random seeds. Results are in Table 2.
Table 2. Classification with the same probe (TEST 11-task weighted F1).
We thank the reviewer again for the encouraging assessment.