- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies how ego motion can help predict future driving scenes. MotionJEPA first moves the current bird’s-eye-view (BEV) map into an estimated future ego frame. A neural network then predicts a signed correction to this transported map.
The experiments use seven-channel semantic BEV maps built from NAVSIM annotations, with prediction horizons of 0.5, 1.0, and 1.5 seconds. The paper compares direct prediction, motion-conditioned prediction, geometric transport alone, and transport with a learned residual. Compared with the motion-conditioned baseline, the proposed method reduces test Macro Smooth-L1 by 7.69%. Validation mIoU increases from 0.5906 to 0.6585. The paper also uses ground-truth future poses to study errors caused by motion extrapolation.
Critical strengths
Models A1 and A3 use the same motion information and have the same number of trainable parameters. Their difference shows the effect of using motion as an explicit geometric operation rather than only as a network condition. Model A3 improves both test Smooth-L1 and validation mIoU.
It notes that the residual may include motion-estimation errors, sampling errors, visibility changes, and object motion. The ground-truth-pose comparison on common support is a useful check. This makes the interpretation more credible than claiming that the network separates only true environmental motion.
Critical weaknesses
The input and target are fixed semantic BEV maps built from annotations. The reported setup does not demonstrate a learned joint-embedding target or evaluate representation quality. Transport followed by learned correction is also closely related to the physics-plus-learning and feature-warping approaches discussed in the paper. The related-work section does not clearly explain what new capability or insight distinguishes MotionJEPA from these ideas.
The study uses one dataset setup, short prediction horizons, and 10,000 training steps. It does not report results across different random seeds or confidence intervals. At 1.5 seconds, A3’s test Smooth-L1 improvement over A1 is only about 1.07%. A3 also has higher MAE than transport alone and does not improve pedestrian or bicycle IoU over that baseline. These results do not disprove the method, but they make it important to show that the gains are reliable and explain which errors the residual corrects. The current comparisons also combine geometric alignment with the additive residual, so their separate effects are unclear.
Questions for authors
-
What makes the evaluated Stage 1 model a joint-embedding predictive architecture? Are any context or target representations learned beyond the supervised semantic prediction network described in the paper?
-
Were the results obtained from a single training seed? Please provide the missing training settings and, if available, variation across seeds or paired confidence intervals across test logs. Does the A1-A3 gap remain after longer training?
-
How does A3 compare with a model that receives the transported BEV and the same motion condition, but directly predicts the future BEV without adding the transport baseline? This would help separate the value of alignment from the value of residual prediction.
-
Can you report the common-support CTRA-versus-ground-truth-pose errors by static and dynamic class and by horizon? Together with ego-pose extrapolation errors, this would help assess how much of the residual addresses motion-prior errors rather than changes in other road users.