- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper investigates whether action conditioned latent predictive representations retain physically meaningful vehicle states, preserve physical neighborhood structure and accurately capture local responses to control inputs. The authors propose a measurement protocol that separately evaluates state retention through frozen readout probes, physical organization through nearest neighbor overlap and collision metrics, predictive accuracy against persistence and supervised baselines, and local control response through matched perturbations of the simulator, target representation, and predicted representation.
The main contribution is a systematic evaluation framework demonstrating that state retention, forecasting accuracy, and local control fidelity are distinct properties of predictive latent models.
The authors validate the protocol using a temporal joint-embedding predictive architecture with a controlled neural ODE predictor trained on IPG CarMaker simulation data.The results suggest that low prediction error alone is insufficient to establish a latent model's suitability for model-predictive control. However, the validation is limited to noise-free simulation on a single route with one automated driver and six vehicle configurations; real-world vehicle transfer and closed-loop control performance remain unverified.
Critical strengths
1.A systematic evaluation framework that disentangles distinct properties of latent predictive representations. The paper evaluates state retention, physical neighborhood organization, forecasting accuracy, and local control-response fidelity using complementary metrics and controlled comparisons.
- A consequential empirical finding supported by controlled experiments. The results show that reasonable forecasting accuracy does not guarantee accurate local responses to control perturbations: predicted responses can diverge substantially from simulator responses and lead to worse rankings of nearby candidate commands.
Critical weaknesses
The validation is limited to noise-free simulation on a single route with one automated driver and six vehicle configurations; real-world vehicle transfer and closed-loop control performance remain unverified.
Questions for authors
How sensitive are these results to the magnitude and duration of the perturbations, the choice of operating points, and the normalization used to calculate response error and regret? Could the authors provide evidence that the observed discrepancies are robust across these choices rather than specific to the evaluation setup?
The untrained encoder performs better than the trained encoder on state recovery and neighborhood preservation. How do the authors interpret this result, and what evidence supports attributing the observed representation properties to predictive training rather than architectural inductive biases or properties of the input data?
Specific Response to Reviewer 8G7P
We thank the reviewer for the careful comments. We wrote a general response summarizing the improvements to the reviewed paper, and below are the specific responses to your comments:
One route and driver, noise-free simulation, no closed loop.
The study is repeated on a second road and with a second driver (§3; Table 3; Appendix G.8). §6 states the remaining limits: simulation only, no closed-loop evaluation, no independent command excitation because the interface cannot add a signal to a driver command, milder regimes in the replications, and intervals over six vehicles.
Sensitivity to magnitude, duration, operating point and normalization.
Why does the untrained encoder do better, and what is attributable to training?
The reference outputs are among the encoder inputs, so retaining them is a property of the inputs and the architecture. An MLP on the raw history reaches R² 0.999, and larger readouts narrow the gap between trained and untrained encoders from 0.015 to 0.005 (§5.1; Table 17). A retention score is therefore informative only next to an untrained reference (§6). Training does change what the other lenses measure. With data and architecture fixed, masking target commands raises neighbor overlap by 0.052 [0.037, 0.064] in 6/6 vehicles, close to the untrained level, and improves forecasting and history response. These effects recur with the second driver (+0.051) and are not resolved on the second road (Table 35), so this attribution depends on the data.