- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper seeks to provide an explainability method for world models. As typical explainability methods probe model parameters to examine the output, and world models use their predictions as input for further computation, this problem is not trivial. It is proposed to evaluate the model at the current step and future steps, which is tested on multiple editors and 3 models on 3 benchmarks. This analysis shows that the models should be rewarded more for future consequences, resulting in the proposition of the temporal supervision method delayed loreft, which shows improvement in some tasks.
Critical strengths
- Explainability is an important problem, and extending it to world models is both important and relevant, specifically due to the difficulties in trivially transferring traditional explainability methods.
- The experiments appear extensive and thorough
Critical weaknesses
- The related work is very short, I would expect at least some minor discussion on world models, or at least a more detailed analysis of previous world model interpretability work. The limitations of the prior work are not defined in a way that shows the need for this method.
- The figures for this paper are unfocused and unclear. There is no figure for either RolloutFaith or Delayed Loreft, and instead there is an unclear teaser figure and a figure for the dataset composition, which appears to be composed from existing datasets. The captions can also be significantly improved with direct explanations instead of requiring the reader to find where it is mentioned in the text.
- Overall it seems that the paper can be framed better, starting with a more structured background on world models, an analysis of existing interpretability metrics with clear examples of failure cases, and finally explaining the framework and results.
- The proposed improvements do now show improvement over all tasks
Questions for authors
- Can you provide some clear examples of where previous interpretability methods fail, and RolloutFaith succeeds.
- Can you provide a framework/method diagram for both RolloutFaith and Loreft