- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors explore the problem of converting turning static figures in printable textbooks into interactive experiences and video examples. To be faithful to the stated physical laws in the textbook, the proposed method first extracts relevant equations and provides them as context for code and video generation.
Critical strengths
The idea is simple but powerful. The method has the potential to speed up learning experience of textbooks and the included human evaluation shows this qualitatively. The method section tries to introduce the approach in a very detailed manner.
Critical weaknesses
That said, I don't think the paper is ready yet for publication and needs further revisions. First and foremost, the paper does provide almost no example outputs that would help to put the very dry methods section into context. Given the topic, I would have loved to inspect some outputs myself e.g. through the supplementary materials to deepen my understanding. Apart from this several aspects of the paper are either ambiguous, unclear or contradictory to me. Figure 1, for example, puts video generation as a pipeline step after interactive output generation, yet in Figure 2 the processes run in parallel. Some aspects of the approach also do not appear well discussed. The method seems to rely heavily on large language models, but how is not clear. Baselines, on the other hand, rely on much lighter embedding models which makes it difficult to assess if the observed improvements come from the approach specifically or from just using stronger models. The authors should be more clear and list which exact models they are employing in their experiments and why they think the comparison is fair. Other aspects of the evaluation are also unclear: How was the dataset collected? What are the eight multiple choice questions? How exactly does the degradation work? It sounds like the interactive artifacts are compared against the static image. How does this evaluate interactivity? And what value does the interactive figure provide if it can't outperform the static image baseline (Figure 4)? Last but not least, the authors should discuss the limitations of their approach, e.g., how does the runtime compare across approaches?
I am happy to increase my score if the authors can address my concerns. But as of now I would recommend the authors to revise their work and resubmit.
Questions for authors
- l.27 to what metric do the reported score numbers belong?