- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes SPW-Nav, a semantic-aware streaming panoramic video generation framework. The authors also construct SPW-NavSet, a 233-hour dataset paired with verified explicit and goal-based movement instructions, and SPW-NavBench, a 100-clip evaluation benchmark with ground-truth trajectories and dual instruction types.
Critical strengths
The writing is easy to follow.
Critical weaknesses
The performance is really poor. I carefully reviewed the supplementary video and found that it does not appear to accurately follow the navigation prompts. For example, at timestamp 00:23, among the three scenes sharing the instruction history that includes "move forward three meters," consider the leftmost one: after turning left by 90 degrees, the camera's movement becomes nearly static. Even if there is slight movement, the displacement is far smaller than that produced by the earlier "move forward three meters" instruction. As a result, the subsequent instruction "walk forward five meters" appears to be ineffective. Similarly, the middle video also fails to comply with the instruction "Keep walking until you reach the statue." The same issue persists in nearly all subsequent scenes. Based on this, I believe the experiments do not support the paper's claim in line 048 that "SPW-Nav understands the semantics of movement instructions."
Questions for authors
I had originally intended to ask about the generalization ability of text instructions; however, I would instead suggest that the authors first ensure the model can accurately follow navigation instructions.