- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates panoramic video understanding, where relevant visual evidence may be distributed across different viewing directions and temporal locations. The authors introduce PanoVideoBench, a manually annotated benchmark containing 1,000 multiple-choice questions across five semantic categories and 15 question types, with additional diagnostic annotations for evidence search and panoramic reasoning capabilities. Evaluations of 11 existing models reveal that cross-view tracking and sphere–time evidence integration remain challenging. To address these limitations, the authors construct PanoVideoCoT, a training dataset of 13,465 question-answer-reasoning pairs generated from real panoramic videos through sphere–time evidence construction, question synthesis, agentic exploration, and reasoning trace verification. They subsequently train PanoVideoReasoner using supervised Chain-of-Thought fine-tuning and Evidence-Privileged On-Policy Self-Distillation (EP-OPSD). The resulting model achieves 55.7% accuracy on PanoVideoBench, outperforming its Qwen3.5-9B backbone by 12.5 percentage points and the strongest reported baseline by 2.6 points. Overall, the paper contributes a structured evaluation framework and a practical training pipeline for panoramic video reasoning.
Critical strengths
The proposed PanoVideoBench extends beyond static panoramic perception to evaluate spatial relationships, action understanding, cross-view identity tracking, and temporal reasoning in real panoramic videos. A particular strength is the separation between semantic question categories, target-search settings, and panoramic reasoning capabilities. This design allows more informative diagnosis of model limitations than overall question-answering accuracy alone. The manually annotated evaluation set, independent answer verification, and direction-sensitive quality checks further support its value as a benchmarking contribution.
The proposed PanoVideoCoT pipeline associates visual observations across directions and timestamps, constructs questions from supporting evidence, and derives reasoning traces from successful visual exploration. This is a sensible approach to producing panoramic reasoning supervision while reducing dependence on fully manual annotation. The experiments show substantial improvements over the backbone, especially in spatial reasoning, motion tracking, and temporal reasoning. The ablation studies also provide useful evidence that CoT supervision and evidence-privileged teacher views contribute to the observed performance gains.
Critical weaknesses
- The evaluation does not sufficiently establish whether the model learns the intended sphere–time evidence-grounding capability.
The paper's central motivation is that panoramic video understanding requires locating, maintaining, and connecting observations across viewing directions and time. However, the main evaluation relies on multiple-choice answer accuracy. Although the benchmark includes diagnostic capability labels, these measure accuracy on particular question subsets rather than whether the model actually identifies and associates the correct supporting evidence.
This distinction is particularly important because the proposed training pipeline explicitly constructs evidence records containing timestamps, directions, and cross-view entity associations. These annotations could potentially support a more direct evaluation of evidence localization, identity continuity, and temporal association.
Related work such as CaST-Bench (CVPR 2026) has explored evaluating evidence-chain-grounded spatio-temporal reasoning. While the panoramic setting introduces additional challenges, the paper would benefit from discussing this distinction and providing stronger validation that the improvements reflect the intended evidence-association capability rather than improved multiple-choice video QA performance.
- The contribution and generalizability of panoramic-specific supervision are not sufficiently isolated from existing video reasoning and distillation approaches.
Several components build on established methods. For example, OmniCoT (ECCV 2026) explores panoramic reasoning benchmarks and CoT supervision, VideoEspresso (CVPR 2025) investigates grounded video reasoning data construction, and EP-OPSD explicitly adapts the existing Vision-OPD self-distillation formulation. The distinctive contribution therefore appears to lie primarily in extending evidence-grounded reasoning supervision to panoramic video and incorporating cross-view temporal associations.
While the reported improvements are encouraging, the experiments do not fully establish how much of the gain comes specifically from the proposed sphere–time representation and evidence association, as opposed to general CoT supervision and evidence-enhanced training. Moreover, the main evaluation is confined to PanoVideoBench, leaving the transferability of the learned capability to other panoramic-video or conventional video reasoning benchmarks unclear.
A more targeted ablation of the sphere–time evidence construction, or a cross-benchmark evaluation, would help establish the general significance of the proposed framework.
Questions for authors
Q1. How can the authors verify that the model correctly identifies and connects the relevant sphere–time evidence, rather than obtaining the correct multiple-choice answer through alternative cues?
Given that the training pipeline already maintains evidence timestamps, directions, and entity associations, could the authors evaluate evidence localization or association accuracy on a representative subset? Such an analysis would materially strengthen the central claim of improved panoramic reasoning.
Q2. How much of the improvement is attributable specifically to sphere–time evidence construction and association?
Table 5 establishes the benefits of CoT SFT and evidence-privileged distillation, but it would be helpful to isolate the value of the panoramic-specific evidence representation. For example, how does training with sphere–time-grounded CoTs compare with using conventional video CoTs or CoTs constructed without explicit cross-view entity association, under comparable training settings?
Q3. Does the learned reasoning capability generalize beyond the proposed benchmark?
Could the authors provide cross-dataset results on compatible panoramic-video benchmarks, or evaluate the trained model on an established conventional video reasoning benchmark? This would clarify whether the method develops transferable spatial-temporal reasoning capabilities rather than improving performance primarily on the proposed benchmark distribution.
Q4. How reliable are the automatically synthesized evidence associations and reasoning traces?
The pipeline uses model-based verification and successful agent rollouts to select training samples. Since correct final answers do not necessarily imply correct intermediate reasoning, is there any human assessment of the accuracy of the generated evidence chains and reasoning traces, particularly for cross-view identity tracking and temporal association? If available, reporting annotation agreement or error rates on a representative subset would help assess the reliability of the supervision.