- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces PVWander, a framework that first lifts 2D panoramic videos to 3D point clouds, and re-renders videos from partially observed point clouds. Path-Facing Canonicalization aims to regularize the ERP direction, and Timestep-aware Gating is proposed to eliminate artifacts. The idea is intuitive but not novel, and the writing is easy to follow. There is no supplementary material, and no video results are provided.
Critical strengths
- The proposed design is reasonable, and the writing is easy to follow.
- Quantitative experiments demonstrate the effectiveness of PVWander.
Critical weaknesses
-
The Path-Facing Canonicalization seems somewhat trivial, as it mainly operates on the yaw axis, though the authors provide an ablation study on this design. This is equivalent to horizontally rotating an ERP, while the main visual content still lies within the ERP grid. However, when it comes to pitch/roll movement, trivial visual content (e.g., the ceiling) takes over the ERP grid, and severe distortion appears. How robust is PVWander in this situation?
-
No video results are provided, making it difficult to evaluate the quality of the generated panoramic videos, which is a critical aspect in this field.
Questions for authors
How robust is PVWander? Does PVMetric fail when sharp pitch or roll is applied?
5 comments
Response to the Novelty Concern (Summary & W1)
Response to the Novelty Concern (Summary & W1)
Our core contributions target two challenges: diverse motion–orientation relationships and imperfect 3d memory guidance.
For the former, exploiting the horizontal cyclic symmetry of ERP, we propose Path-Facing to align each segment's ERP orientation with its principal motion direction. The key lies in the trajectory-dependent canonicalization, rather than the cyclic shift operation itself. For the latter, we propose Timestep-aware Gating to adaptively regulate memory guidance across denoising stages, preserving useful structural benefits while mitigating unreliable local details.
In our manuscript, the statistics over 31K sampled clips in Fig. 1 show that Path-Facing effectively reduces the variability of motion directions relative to ERP orientations. Fig. 1 and Fig. 6 further illustrate the timestep-dependent behavior of the learned gating output, consistent with our coarse-to-fine motivation. Tab. 3 demonstrates the contributions of both designs through ablations, while Tab. 4 further supports the gating design details.
Importantly, Path-Facing is not tied to the 3D memory pipeline or a specific framework. Tab. 5 demonstrates its zero-shot transfer to existing panoramic generators, including Wan2.1-Fun. Furthermore, Tab. 3 shows that incorporating Path-Facing during training brings additional improvements to Wan2.1-Fun.
Overall, these results support the practical value and transferability of our designs.
2. Additional comparison with EvoWorld.
To further evaluate the generalizability of our designs, we conduct additional experiments on the Unity_curve dataset of EvoWorld, as shown in Tab. III.
First, to control for the backbone difference, we implement an SVD-based PVWander variant and compare it with the official EvoWorld. At the matched 1024×512 resolution, SVD-based PVWander consistently outperforms the official EvoWorld across all metrics at both 25 and 73 frames.
Furthermore, to test whether our designs can benefit an independent framework, we reproduce EvoWorld and integrate Path-Facing (PF) and Timestep-aware Gating (TAG) into it. Under identical training and inference settings at 640×320, adding PF and TAG improves all metrics over the reproduced EvoWorld baseline. After high-resolution fine-tuning at 1024×512, the enhanced model also outperforms the official EvoWorld.
Overall, these results demonstrate that our designs generalize across different backbones and can effectively benefit an independent panoramic framework. We will include these comparisons in the revised manuscript.
Table III. Comparison on EvoWorld's outdoor Unity_curve dataset. 25F and 73F denote the first-segment (25 frames) and three-segment (73 frames) evaluations, respectively. PF: Path-Facing Canonicalization; TAG: Timestep-Aware Gating. All reproduced models follow the same training schedule: 5K steps (batch size 24) at 640×320, followed by 3K fine-tuning steps at 1024×512. Other settings follow the official EvoWorld implementation.
| Method | Resolution | 25F-SSIM↑ | 25F-PSNR↑ | 25F-LPIPS↓ | 25F-FID↓ | 25F-FID_cube↓ | 25F-TransErr↓ | 25F-RotErr↓ | 73F-SSIM↑ | 73F-PSNR↑ | 73F-LPIPS↓ | 73F-FID↓ | 73F-FID_cube↓ | 73F-TransErr↓ | 73F-RotErr↓ |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| EvoWorld (official, native) | 1024×576 | 0.7745 | 18.93 | 0.3238 | 14.65 | 19.70 | 0.768 | 10.10 | 0.7480 | 16.88 | 0.4192 | 25.53 | 23.68 | 3.467 | 43.70 |
| EvoWorld (official, resized) | 1024×512 | 0.7723 | 19.06 | 0.3216 | 14.54 | 19.70 | 0.768 | 10.10 | 0.7442 | 16.96 | 0.4181 | 25.30 | 23.68 | 3.467 | 43.70 |
| PVWander (SVD-based) | 1024×512 | 0.8199 | 22.00 | 0.1991 | 12.01 | 19.52 | 0.069 | 0.262 | 0.7891 | 20.04 | 0.2597 | 13.02 | 17.42 | 1.795 | 18.15 |
| EvoWorld* (reproduced) | 640×320 | 0.7321 | 19.26 | 0.3034 | 20.68 | 27.51 | 0.575 | 8.206 | 0.6905 | 16.87 | 0.4205 | 36.09 | 34.88 | 3.540 | 45.12 |
| EvoWorld* + PF & TAG | 640×320 | 0.7745 | 21.19 | 0.2156 | 14.11 | 20.77 | 0.239 | 0.338 | 0.7417 | 19.38 | 0.2715 | 16.97 | 18.81 | 1.836 | 18.27 |
| EvoWorld* + PF & TAG | 1024×512 | 0.8091 | 21.13 | 0.2265 | 11.38 | 17.89 | 0.233 | 0.274 | 0.7834 | 19.43 | 0.2705 | 11.50 | 15.06 | 1.827 | 18.32 |
Thank you for your response. Considering that the novelty does not convince me, I have decided to maintain my score.
We sincerely thank Reviewer ktFv for the valuable feedback. We have prepared an anonymized project page with additional qualitative results and videos: https://review-supplement.pages.dev. Below, we address each weakness (W) and question (Q) point by point. We will incorporate the relevant content into the revised manuscript.
W1 & Q1: Robustness to Large Pitch/Roll Rotations
1. Handling large pitch/roll rotations
In our task setting, target camera poses are precisely known. We therefore perform generation and depth estimation with zero pitch&roll, then use spherical reprojection (e.g., Equilib [1]) to obtain the requested viewing orientations. Unlike yaw, which can be handled by ERP's horizontal cyclic shift as in Path-Facing, pitch/roll substantially alter ERP distortion and may introduce a distribution gap for pretrained models. This setting is also consistent with recent methods such as OmniRoam[2] and PanoWorld[3].
Accordingly, below we evaluate the visual robustness of reoriented videos and depth estimation under large pitch/roll rotations.
2. Robustness evaluation of PVWander and PVMetric
We evaluate both the visual quality of reoriented panoramic videos (Tab. I) and the accuracy of depth estimation (Tab. II) under large pitch/roll rotations.
For PVWander, we conduct experiments on 98 InteriorGS-OmniRoam test scenes, each containing 641 frames. Pitch and roll continuously vary over time within [−60°,60°] throughout each sequence. Identical spherical rotations are applied to the generated panoramas and corresponding GT, using the same rotation trajectories for both PVWander and OmniRoam.
Table I. Robustness of output reorientation on 98 test scenes (8 segments per scene).
As shown in Tab. I, large pitch/roll reorientations introduce only minor degradation, while PVWander maintains better generation quality than OmniRoam under both upright and rotated settings.
For depth estimation, PVMetric is specifically trained for our generation framework using panoramas with zero pitch&roll. We evaluate PVMetric under large pitch/roll rotations and compare it with the general-purpose panoramic depth estimator DAP [4].
Table II. Depth estimation accuracy under pitch/roll rotations (±60°). For upright inference + output rotation, we estimate depth from upright input and then apply spherical rotations to the predicted depth maps.
Directly feeding rotated ERP panoramas to depth estimators leads to substantial accuracy degradation. DAP exhibits a similar trend, indicating that sensitivity to large pitch/roll variations is a broader challenge in panoramic depth estimation. Notably, performing depth estimation on upright panoramas followed by spherical reorientation nearly restores the original accuracy for both estimators.
Section 3 of our anonymous project page further provides videos, demonstrating the reorientation of PVWander outputs to different pitch and roll angles.
[1] PyEquilib: Processing Equirectangular Images with Python, https://github.com/haruishi43/equilib, 2021
[2] Omniroam: World wandering via long-horizon panoramic video generation. SIGGRAPH 2026
[3] PanoWorld: Real-World Panoramic Generation. ArXiv 2026
[4] Depth any panoramas: A foundation model for panoramic depth estimation. CVPR 2026
W2: Video supplementary
We have created an anonymized project page: https://review-supplement.pages.dev. Please refer to Section 2 for video results.