- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces PanoWorld, along with the World360 dataset. The authors fine-tune a video generation model to adapt to panoramic video generation, and propose DPRC and GMA to realize camera control and memory retrieval. The authors also conduct experiments, including both qualitative and quantitative evaluations, to demonstrate the effectiveness of the proposed method.
Critical strengths
The proposed World360 dataset is valuable for the community.
Critical weaknesses
-
The main claim of "rotation-equivariance" is exaggerated. Rotating an ERP along the yaw axis is simple, i.e., horizontal translation (or circular padding), which means that the main visual content still lies within the ERP grid. However, when it comes to pitch/roll, the situation becomes more complex. In this case, trivial visual content (e.g., sky or ceiling) takes over the ERP grid, and severe distortion appears. Building on this fact, the technical contribution of the paper is significantly undermined, as the remaining technical designs seem to be a combination of existing works, such as PRoPE, CubeDiff, and WorldPlay.
-
The authors should carefully review the manuscript before submitting it to the conference. There are many problems regarding writing. For example, in line 069: "To stably optimize each component, we employ a progressive, three-stage training strategy." — and the paragraph ends there, which seems to be an incomplete sentence. Likewise, in line 161: "...despite variations in velocity. Finally," seems to be cut off by the next paragraph. (Italics can be used to indicate sub-headings within a paragraph, such as Uniform Spatial Resampling and Exposure Quality Filtering.)
-
I checked the supplementary videos, and I didn't find a remarkable improvement in PanoWorld compared to Matrix-3D, though the latter method is not fine-tuned on the World360 dataset.
Questions for authors
How well does PanoWorld perform in terms of camera control that includes pitch/roll?