- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes PanoWeaver, a model for finding the desired perspective view from an input panoramic image given text condition. The author proposed a hybrid framework that jointly estimates the camera parameters and denoises the target rgb image. To train such a model, the author collected 100K panoramas with corresponding perspective views. Experimental results demonstrated certain amount of improvement upon existing methods.
Critical strengths
- This paper is mostly well-written and easy-to-follow.
- The 100K image labeling seems a huge effort for human to label themselves.
Critical weaknesses
-
Insufficient justification for joint image generation. The target view is a deterministic projection of the input panorama given a low-dimensional camera state. The paper lacks a controlled baseline that fuses visual and text features (e.g., via standard attention layers), directly predicts camera parameters, and renders the resulting view.
-
Limited gains and missing efficiency evaluation. In the text-free setting, the proposed method achieves comparable rather than superior spherical IoU to UNIC (0.465 vs. 0.468). Given the 9B backbone and 50-step sampling procedure, the absence of inference latency and computational cost, it is unclear whether this simple task worth such a complicated model to handle.
-
Missing iterative rendering-feedback baseline. Although the paper includes VLM baselines, it does not report a tool-assisted agentic approach that iteratively proposes camera parameters, inspects the actual rendered view, and refines the framing. I recommend the authors to directly test this task with general-purpose coding agent harness (e.g., claude code or codex). This would directly test whether visual feedback can improve camera selection without jointly generating image pixels.
-
Evaluation does not clearly isolate the claimed benefits. Spherical IoU directly measures agreement with the annotated viewport, whereas improvements in PSNR, SIFT, or VGGT do not necessarily establish better photographic composition. Given that the degree of freedom is only five, that many metrics seem unnecessary. Besides, given that the paper aims at helping people with photography, I think a human preference score is needed for evaluation.
-
Minor issues
- The paper distinguishes their task as a "new photography-oriented task," however, the task is already handled in existing frameworks as mentioned in its own related works section.
- Figures 6 and 7 are too small to clearly see the difference between images.
- Reference formatting is inconsistent, e.g., some entires use full venue names while others use abbreviated names.
Questions for authors
- How did you collect the 100K labels just by human? Can you disclose the details, e.g., how many people worked on it and how much time it took on average to label one image? It seems a very huge amount of work.
Besides, please address my concerns raised in the weaknesses section.
Thank you for the detailed rebuttal. However, some concerns remain unresolved.
Regarding model size and computational cost, I am still not fully convinced why this discriminative task requires a diffusion model taking 105 seconds per image. As a thought experiment, suppose we approach ImageNet classification through joint image generation and label prediction, increasing the model size from tens of millions to tens of billions of parameters and inference time from a fraction of a second to roughly 100 seconds. While this might improve performance, the gains could simply come from the increased model capacity and compute. The CLIP ViT-B/32 baseline is still roughly two orders of magnitude smaller than the proposed model. Without comparisons under similar parameter and compute budgets, it is difficult to attribute the gains to the proposed formulation. Furthermore, even if the formulation contributes, I remain unconvinced that the improvement justifies such a substantial computational cost for this task.
Regarding the agentic baseline, the iteration budget is limited to three rounds, and the underlying model is GPT-5.6-Sol. Would a stronger model with a larger iteration budget match or surpass the proposed method? Given the improvement from one to three rounds, this seems worth investigating.