- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper studies camera pose estimation from sparse multi-view inputs: given N unordered images, it predicts the rotation and translation of each image relative to a randomly selected reference frame.
Critical strengths
- The constraint that a quaternion must lie on the unit sphere is enforced at every step of the generative process, rather than being imposed only as a loss term.
- A controlled variant shares the same architecture and hyperparameters, so the central claim is supported by direct numerical evidence.
- The appendix provides ablations over the backbone and the number of integration steps, which is useful reference material for practical deployment.
Critical weaknesses
- The translation branch produces a confusing result. The translation branch of QuacamFM and QuacamFM-lerp is identical in both design and formulation, yet translation accuracy (RTA) differs substantially in Table 1. A modification confined to the rotation branch should not directly alter the generation path or the supervision signal for translation. This result is difficult to interpret.
- The reported numbers do not match the authors' claims. PoseDiffusion's RTA@15 (79.8) and AUC@15 (47.5) both exceed the proposed method's (74.2 and 45.1), and RelPose++'s RRA@15 (84.5) also exceeds it (82.0). This is inconsistent with the paper's stated "advantage in camera pose accuracy over diffusion-based methods" and with the claim of "significant improvements over previous methods, including classic SfM and diffusion-based approaches".
- The baseline coverage is dated. The most recent methods compared against are PoseDiffusion (2023) and RelPose++ (2024). More recent feed-forward geometry methods — DUSt3R, MASt3R, VGGT, FLARE — as well as Camera-as-Rays and DiffusionSfM, are discussed in the related work but none of them appear in the experiment tables.
Questions for authors
- The translation branch is identical in QuacamFM and QuacamFM-lerp. Why does RTA@15 in Table 1 then improve from 60.4 to 74.2?
- On the quantitative results the proposed method is not uniformly ahead. What, specifically, is its advantage over PoseDiffusion and RelPose++?
- What is the advantage of the proposed method compared with current feed-forward geometry methods such as DUSt3R, MASt3R, VGGT, and FLARE?
3 comments
Thank you for the detailed responses.
The clarifications in Q1 and Q2 are helpful. But my concern in Weakness 3 remains. I pointed out that the original baselines are relatively outdated and asked for a comparison with recent feed-forward methods such as VGGT-omega, Pi3 and DUSt3R. The rebuttal still does not provide quantitative evidence that the proposed method is stronger than these approaches.
The discussion of pose ambiguity in Figure 7 and Section 4.4 is interesting: the method can sample multiple plausible hypotheses for symmetric or repeated structures, whereas VGGT and DUSt3R return a single estimate. This remains a qualitative argument. It does not show that the proposed method is more accurate, or more useful in practice, than current feed-forward estimators under the same evaluation protocol.
I therefore maintain my score of 2.
We thank the reviewer for further feedback.
We would like to further discuss the remaining concern.
The overall benefit of probabilistic methods, including ours and other baselines, over feed-forward methods is their ability to generate multiple plausible hypotheses. However, since only a single ground-truth pose is available for each ambiguous input, rather than the underlying pose distribution, we cannot reliably evaluate uncertainty for any probabilistic method.
The key is not simply which method achieves higher accuracy, but which can capture a meaningful distribution of plausible solutions. For example, with symmetric objects, multiple camera poses can produce identical observations.
Figure 7 demonstrates our method's ability to capture such plausible distributions. The selection of a particular hypothesis depends on the downstream task.
We do not compare against current feed-forward methods, e.g. VGGT, for two reasons:
-
Methodological focus: Our approach is probabilistic and is therefore more directly comparable to probabilistic baselines such as Ray Diffusion and DiffusionSfM. Under this comparison, our method achieves substantially faster inference.
-
Fairness of training settings: VGGT and VGGT-Omega are trained on many massive datasets, making comparable training infeasible. Our reported results, including results in submission and rebuttal phases, follow consistent experimental settings to ensure fair comparisons.
Thank you for your thoughtful feedback and recommendations. We provide the answers to your questions below:
Q1: Why does the translation metric differ in QuacamFM and QuacamFM-lerp?
During training, the model predicts camera translations in the camera-to-world representation. This allows the model to learn translations independently of camera orientations, providing a consistent training translation target.
During evaluation, we convert the predicted poses into the world-to-camera representation to maintain consistency with the evaluation protocol in PoseDiffusion. Since this conversion of translations involves estimated rotations, rotation inaccuracies can affect RTA, explaining why the metric can differ despite identical translation branches.
Q2: What are the advantages over PoseDiffusion and RelPose++?
Our method shows advantages in all metrics compared to PoseDiffusion w/o GGS, which has the same model capability and does not either use correspondences or post optimisation.
Comparing with PoseDiffusion and RelPose++, which require explicit correspondence or post-optimisation, we achieve higher accuracy at threshold of 30, and comparable at threshold of 15, while reducing inference time by approximately 19× and 10×, respectively.
Q3: What is the advantage of the proposed method compared with feed-forward methods?
Inspired by probabilistic modeling, our method can generate a distribution of plausible camera poses, capturing multiple valid hypotheses under ambiguous image observations. Please see Figure 7 in our uploaded revision version for a demonstration.
In challenging cases, such as symmetric objects, multiple camera poses may be equally plausible. In contrast, deterministic feed-forward models, e.g. VGGT, DUSt3R, can only produce one single pose estimate, which may fail to capture the correct solution when there is ambiguity.
In Figure 7, in section 4.4 in our uploaded revision version, we discuss how our method generates plausible hypotheses with input objects that are highly symmetric and have repeated structures.
We also added a comparison against RayDiffusion and DiffusionSfM, please see updated Table 1. RayDiffusion and DiffusionSfM use a dense-ray representation to parameterize the cameras, hence, we observed that they achieves higher accuracy but take 20× and 5× times longer inference than our method.