- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
Visual geometry foundation models recover structure and camera motion in an arbitrary unit. UniMetric estimates one positive scale for a sequence without training or extra sensors. A vision–language model (Seed1.8) proposes familiar objects, height intervals, confidences, and a support surface; SAM 2.1 produces masks. Object height is measured in the reconstruction along the normal of a plane fit to the support, and each height interval becomes an interval on the shared scale. A convex weighted sum of squared distances to these intervals is minimized by golden-section search, and the resulting scalar multiplies point maps and camera translations. MetricBench evaluates this correction on twelve driving, roadside, and embodied subsets (694 sequences) without ground-truth scale alignment. Across nine models, the authors report mean reductions of 54.2% in depth Abs Rel, 83.8% in Chamfer distance, and 65.6% in trajectory error, with every model improving on all three tasks at the suite level.
Critical strengths
1.The evaluation asks the question that standard GFM tables remove. Depth and pose are scored after rigid alignment only, never after fitting scale to the sensor reference. Under that protocol, most driving results start at δ₁ = 0.0 and Abs Rel near 0.97. Suite-level Abs Rel then falls from 0.892 to 0.338 on driving and from 0.671 to 0.379 on embodied scenes, and the same scale improves Chamfer distance and ATE for every model in Table 3. The gain is not confined to models with an arbitrary unit: π³ already has driving Abs Rel 0.330 and δ₁ 33.0, and UniMetric moves these to 0.190 and 80.6. Holding the GFM output fixed and changing only the scale makes the comparison easy to interpret. 2.Where a practitioner’s alternative is reported, UniMetric is ahead, and the design ablation matches the paper’s claim. On VGGT-Ω, one scale taken from Depth Pro, UniDepth v2, Depth Anything V2, or ZoeDepth is worse than UniMetric on Abs Rel, δ₁, Chamfer distance, and ATE for both nuScenes and FusionPortable (Table 4). Replacing the joint intervals by the single lowest-weight anchor drops δ₁ from 82.0 to 45.4 on nuScenes and from 52.2 to 18.0 on FusionPortable (Table 5). That is evidence that aggregating several uncertain sizes matters on these sequences.
Critical weaknesses
1.The argument that uncertain semantic intervals are what produces a consistent scale is not isolated. Proposition 1 is the mean-square bound for the sample mean under zero-mean, uncorrelated errors and exact relative heights. The controlled study uses those exact heights, setting hᵢ = q Hᵢ with q = 0.3, so it does not include reconstruction error. In the actual system, repeated frames of the same object enter the sum as separate observations, and category weights α_c appear in Eq. 9 without a definition or a statement of how they were chosen. There is also no comparison to a detector with a fixed nominal height per class, which is the classical version of this idea. Until that baseline exists, the VLM intervals and the convex objective are not shown to be necessary.
2.The headline reductions describe a correction of a bad global unit more than a uniform metric reconstruction, and the alternative is only tested narrowly. Driving δ₁ of 0.0 before correction means almost any plausible scale produces a large relative drop. After correction, VGGT remains at Abs Rel 0.722 on KITTI and 0.866 on DAIR-V2X-I, Scal3R at 0.856 on DAIR, and π³ on KITTI moves only from 0.190 to 0.188. Table 4, the comparison against metric-depth scale donors, covers one model and two of the twelve subsets. The oracle gap on those two subsets is still material (nuScenes Abs Rel 0.152 vs. 0.087; FusionPortable 0.331 vs. 0.219).
Questions for authors
1.On the full MetricBench protocol, how does UniMetric compare with a fixed nominal height per category, using the same masks and support normals, and with the same pipeline driven by a second vision–language model? If the nominal-height variant matches Table 3, I would treat the method as classical object-height scaling and lower the rating.
2.Please define α_c and state whether any of its values, the observation filters, or the choice of partial subsets (Humanoid Everyday and 3EED) were selected using MetricBench numbers. Also state which point inside a nonempty interval intersection is returned, since Eq. 11 is flat on that intersection.
3.Please extend Table 4 to the subsets where the corrected error stays high, at least KITTI and DAIR-V2X-I, for VGGT and π³. If a metric-depth scale is better on those subsets, the suite-level claim should be qualified.
2 comments
Follow-up response, summary of manuscript revisions
To complement our response, we list below the changes in the revised paper that answer your comments. They are marked in blue, and we hope you will have a chance to look at them.
- Added the fixed-prior baseline (Section 4.4, Table 6): replaced the VLM intervals with fixed category intervals, keeping the same masks and support normals.
- Added a second VLM (Section 4.4, Table 5): ran UniMetric with the open-weight Qwen3-VL.
- Extended Table 4 (Section 4.3; Appendix E.1): it now covers VGGT, VGGT-Ω and π³ on five subsets, including KITTI and DAIR-V2X-I.
Response to Reviewer z38S
We thank Reviewer z38S for the precise comments (revisions in blue).
W1 / Q1. On the full MetricBench protocol, how does UniMetric compare with a fixed nominal height per category and with a second VLM?
Thank you for stating this test so clearly. Both comparisons are now in the ablation study of the main text (Sec. 4.4, Tables 5 and 6). The baseline replaces the VLM intervals with fixed category intervals taken from each dataset's own statistics and keeps everything else the same, including the masks and support normals. It is run with VGGT-Ω on one subset from each MetricBench suite, nuScenes and FusionPortable:
The fixed-prior variant does not match UniMetric on either subset. With Qwen3-VL as the second VLM, UniMetric stays above the fixed-prior variant on both subsets.
W1. Proposition 1 and the controlled study assume exact relative heights and uncorrelated errors.
Thank you for pointing this out. You are right that Proposition 1 and the controlled study rest on these assumptions. The MetricBench experiments rely on neither. Every MetricBench result uses heights measured on the GFM reconstruction and counts repeated views separately, and Abs Rel improves in all 108 model–subset pairs. The analysis also extends. If M distinct objects are each seen m times with same-object correlation ρ, the mean-square error is bounded by σ²[1+(m−1)ρ]/(Mm), which still decreases as 1/M. If a measured height is off by a relative error η, the true scale stays inside the anchor's interval as long as H(1+η) stays within the VLM interval.
Q2. How is α_c defined, were its values, the filters or the partial subsets selected using MetricBench numbers, and which point of the intersection is returned?
Thank you for the question. α_c is a predefined category-level weight that reflects how reliable a category is as a scale anchor. Selected categories, such as cars, buses, doors and people, get their own weights from domain knowledge, and all others get the default (Eq. 9, Appendix C.2). The weights were fixed a priori, not tuned on MetricBench. For Humanoid Everyday and the quadruped part of 3EED, we removed repeated recordings of the same task in the same environment and kept 30 of 45 and 8 of 13 sequences. Redundancy was the only criterion. The minimizer is unique unless the intervals share an intersection of positive width (Proposition 2), where every scale has zero objective value. Our golden-section search keeps the right-hand bracket on ties, so it returns the upper end of the intersection.
W2 / Q3. Extend Table 4 to KITTI and DAIR-V2X-I for VGGT and π³; the headline mostly reflects the correction of a bad global unit.
Thank you for this suggestion. Table 4 now covers VGGT, VGGT-Ω and π³ on five subsets, including KITTI and DAIR-V2X-I, against seven other scale sources, with a new paragraph in Sec. 4.3. Abs Rel is below (lower is better, best in bold; Oracle fits the scale to ground truth).
Across the 15 settings, UniMetric is the most accurate in 10 and the second most accurate in two more. You are right that the gain over unscaled outputs mainly comes from fixing the global unit, and Table 4 compares UniMetric with other ways of fixing it.