- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper analyzes low-rank test-time optimization for zero-shot depth completion after analytically eliminating scale-and-shift alignment. It shows that the objective is a variance-scaled correlation criterion, that standard zero initialization is degenerate, and that sparse measurements leave a large set of minimizers. Two complementary remedies follow: Semiparametric Residual Propagation selects a function-space correction through constrained graph-harmonic interpolation plus a parametric depth term, and Spectral Warm Start computes a rank-r descent initialization and amplitude. Across five benchmarks and two backbones, SRP without adaptation is 30-40x faster than 40-step LoRA-TTO, while SWS+SRP at 10 steps matches or improves the 40-step baseline on every reported metric and benchmark.
Critical strengths
- The analysis identifies precise structural causes of slow and unstable test-time adaptation and leads directly to two targeted algorithms. The paper then tests several falsifiable consequences, including negative results for optimization and parameter-space regularization interventions.
- The empirical study is unusually comprehensive and reproducible: five benchmarks, all 6,479 evaluation images, repeated stochastic baselines, paired statistics, consistent timing, transfer to a second backbone, strong ablations, and a substantial code supplement. The resulting accuracy-latency frontier is practically important.
Critical weaknesses
- The empirical comparison is centered on LoRA-TTO and TestPromptDC; diffusion-based and supervised completion methods are not run under the same protocol. This limits claims about the broader state of the art, although it does not undermine the main within-family conclusions.
- The method still relies on the affinity graph and measurement pattern. The paper documents weaker behavior for the adaptation-free point on RMSE and for biased VOID measurements, so deployment outside the evaluated sparsity regimes remains uncertain.
Questions for authors
- How sensitive are SRP and the 10-step operating point to substantially different measurement densities and structured missingness beyond the five benchmark protocols? Please report or discuss failure thresholds.
- Can the authors clarify which conclusions require the locally submersive adapter assumption and whether any evaluated samples materially violate it? A concise summary of diagnostic failures would strengthen the theoretical-to-empirical link.
4 comments
Results: density and structured missingness (Q1)
Thank you again. The sweep we fixed in advance is complete on 100 NYUv2 and 100 KITTI held-out images. Values are MAE / RMSE relative to 40-step LoRA-TTO on the same images and thinned measurements (below 1 is better). In the sweep the baseline is a single seed (seed 0); on the full NYUv2 split its seed-to-seed standard deviation is 2.4% of MAE (Tab. 13). In short, the 10-step configuration stays within 4% of the baseline in every setting and never falls behind on KITTI in MAE, and SRP alone keeps its MAE lead on KITTI down to a tenth of the points.
Failure thresholds, 10-step configuration. On NYUv2 it first falls behind at 95 measured pixels (1.017 / 1.003), a gap smaller than the baseline's seed spread; it is never more than 2% behind at any density and leads at the sparsest setting (10 pixels: 0.960 / 0.971). On KITTI it never falls behind, down to 2% of the points (334) or a single scan line (377 points; 0.820 / 0.847). The 40-step configuration leads at every density and line count on both.
Failure thresholds, SRP alone. The adaptation-free point keeps its MAE lead on KITTI down to 10% of the points (1,665) or 16 lines, and falls behind at sparser settings except a single line; on NYUv2 it is level at full density (0.992) and falls behind as points thin (1.119 at 10 points). This is the regime the 10 adaptation steps cover.
Structured missingness (MAE ratio of the 10-step configuration):
| Pattern | left half | central box | farthest 25% | farthest 50% |
|---|---|---|---|---|
| NYUv2 | 1.038 | 0.997 | 1.008 | 0.942 |
| KITTI | 0.962 | 0.945 | 0.814 | 0.780 |
On KITTI the RMSE ratio is above 1 only with the left half removed (1.004). On NYUv2 the left-half pattern leaves half the image with no measurement at all; there the 10-step configuration is 3.8% behind and the 40-step one 1.1%. SRP alone trails under all eight structured patterns.
Revision 2, which we will upload by November 13, adds the full table, with every density, pattern and configuration, to a new appendix, and a summary with one figure to Sec. 5.2.
W1. The Marigold-DC results on the full splits, and its 10-sample ensemble, are in our reply to htJo.
Thank you for your response. It has addressed my concerns. After some consideration, I decide to keep my original rating unchanged.
Thank you
Thank you for reading our responses and for letting us know that they address your concerns. We appreciate your careful review.
Response to Reviewer pvbf
Thank you for the careful review and for recognizing the falsifiable predictions and the reproducibility effort. Changes are in Revision 1 (blue).
W1. Other method families. Revision 1 scopes our claims to training-free completion (Sec. 1, 5.2, 5.3); supervised completion needs paired training data. For diffusion priors, Marigold-DC is running under our protocol on all 6,479 images; on a subset fixed in advance it already trails our 10-step configuration in all ten cells (table in our reply to htJo).
W2/Q1. Density and structured missingness. The weaker RMSE of the adaptation-free point is addressed in our reply to hzPS (W2); the 10-step point matches or beats the baseline on both metrics on every benchmark. On density, the evaluated range already spans 82 to 18,966 measured pixels, and over the core benchmarks the gain tracks the baseline's error (Spearman −0.50) more than density (+0.34) (App. D). To find failure thresholds, we fixed a sweep before seeing any result: on 100 NYUv2 and 100 KITTI held-out images, nested thinning to 50–2% of the measurements, KITTI scan lines down to one (as in Seo et al., 2026), and removal of the left half, a central box, or the farthest 25–50% of points. We will report error relative to the baseline against the measurement count, with the threshold where the 10-step configuration first falls behind (App. D, Revision 2).
Q2. Submersion hypothesis. Only the exact dimension count of Prop. A.5 uses it; the closed form, (C1)–(C3), SWS and SRP (Prop. A.6–A.8) do not. Without it, the "≥95% free" statement still holds to first order, since the Jacobian has rank at most m. No sampled block showed a rank drop: on the 50-image diagnostic subset, at three points of the run, 150 of 150 random 64-row blocks are full rank (App. E). Sec. 3.2 now states this.