- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper studies how continuous-time 3D Gaussian models can incorporate newly observed geometric changes after periods without observations. It constructs a controlled Visible–Disappear–Reappear diagnostic using rendered observations, synthetic geometric perturbations, and dense Gaussian-attribute supervision. The model combines a continuous-time latent prior, an image-conditioned reconciliation operator (RoR), and optional typed translation, rotation, and scale residual rates.
Critical strengths
The paper asks a useful diagnostic question and evaluates geometric errors rather than relying only on image quality. It reports negative results and acknowledges the limitations of its controlled setting. The main rotation experiment includes useful component ablations.
Critical weaknesses
- The paper writing and presentation are significantly poor. The text is repetitive and terminology-heavy. It is hard to track the initialization, losses, and trainable components for each experiment..
- No technical contributions. The main causal claim is not fully supported. The results show that decoder fine-tuning helps, but do not establish that limited decoder expressivity is the cause of failure. A frozen decoder may still produce different quaternions when its latent input changes. Moreover, the RoR-only result in Table 5 uses a checkpoint trained with typed residuals, rather than a separately trained RoR-only model.
- The main closed-loop evaluation lacks comparisons with relevant existing methods. Most comparisons are against the authors’ own variants or a static-memory baseline. The open-loop comparisons in Tables 12–13 do not establish the advantage of the proposed reconciliation mechanism. The authors should evaluate relevant prior methods under matched observation and supervision conditions, or explain why they cannot be meaningfully adapted to this setting.
Questions for authors
- What prevents the frozen decoder from producing useful quaternion corrections, beyond difficulty optimizing the latent update?
- Which modules and losses are active in every row of Tables 4–5?
- How does the method compare with simple extrapolation from the same reconciled observations?
Thank you for a critical and precise review. Your three substantive points, the unsupported decoder claim, the RoR-only control and the missing closed-loop comparisons, were correct. We ran the experiments they called for; the general response summarizes the outcome. Point by point:
W2 / Q1 — The decoder-expressivity claim; what prevents the frozen decoder from producing useful quaternion corrections. You were right, and the answer is that nothing does. With the decoder frozen, directly optimizing the latent at each reveal against the ground-truth state (an oracle, 1000 steps) reaches 0.44 rad geodesic error, below static memory (0.55) and below learned RoR (≈0.50). Unfreezing lowers the oracle to 0.21–0.24 rad in all three seeds and the linear residual of the quaternion Jacobian from 0.54 to 0.38 (Appendix H). Both decoders can represent much better states than RoR reaches, so the bottleneck is the latent update, not decoder expressivity. We withdrew the claim. Appendix I adds a related diagnosis: photometric-only training de-calibrates the correction operator itself (anchor error 0.55 → 0.99 rad).
W2 — RoR-only reused a typed checkpoint. We trained an independent RoR-only model (same initialization, epochs and loss, no rate extrapolation; 3 training × 3 injection seeds). It reaches +5.0/+8.7% on fan rotation, better than the learned residual rate (+1.7/+4.7%, Table 5). The typed residual is therefore no longer a contribution.
W3 / Q3 — Comparison with existing methods and with simple extrapolation from the same reconciled observations.
Simple extrapolation from the same anchors: per-Gaussian and rigid CV, correction CV, the RoR rollout and a learned rate all start from the same RoR anchors (Sec. 4.3). RoR+CV is the most accurate state predictor and our state operating point (Table 1). Prior continuous-time predictors under matched observations: latent ODE (ODE-GS style), CfC, GRU and cubic spline, plain and velocity-augmented, trained on the same frozen Stage-1 and split and re-encoded from our RoR anchor at every reveal, so observations and anchors are identical. RoR+CV has a lower mean state error than the best of them on every NVFi scene and occlusion length; the intervals exclude zero on 3 of 6 (Table 3). Ground-truth re-encoding is far better than RoR re-encoding (e.g. latent ODE +53% vs. +8% on bat), so with any of these dynamics models the reveal-time state estimate is the bottleneck (Appendix E). Test-time photometric fitting: a learning-free tracker refits 8 rigid SE(3) parts to each reveal image, close in spirit to Dynamic 3D Gaussians. It renders well but has state error 8–824% above static memory, because single-view rigid fits slide along textureless surfaces (Sec. 5.3). Not adapted: physics-based forecasters (NVFi, FreeGave, TRACE) fit per-scene physical parameters; re-optimizing them photometrically at every reveal amounts to the tracker above (Sec. 2). The open-loop HyperNeRF tables now only check the backbone, and the text says so (Appendix L). W1 — Writing; initialization, losses and trainable components per experiment. We rewrote the paper around one question (what carries closed-loop accuracy) and removed repeated claims. Table 7 lists every trained model with initialization, trainable modules, losses, data and epochs, followed by a terminology paragraph. Sec. 3 defines the protocol and metrics in one place.
Q2 — Active modules and losses in each row of Tables 4–5 (submission). Those tables were replaced. In the revision every trained model is a row of Table 7. The supervision table (Table 14) states in its caption that all rows finetune the same rotation model and differ only in w_state and w_img. The rotation table (Table 5) uses one rotation model, with predictors that are inference-only.
Technical contribution. We accept that the submission's mechanism claims did not survive. What the revision contributes is a closed-loop state estimator whose anchors make simple extrapolation more accurate than published continuous-time predictors given the same observations; a demonstration that the anchor, not the extrapolator, carries the gain; and a protocol with paired no-change controls and intervals showing where image and state metrics disagree. We would be grateful if you would assess the revised paper on these terms.