What RoR Can Write under Privileged Supervision: Decoder Expressivity for Continuous-Time 3D Gaussians
Abstract
Open-loop continuous-time 3D Gaussian extrapolators forecast well under continuous observation, yet under intermittent reveals they still need a correctable write of off-screen geometric change. We run a controlled write-path diagnostic on NVFi Visible–Disappear–Reappear: GT-render reveals, constant-rate hidden change (translation or centroid rotation), and dense 3D attribute supervision—isolating which components of an image-space Reconcile-on-Reobservation (RoR) stack can record the change, not claiming a transferable real-camera world model. A co-evolving latent drift-rate is inert; a frozen translation-only head fails under in-place rotation (fan). Unfreezing the Stage-2 decoder so RoR can express quaternion updates accounts for most of the rotational sign flip vs. an honest static-memory baseline ( RoR-only at occ10 over training seeds); gated typed on-manifold residuals add only a small, seed-sensitive margin at this operating point (typed ), but that margin triples as the hidden rotation grows along either occlusion length or rotation rate ( pp), so the typed channel is operating-point dependent rather than negligible. The same residual family specialized to translation remains useful for relocation ( inj-seed mean on bat @ occ10), and adding the SO(3) channel converts fan's relocation deficit from to , confirming that its residual error there is rotational. Photometric-only finetuning (state weight ) collapses the flip ( at occ10), and freezing the reconcile path localizes that collapse to a single operator while recovering a positive write (); a weak state weight () suffices to learn the write from scratch with no privileged initialization ( vs. for full supervision), so image-only calibration of the reveal reconcile is the specific open problem, not privilege in the attribute signal.
est. 32% chance this paper gets accepted at ICLR 2027.
What do you think this paper will get?
All positions stay anonymous.