- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents Triplex4DGS, a two-stage 4D Gaussian reconstruction framework for Tianmou's complementary vision sensor (CVS), which is used for high-speed dynamic scene reconstruction. Tianmou simultaneously provides approximately 30 FPS of RGB observations and 757 FPS of TD/SD differential signals.
Critical strengths
High-speed dynamic 4D reconstruction is limited by the RGB frame rate, and event cameras require additional RGB and calibration. Tianmu's RGB + TD/SD synchronous observation provides a potential alternative solution. The paper introduces CVS into 4DGS, which has good exploration value.
Critical weaknesses
(1) The paper mainly compares RGB-only 4DGS and event-based E-D3DGS. The RGB-only baseline cannot utilize TD/SD, so the comparison can only indicate that "the additional high-frequency signals are useful", but it cannot demonstrate that "the proposed simulator and two-stage strategy are the best way to utilize TD/SD". (2) Under high-speed movement, sparse viewpoints, and 30 FPS RGB, the pose estimation of COLMAP may be unstable. The synchronization accuracy between cameras, can also affect 4D reconstruction. (3) How does the model address the issues of minor artifacts and temporal fluctuations?
Questions for authors
See the weakness section.
2 comments
Follow-up on Our Rebuttal Responses.
Dear Reviewer btT1,
We sincerely appreciate your time and effort in reviewing our paper and providing valuable feedback.
As the discussion deadline approaches, we would be grateful if you could review our responses and share any further feedback. Please let us know if you have any remaining concerns or questions. We would be happy to provide additional clarification.
Thank you again for your time and consideration.
Best regards,
The Authors
We thank the reviewer for the constructive comments. We address each concern below and highlight the corresponding revisions in the updated manuscript.
W1: We thank the reviewer for this important comment. We agree that additional comparative experiments help demonstrate the effectiveness of our method. Our experiments have already considered two intuitive TD/SD integration strategies:
(1) two-stage reconstruction (2D reconstruction followed by 4DGS). We include CBRDM + 4DGaussians, which first reconstructs intermediate 2D images from RGB and TD/SD signals and then uses them to supervise 4DGaussians. In contrast, our method directly supervises dynamic Gaussians through a differentiable TD/SD simulator, achieving better reconstruction quality on synthetic data. CBRDM requires approximately 26 h 32 min for 2D preprocessing alone, whereas our method completes the entire 4D reconstruction in 1 h 49 min, reducing runtime by 93.2%. The former excludes subsequent 4DGaussians training, further highlighting our efficiency advantage.
(2) Direct joint optimization. We compare direct joint training with our two-stage progressive optimization in the appendix. Both use the same dynamic representation and TD/SD supervision, differing mainly in the optimization procedure. Our strategy reduces Gaussian primitives from 333,069 to 128,676 and model size from 78.78 MB to 30.43 MB, representing approximately 61.4% reductions in both metrics.
These comparisons demonstrate the advantages of our framework in reconstruction quality, computational efficiency, and model compactness under our experimental settings.
W2: We agree that camera pose errors and temporal misalignment may affect high-speed 4D reconstruction. However, these issues mainly concern data acquisition and preprocessing rather than inherent limitations of TD/SD supervision.
Our sparse-view setup is constrained by the available camera number and aims to validate practical feasibility rather than deliberately simulate extreme sparsity. Similar limited-camera settings are common in previous high-speed reconstruction studies [1–3]. We acknowledge that motion blur may degrade COLMAP feature matching and pose estimation. Recent CVS studies demonstrate TD/SD-assisted motion deblurring [4] and extreme high-speed reconstruction [5]. Integrating these techniques could provide clearer RGB images, improving pose estimation and subsequent reconstruction. We discuss this in the appendix’s Limitations section.
For temporal synchronization, we use a flashing light as a common reference and align its recorded responses across cameras, controlling inter-camera TD/SD alignment errors within 1 ms (1/2 TD/SD sampling interval). Details are provided in the appendix section Multi-Camera Temporal Synchronization.
W3: The artifacts and temporal fluctuations discussed in our paper mainly concern pipelines that reconstruct intermediate 2D images before 4DGS optimization.
Learning-based 2D reconstruction may introduce texture artifacts, brightness deviations, and inconsistencies across independently reconstructed frames due to the lack of unified 3D constraints. When these images supervise 4DGS, their errors may propagate into the dynamic scene representation, causing temporal discontinuities or flickering.
In contrast, our method directly optimizes a unified dynamic Gaussian representation using RGB and TD/SD observations. Renderings across timestamps share scene parameters and continuous temporal modeling, providing consistent spatiotemporal constraints rather than relying on independently reconstructed 2D frames. This helps maintain structural and appearance consistency while avoiding error propagation from intermediate 2D reconstruction.
Thus, instead of introducing an additional artifact removal module, our method mitigates these potential artifacts and temporal fluctuations through direct, unified 4DGS optimization.
Refrence:
[1] BulletTime4D: Towards High Spatio-Temporal Resolution Dynamic Scene Rendering via Spike-Guided Stereo Vision[C]//Proceedings of the AAAI Conference on Artificial Intelligence. 2026, 40(4): 2743-2751.
[2] Spike4DGS: Towards High-Speed Dynamic Scene Rendering with 4D Gaussian Splatting via a Spike Camera Array[J]. Advances in Neural Information Processing Systems, 2026, 38: 28707-28727.
[3] E-4dgs: High-fidelity dynamic reconstruction from the multi-view event cameras[C]//Proceedings of the 33rd ACM International Conference on Multimedia. 2025: 7356-7365.
[4] Spatio-Temporal Difference Guided Motion Deblurring with the Complementary Vision Sensor[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2026: 37496-37506.
[5] Diffusion-based extreme high-speed scenes reconstruction with the complementary vision sensor[C]//2025 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE, 2025: 5701-5710.