Real-Time Motion Consistency Rendering in 4D Gaussian Splatting

Novel view synthesis for dynamic scenes is a key challenge in computer vision, due to the complexities of the time dimension and diverse motion patterns. The added dimension in 4D Gaussian distributions complicates their constraints, hindering the rendering of realistic and consistent appearances. To achieve realistic dynamic appearance reconstruction, we introduce Motion 4D Gaussian Splatting (Motion4DGS), a rendering approach that integrates motion consistency regularization into 4DGS. This regularization incorporates both 4D spatial and temporal consistency, leveraging depth and optical flow information. Furthermore, we extend optical flow constraints to continuous unit time intervals, enhancing the consistency of motion appearance without increasing the point cloud size. Motion4DGS excels in rendering dynamic scenes with multiple objects, including those with complex reflective areas. Comprehensive evaluations on both monocular and multi-view datasets show that Motion4DGS achieves real-time performance at high resolutions, surpassing existing methods in both quantitative and qualitative metrics. It provides a notable improvement in quality, all while maintaining comparable rendering speeds and training times to previous approaches.