- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces VideoPort, a two-stage method for monocular video to streamable auto-regressive generated video, benefits human reconstruction and telepresence. The first stage is 3D human reconstruction. The proposed method recieves a monocular RGB video input, use DINO V3 to extract feature, and trained a reconstruction transformer to predict 3D Gaussian representation of the person. In the second stage, a video to video refine model recieve the coarse renderings from the 3D Gaussian representation and refine it with a causal wan2.2 model fine-tuned with LoRA. The results show that the proposed method achieves better results than exisiting works.
Critical strengths
-
The overall presentation is clear. The paper features a detailed supplementary PDF and a video for results demonstration.
-
The idea of reconstruction with feed-forward model and refine with video model is reasonable. Motivation is clear.
-
Results are sufficient and convincing.
Critical weaknesses
-
I think the main problem of this paper is that the method is not new. People has been doing reconstruction with feed-forward model and refining with video model for a while, including MVSplat 360, and some camera control works like TrajectoryCrafter. The novelty or contribution is questionable.
-
It would be nice to not have the video refinement stage, and the feed-forward model can directly predicts clear 3D human representation, like LHM and LHM++. I wonder what is the performance of stage I alone, and with if we replace stage I with LHM++?
-
The visual results are still blurry, especially for the back of the person. I would expect the video model can fix that. Meanwhile it will be good to enlarge some parts of the image for a clearer visualization.
[1] Chen, Yuedong, et al. "Mvsplat360: Feed-forward 360 scene synthesis from sparse views." Advances in Neural Information Processing Systems 37 (2024): 107064-107086.
[2] Yu, Mark, et al. "Trajectorycrafter: Redirecting camera trajectory for monocular videos via diffusion models." 2025 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE, 2025.
Questions for authors
- Given that Wan 2.2 14B is a MoE model, what issues you have to resolve to make it auto-regressive? I would expect using models like Wan 2.2 5B or Wan 2.1 14B will get similar performance with faster speed.