- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes a LoRA-adapted Wan2.2-TI2V-5B video DiT that re-renders a monocular video under a new camera trajectory while switching a user-selected in-scene light emitter on/off and changing its colour/intensity (plus a global ambient scalar). The model is trained on a new 134K-clip UE5 synthetic dataset. It claims to be the first joint camera + spatially-varying local-light controller and beats adapted baselines on all three sub-tasks. The engineering is solid and the depth-vs-RGB warping insight is well evidenced, but the comparisons are stacked: the closest parametric-relighting methods are cited and not run, and no metric measures lighting-control accuracy on real video.
Critical strengths
- Clear, well-motivated design choice. The paper uses warped depth + occlusion mask instead of warped RGB, so source shading cannot be copied. Table 4 isolates it (16.29 → 21.76 PSNR) and Figs. 14–15 show the ghosting failure modes of RGB warping.
- Emitter-bound parametric control is a practical UI and handles light on/off, chromatic changes, multi-light and zero-shot OOD emitters such as monitors/windows.
- OVI is a well-engineered synthetic pipeline. Using path-traced stream decomposition with linear compositing (Eq. 8), sequence-level tone mapping, 12 trajectory primitives, procedural placement rules.
- Evaluation spans three decomposed tasks with synthetic GT metrics plus real-video proxies.
- The limitations of the proposed method is discussed extensively, with no photometric accuracy, no off-screen emitters, no 360° orbits, floaters from bad depth.
Critical weaknesses
- Closest parametric-relighting prior work is cited but never compared. RelightMaster (Bian et al., 2025) and LiveLight (Ma et al., 2026) already relight video with point lights of controllable 3D signals, multiple and moving lights, UE5 training data, and a depth-aligned light-image adapter injected into a DiT with LoRA, i.e. nearly the same lighting-conditioning recipe. The paper dismisses them in one sentence (Sec. 2.1: "does not explicitly encode fixture geometry") and excludes them even from Task 2, comparing instead against text-driven global relighting models.
- Architectural novelty is a recombination of three cited systems. DWMesh warping is EX-4D, frame-wise source concatenation is ReCamMaster, the compositing recipe is LightLab, the adapter is RelightMaster-like. The only delta is depth-instead-of-RGB warping plus light masks, which is kind of incremental.
- Synthetic benchmark is in-domain for LumiLens only. The held-out set comes from the same UE5 pipeline, asset library and renderer as training, although whether the assets used are unseen is not stated.
- Train/test gap in the conditioning signal is unaddressed. Training uses UE5 ground-truth depth, visibility and emitter masks. At inference time, it uses DepthCrafter + DA3 + SAM 3, while whether noise or augmentation is applied in training is not stated.
- The evaluation set is small, with synthetic held-out ≈ 80 clips and 100 in-the-wild clips without per-source breakdown.
Questions for authors
Besides the above weaknesses, I have the following questions for the authors:
- Why are RelightMaster and LiveLight not compared on Task 2? What does the emitter-mask proxy encode that a depth-aligned light image does not, given both are per-frame mask-like maps?
- Exactly how were color/intensity targets converted into prompts or reference images for Light-X, V-RGBX, RelightVid and IC-Light? Were outputs resized to a common resolution before computing metrics on PSNR/VBench?
- Please provide Task 3 results for Models B/C.
- User study: how many pairwise comparisons per participant, what was the "hard to judge" rate, and were participants shown the parametric target or only the baseline's prompt?