- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes PhysRect, which corrects a frozen Wan2.2 generator's text embeddings before sampling. Embeddings fitted to real physical events are distilled into seven mechanism experts gated by a VLM.
Critical strengths
Mean physics error decreases from 1.431 to 0.705 on VideoPhy-2. Supervision comes from real events, and the correction avoids additional operations at each sampling step.
Critical weaknesses
- The benefit of selecting experts is not established. The paper does not directly compare selecting experts with averaging all seven outputs. If each expert improves a different aspect of physical consistency, the paper needs to explain why all experts should not be used together. Table 2 compares against a smaller single network, which changes both the architecture and capacity. This does not show why selecting experts is necessary.
- The choice of correction strength is insufficiently documented. Figure 6 evaluates alpha on the test prompts and reports the best result at 0.5, also used in Table 1. The paper does not explain whether this value was fixed on independent validation data, leaving possible use of test feedback unresolved.
- The cost and necessity of Gemini are unclear. Table 1 does not specify whether timing includes a Gemini call for each new prompt or uses precomputed labels. The full inference cost is therefore unclear. There is also no comparison with a standard open-source VLM to justify this dependency.
Questions for authors
- Does selecting experts outperform averaging all seven outputs under the same settings?
- Was alpha=0.5 selected on independent validation data before evaluating the test prompts?
- Does runtime include Gemini for a new prompt? Can an open-source VLM replace it for mechanism labeling, and how does this affect video quality, latency, and cost?
2 comments
Thanks for the response and the new experiments. My main concerns about the capacity-matched baseline, α validation, and the Gemini dependency are mostly addressed, so I'm glad to raise my score.
W1 / Q1: Selecting experts vs. averaging all seven
Selecting vs. averaging. On VideoPhy-2, averaging all seven experts with equal weights and selecting them by ℓ(y) differ by only 0.04. VideoPhy-2 prompts usually involve several mechanisms (3.1 on average), so the selected experts and the full set give close corrections. To isolate the effect of selection, we took 105 held-out VideoPhy-2 prompts, disjoint from the test captions, whose labels have a single primary mechanism, 15 per mechanism. On these prompts, selection is ahead of averaging by 0.105:
Capacity. The gain does not come from the added parameters. A single network without mechanism labels, widened to 73.2M parameters to match the mixture's 73.5M and trained on the same fits, reaches 57% of the gain, and its error is higher than ours by 0.236:
W2 / Q2: Was α=0.5 selected on independent data?
In the paper, α was chosen from the sweep in Fig. 6a, which uses the test prompts. We have now repeated the sweep on a separate validation set of 300 prompts, drawn from the VideoPhy-2 training split and disjoint from the test captions:
The gain is robust to α, the difference between α=0.25 and 0.5 is within noise (0.088 [−0.081, 0.255]), and larger values are worse. We will describe this protocol in Sec. 4.1.
W3 / Q3: Cost and necessity of Gemini
The label is read from the prompt text alone during inference: one text-only call per prompt, made once before sampling, with no effect on the cost per denoising step. With Gemini 3 Flash it takes 1.31 s and $0.00049 per prompt on average. The 38.3 s in Table 1 does not include it, since labels are computed before sampling. Adding it gives 39.6 s per video against 38.9 s for the uncorrected backbone, 0.7 s (1.8%) more.
Open-source labeller. Gemini can be replaced by a local open-source model without retraining and without loss. We relabelled the 591 test prompts with Qwen3-VL-8B-Instruct, with the same instruction, and regenerated them with the same experts:
The two differ by 0.003 [−0.102, 0.106], and Qwen3-VL-8B gives the same primary mechanism as Gemini on 97% of the prompts.