- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
PhysReflex is a training-free sampler for improving prompt-faithful physical events. At sparse anchors, it steps forward under the target prompt, integrates back under both the target and a physically valid counterfactual prompt, and adds the normalized difference to the latent. An adaptive gate decides whether to repeat. On Wan2.2-A14B, it improves VideoPhy2 semantic alignment by +8.3 / +7.5 points at ~1.5× cost, and also improves on a PhyWorldBench subset.
Critical strengths
-
The idea is simple and fits the problem. Probing how two event conditions respond after a short look-ahead along the target trajectory, with the target's own return as a matched reference, is a clean construction.
-
The baselines are the right mechanism controls. Direct counterfactual guidance and SDG at matched call budgets are exactly what you need to show that the cycle matters. The direction of improvement holds across two judges and two benchmarks.
Critical weaknesses
-
The experiments don't directly test the central claim. The paper is motivated by event-attribute fidelity, but nothing in the evaluation directly measures it. VideoPhy2 SA and PhyWorldBench Content are frame-sampled VLM judgments of general prompt adherence. The authors themselves note (App. L) that a frame-based judge may not reliably measure deceleration rate, and they leave trajectory-sensitive tests of braking rate.
-
The counterfactual prompt c− is an extra input, and the paper does not say who or what wrote it for the VideoPhy2 and PhyWorldBench prompts. App. D lists only the pairing rules, and the only examples given are illustrative (braking, bounce count, impact).
-
The mechanism may reduce to a known baseline. For m = 1, the anchor cancels (App. B, Eq. 12-14) and the update is simply a direct counterfactual contrast evaluated at the one-step-denoised state y and σ_{i+1}. The h² "state-response" term in Eq. 9 is just the effect of evaluating there instead of at the anchor; genuinely path-dependent terms appear only for m > 1, yet m is never reported or ablated. Since the Direct Counterfactual control is evaluated at the anchor (Eq. 7, Sec. 4.2), a "direct contrast at y, no return" baseline and an m sweep are needed to show that the return path adds anything.
Questions for authors
- Can you evaluate the central claim directly? For example, for a set of prompts with a measurable attribute (braking rate, bounce count, impact strength), generate from the same seed with (c+, c−) and with the swapped pair (c−, c+). Then check whether the outputs actually separate along the attribute.
- How did you write c− for the benchmark prompts? How many pairs were rejected under the App. D rules?
- Value of m and the return path. What value of m is used in the reported experiments?
- Please report the values of the anchor set A, η, τ and B, and the distribution of accepted cycles per sample. How does PhysReflex compare with a fixed number of cycles and no gate?