- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents DreamCloth, which uses a pretrained video model to fit cloth simulation parameters from multi-view images. It combines guidance from four rendered scene variants to emphasize the interaction between clothing and body motion. Experiments show improvements over direct video-model guidance, but the physical accuracy of the estimated parameters and reliability across repeated runs need stronger validation.
Critical strengths
-
The proposed four-point interaction contrast constructs model guidance without requiring the video model to internally separate appearance and motion.
-
The paper distinguishes accurate simulated motion from correct material recovery. The gradient checks, parameter-boundary analysis, and optimization landscape study in Sec. 4.3 show that accurate cloth motion does not necessarily mean the recovered material parameters are correct.
Critical weaknesses
-
It is unclear how much of the remaining guidance describes cloth physics. The subtraction correctly removes the individual effects defined by the four rendered clips. However, the remaining signal may still reflect the video model’s visual preferences. For example, it might favor a wrinkle pattern because that pattern is common in training videos. The improved geometric accuracy shows that the combined guidance helps, but does not fully explain why it helps. I suggest conducting a controlled test that changes only texture or lighting to measure how much unwanted appearance influence remains.
-
The experiments do not show whether the improvements are reliable across repeated runs. Each sequence is optimized only once and the results may depend on the starting material values and the random noise used during optimization. The existing 25-run experiment uses a different geometric objective, so it does not test FSD’s reliability. I suggest repeating the full FSD optimization several times for each sequence, with different random seeds and starting material values.
Questions for authors
How stable are the held-out results and fitted parameters across repeated full-FSD runs? Please report variation and boundary-hit rates, and extend the fourth-corner ablation beyond s190.
Thank you for a constructive review. You asked for the two experiments we were most worried about. The revision adds one of them in full and part of the other. New text in the revised PDF is in blue.
Are the results stable across repeated runs?
We repeated the full optimization five times on s190, changing the initialization, the sampled timesteps and the noise draws, for three objectives with the same optimizer (new Table 3):
Under FSD the stiffness is the least stable parameter (coefficient of variation about 55%), while density and thickness move much less (about 13% and 10%). We don't think this is the optimizer misbehaving. The 25-start landscape study (Table 4) shows a long valley on s190 along which density and stiffness trade off with almost no change in the rollout, and the seeds spread along that valley. The supervision simply does not pin down that direction, and Section 4.3 says so.
Thickness is where the objectives differ. The CFG-style score drifts toward the lower bound (0.837 ± 0.047), below the range that FSD stays in.
We do not yet have held-out error across seeds, or boundary-hit rates, for every sequence. Those runs are not finished, and we would rather add them to the camera-ready than post partial numbers.
The fourth-corner ablation beyond s190
Table 2 now covers three 4D-DRESS sequences with matched runs. Removing the static garment-free render makes the held-out error worse on all three:
Without the fourth render, the residual of the static body, including its share of the noise, stays in the objective (Section 3.6), and these runs show that it hurts in practice. They are single-seed runs that end on a box constraint, so they compare objectives rather than recovered materials.
Is the remaining signal still partly appearance?
It can be, and your wrinkle example is exactly the right worry. The four renders cancel the effect of appearance on its own and of body motion on its own. A learned preference for certain wrinkle patterns on moving cloth belongs to the garment–motion interaction, so it survives. Section 3.6 states this, and the paper's claims rest on held-out behavior rather than on the signal being purely physical.
The sign-agreement check in Table S1 helps only a little. The FSD update points the same way as the update from an appearance-free geometric supervisor 68 to 77% of the time, depending on the video model, but that says nothing about how much appearance leaks in.
Your proposed control is the direct test: change only the texture or the lighting, identically in all four renders, and measure how much the score and the fitted parameters move. It is not in this revision. The Conclusion lists it among the next experiments, and we will include it in the camera-ready.
Physical accuracy
The revision now states explicitly that we do not claim to recover the physical parameters exactly; we report parameters that reproduce held-out motion. Section 4.3 shows where 25 runs of an auxiliary geometric optimizer agree (s170 and s185) and where they do not (s190 spreads along the valley, and s191 sits on a bound). A test on synthetic cloth with known parameters is the direct check, and we list it as future work.