- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Triangular Resampling (TR), a post-training method for reducing error accumulation in long-horizon motion generation. It replays FloodDiffusion’s triangular denoising trajectory, including partially denoised states, and uses a shared random threshold to control the transition from noise-matched ground-truth anchoring to model-generated states.
Critical strengths
- The method is relatively simple, and its description is generally clear. The equations and illustrations make the replay and clamping procedures understandable.
- Supervised TR provides a substantial improvement over the matched TR-off baseline.
- The paper includes useful ablations and transparently acknowledges several limitations, including the lack of additional FID improvement from DMD over its supervised initialization.
Critical weaknesses
-
Limited methodological novelty. Rollout-based training is already an established idea. Although TR combines rollout-based training with ground-truth anchoring, its contribution appears to be a relatively incremental adaptation to FloodDiffusion. The experiments emphasize parameter selection more than establishing broader insights.
-
Hyperparameter sensitivity. Several settings of in Table 2 yield worse FID AUC than TR-off, suggesting that achieving gains with the method requires careful hyperparameter tuning.
-
Limited evidence of generality. The method is closely tied to triangular denoising and is evaluated only on FloodDiffusion. Its effectiveness across other backbones or denoising schedules remains unverified, limiting the evidence for a broadly applicable contribution.
-
Unconvincing overall benefit of TR-DMD. Rolling Forcing outperforms TR-DMD on five of the six metrics in Table 1. TR-DMD’s sole advantage, FID AUC, is small (1.324 versus 1.351), with overlapping confidence intervals. This raises concerns about whether TR offers a sufficiently compelling benefit when combined with DMD.
Questions for authors
-
What motivates applying GT anchoring at high noise levels and retaining model rollouts at low noise levels? Could the authors compare this with a reversed allocation, or with randomly selecting a matched number of clamping steps within each token’s denoising trajectory? The latter differs from Random-position clamping, which matches the clamp count across positions at each Euler step.
-
Why is the release threshold stochastic rather than deterministic? The shift sweep changes the threshold distribution but does not isolate the benefit of randomness. A fixed-threshold comparison with matched average clamping strength would clarify this choice.
-
Although Table 2’s caption explains the convention, boldfacing an entire row can suggest that every metric in that row is optimal. Shading the selected row and reserving boldface for column-wise best values would be clearer.
3 comments
[Q1]
Our design is based on the following assumption: at high noise levels, the input contains less discernible motion information, and relying on model rollouts too early may cause the generated trajectory to deviate from the paired ground truth, weakening the consistency between the training states and the supervision targets. We therefore use GT anchoring matched to the current noise level at this stage to limit excessive drift and provide a stable supervision reference for subsequent learning. As denoising progresses, the prescribed diffusion noise gradually decreases. Retaining model rollouts at this point allows the training states to incorporate prediction errors generated and accumulated by the model itself, building on the foundation provided by GT anchoring at earlier stages. The model thereby learns to continue denoising from states containing its own prediction errors, better handling the inputs actually encountered during inference and mitigating the distributional gap between training and inference. This design thus aims to balance reliable supervision with sufficient exposure to model errors: GT anchoring at high noise levels maintains the supervision reference, while model rollouts at low noise levels allow the model to learn to correct its own errors.
[Q2]
The rationale for using a random release threshold is to expose the model during training to different release timings and subsequent rollout lengths. At the same time, a single threshold is shared within each replay to maintain a continuous release boundary. To examine the role of the release structure, we have included a random-position clamping control in Table 2. This control uses the same and maintains exactly the same number of clamped positions as TR at every Euler step, while randomly reassigning which positions are clamped. Compared with this control, TR (the third row) reduces FID AUC from 1.857 to 1.251, supporting the advantage of a continuous release structure when the number of clamped positions is matched.
[Q3]
As stated in the Evaluation Protocol, we use FID AUC as the primary criterion for evaluating overall generation quality and selecting configurations. The other metrics provide complementary information about text alignment and performance trends over time. Therefore, bolding entire rows in Table 2 was intended to identify the configuration selected by FID AUC within each group, rather than to imply that the configuration is optimal across all metrics. We agree that bolding entire rows may cause confusion. We have revised Tables 1 and 2 (pp. 7 and 9) and their captions. Background shading identifies the row with the lowest FID AUC in each group, while boldface and underlining indicate the best and second-best means, respectively, in each metric column within that group, including ties.
Thanks for the response. My main concerns remain, so I stand by my original assessment.
-
I still see TR as an incremental improvement to FloodDiffusion. The proposed extension to a single chunk is unconvincing. In that setup, all latents in the window share the same denoising progress. The original method uses different denoising levels within the window to decide which tokens to anchor to ground truth and which to leave to the model rollout.
-
Q1 and Q2 still lack the requested experiments on when to apply ground-truth anchoring and whether a random release threshold helps.
-
The authors also acknowledge that TR is sensitive to the threshold and that TR-DMD’s advantage over Rolling Forcing is inconclusive.
We thank Reviewer 4qeE for their careful review and helpful suggestions. Our responses are provided below.
[W1/W2]
Our contribution lies in identifying and addressing the state mismatch within the active window of triangular denoising, extending model replay to partially denoised states, and controlling their deviation through progressively released ground-truth (GT) anchoring. Table 2 shows both the effects of the parameters and the limits of the mechanism: fully self-generated rollouts substantially degrade performance, whereas moderate anchoring restores generation quality. We acknowledge the sensitivity to the threshold. At the same time, with s=0.6 fixed, all three tested replay ratios outperform TR-off, indicating that the gains are not confined to a single ratio. Compared with the matched baseline, our main configuration reduces FID AUC and the degradation slope by 40.9% and 55.3%, respectively, demonstrating the effectiveness of our method.
[W3]
This paper focuses on the training–inference mismatch in triangular denoising, as explicitly stated in the second paragraph of the Introduction. Specifically, TR addresses model prediction errors accumulated in partially denoised states within the window. With the same backbone, initialization, and 30,000 post-training updates, TR reduces FID AUC by 40.9% relative to the baseline without TR, supporting its effectiveness in the current setting. The schedule construction also offers a natural route to extending the method to chunk-based diffusion: the generation unit can be expanded from a single latent to a chunk, with all latents within a chunk sharing the same denoising progress. When the active denoising window contains only one chunk, this schedule corresponds to an autoregressive diffusion process that completes denoising one chunk at a time. Thus, TR's trajectory replay and ground-truth clamping could potentially be extended to this setting, although their effectiveness would still require experimental validation. We have explicitly identified extensions to other backbones and denoising schedules as future work in the Conclusions, and we thank the reviewer for highlighting this important direction.
[W4]
TR-DMD is an extension introduced to enable comparisons with DMD-based methods and verify compatibility. We agree that its gap over Rolling Forcing is insufficient to establish a significant advantage, and that there are differences in initialization and chunking (please refer to our response to Reviewer 5cQG’s Q1 for details). Supervised TR still achieves the best FID AUC, reducing it by 14.7% relative to Rolling Forcing, and receives higher ratings for motion quality and text alignment in the blind evaluation. We have expanded the discussion in Section 5.2 (p. 8) to explicitly acknowledge the small FID AUC gap and overlapping confidence intervals, as well as Rolling Forcing’s stronger results on the other five reported metrics. The revised discussion distinguishes motion distribution fidelity from text alignment and temporal degradation.