- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper proposes Motion-Adaptive Token Allocation, which reallocates spatial representation capacity according to motion demand, assigning denser representations to motion-intensive regions while compressing redundant tokens in low-motion regions. The paper also designs a method for restoring compressed regions and a refinement strategy that disables compression late in denoising. The paper presents quantitative and qualitative comparisons on HyperMotionX using 5B and 14B models. It also analyzes performance across motion difficulty levels, conducts module ablations, and reports computational costs.
Critical strengths
The method solves a meaningful problem and has a complete design. Regions with complex human motion and static regions may need different representation densities. This paper combines local enrichment, compression of other regions, and output restoration. This provides a concrete approach to improving human animation under a limited computational budget.
Critical weaknesses
The added value of the allocation strategy is not fully established. There has been prior work that explored content-adaptive or motion-adaptive token allocation, but this paper seems to provide no direct comparison with these methods. Also, as the paper illustrated, motion-guided allocation achieves similar PCK to random allocation. It improves FVD and VFID but shows no additional benefit in pose accuracy.
Questions for authors
For the random-region baseline in Table 2, did you repeat the evaluation with different randomly selected regions?
2 comments
Thank you for the additional experiments. The matched-training comparison and repeated random allocations substantially address my concern. The new results also show modest gains in pose accuracy. I lean toward accepting this paper.
Reviewer FsEu
We thank the reviewer for asking how MATA compares with ADAPTOR and how sensitive the random-allocation baseline is to the choice of regions.
Response to W1: Comparison with ADAPTOR
MATA’s main contribution is the redistribution of a constrained token budget according to motion demand. ADAPTOR targets acceleration and retains the original token resolution in selected regions. MATA uses pose cues to sample regions with complex articulation more finely than the original patch grid. Compression in low-motion regions offsets the cost of this enrichment, keeping main-DiT FLOPs within 1.29% of the original 5B backbone.
A direct comparison may require adapting ADAPTOR to keep its token selection aligned with the pose-conditioning features in our animation pipeline. We will aim to complete the evaluation before the discussion deadline and share the quality and compute results in a follow-up if they are ready in time.
Response to Q1: Sensitivity to random region allocation
In Table 2, we applied random placement only at inference to a checkpoint trained with motion guidance. For the new comparison, we trained two enrichment-only models from the same Stage-1 checkpoint. One used random placement throughout training and inference, and the other used motion-guided placement throughout. Both received 9,794 Stage-2 updates with identical trainable modules and matched per-frame token counts.
To isolate the effect of which regions are selected, we fixed the generation seed at 0 for all runs on the same 100 videos. For the trained random baseline, we varied only the inference-time allocation seed (0–4) and report the mean ± sample standard deviation across those five runs. Motion-guided placement determines the regions from the input pose sequence, so its row reports a single result at the same generation seed.
At this generation seed, mean per-video FVD ranged from 886.76 to 900.44 across the five random allocations, compared with 863.15 for motion-guided placement.
We separately tested sensitivity to generation sampling by fixing the random allocation seed at 0 and varying the generation seed (0–2) for both methods. Motion guidance reduced Global FVD by 7.09, 5.40, and 3.04, respectively. PCK increased by 0.72 and 0.36 percentage points at the first two seeds and was essentially unchanged at the third.