- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes TimePrune, a training-free ALLM token compression framework that preserves temporal representation trajectories through adaptive temporal resolution. TimePrune comprises two token selection mechanisms: Time-Aware RDP preserving trajectory fidelity and temporal covarage refinement that maintains temporal coverage. Experiments show that TimePrune maintains competitive performance on downstream tasks under aggressive retention ratios of 10%~15%.
Critical strengths
- The experiment covers four ALLMs with different audio encoder families tested under multiple retention rates on different benchmarks. Sometimes the relative scores exceed the unpruned model's, demonstating the effectiveness of the proposed method.
- The paper includes practical inference measurements that account for compression overhead rather than reporting theoretical FLOPs alone.
Critical weaknesses
- TimePrune is built upon a vital assumption: Token compression methods achieve higher downstream performance with better temporal trajectory preservation. While this assumption is partly supported by experiment results in Table 1~4, but a rigorous correlation or causal analysis is absent.
- Performance gain over baselines is marginal, especially on individual benchmarks.
Questions for authors
- I have a few questions on terminology:
1a. What is the definition of temporal representation trajectory?
1b. What is the trajectory-driven refinement? Does it mean Time-Aware RDP?
1c. What is the region in eq. 2? How many tokens are in each region, and how are region boundaries set?
- How do Observation 1 and 2 motivate your method?
2a. Observation 1 shows that Time-Aware RDP trades temporal coverage for trajectory fidelity, but does higher temporal coverage guarantees better downstream accuracy under fixed compression ratio? If this is an assumption, it should be stated and explained explicitly; if it is a claim, it needs experimental support.
2b. Observation 2 finds that trajectory-driven refinement naturally produces adaptive temporal resolution, but it remains unclear whether adaptive temporal resolution improves accuracy under fixed compression ratio. The paper should theoretically explain or empirically test how adaptive temporal resolution influences downstream performance after token compression.
A minor suggestion is to include a limitation section in your paper.
2 comments
Thanks a lot for clarifying your motivation and terminology, which helps me properly understand your work. I now understand the contribution of TimePrune as a novel method to achieve better fidelity-coverage trade-off. The revised manuscript is now clearer and easier to follow. Therefore, I would like to raise my score.
We thank the reviewer for the constructive feedback. We have clarified the motivation, added analyses linking our observations to downstream performance, and included a limitations section. References are to the revised PDF (changes in blue).
W1 / Q2. Is the link between trajectory preservation and accuracy an assumption or a tested claim?
It is a design hypothesis that we now state explicitly and test. We do not assume that higher fidelity or higher coverage alone improves accuracy (Sec. 3.3); the hypothesis is that the two matter jointly. This relationship is a trade-off with an interior optimum, which is the premise of TimePrune: on all four ALLMs, accuracy peaks at intermediate coverage (β=2 or 3), not at maximal fidelity (β=∞) or at the strongest coverage evaluated (β=1). A single correlation coefficient across heterogeneous methods cannot capture such a trade-off, so we use controlled interventions under a fixed token budget, changing one factor while holding the others fixed.
Q2a (Observation 1, coverage). Varying only β (Table 3; Qwen2.5, 90% pruning), β=2 lowers Avg. TGR from 6.200 to 2.500 and raises Avg. Score from 46.4 to 48.7. β=1 leaves TGR unchanged (2.499) but lowers the score to 48.1. So stronger coverage does not guarantee higher accuracy, but removing excessive gaps helps. Coverage refinement improves Avg. Score over Time-Aware RDP on all four ALLMs: +3.6, +2.4, +1.0, +0.7 (Tables 9–12).
Q2b (Observation 2, adaptive resolution). Varying only the anchor criterion, with budget and coverage rule fixed (Tables 13–16), deviation-guided anchors beat midpoint anchors on all four ALLMs: 50.0 vs. 47.1 (Qwen2.5), 53.8 vs. 51.7 (AF-Next), 61.3 vs. 58.2 (Qwen3), 62.4 vs. 61.5 (MOSS). Adaptive allocation alone is not enough, however: Time-Aware RDP concentrates anchors most (highest CAR) but leaves large gaps, and higher CAR does not always improve accuracy (Fig. 7(b); App. G.4).
Fidelity alone. Exact dynamic programming minimizes interpolation error optimally, yet is below TimePrune in MMAU accuracy in all four settings tested (e.g., 64.0 vs. 66.0 on Qwen2.5 and 70.2 vs. 75.0 on AF-Next at 85%; Table 31).
Connection to the design. Observation 2 motivates deviation-driven selection, which allocates more tokens to high-variation regions; Observation 1 identifies its risk of excessive gaps, which motivates Temporal Coverage Refinement. These are aggregate-level interventions, not sample-level causal estimates.
W2. Are the gains meaningful on individual benchmarks?
We agree that individual margins are often modest and that TimePrune is not best on every task; we do not claim significance for single differences. Our claim is consistency:
At the aggregate level, TimePrune has the highest Rel. Score in 17 of 18 model × pruning settings (Tables 1–2, 7–8; mean 96.4 vs. 94.2 for FLoC), and its largest shortfall from the best method is 0.2 points, vs. 5.1 for FLoC. Excluding MELD, where the gold transcript narrows differences, TimePrune still has the highest Rel. Score in all ten settings of Tables 1–2. Fine-grained speech is the weakest case (MMAU-Speech); we analyze speech under-retention in App. G.5 and state it in Sec. 6.
Q1a. Temporal representation trajectory. It is the time-ordered sequence of audio encoder outputs x1,…,xT, viewed as a curve in feature space indexed by time (Secs. 2.1, 3.1). Retained tokens are its temporal anchors, so this view lets us measure the two properties TimePrune balances: how closely the anchors follow the curve (fidelity) and how far apart they are in time (coverage).
Q1b. Does trajectory-driven refinement mean Time-Aware RDP? Yes, it is Time-Aware RDP's anchor-selection rule: it repeatedly keeps the original token deviating most from the time-synchronized interpolation between neighboring anchors (Sec. 3.2). This adds anchors where the trajectory changes rapidly (Observation 2) but can leave large gaps (Observation 1), so TimePrune adds Temporal Coverage Refinement for overly sparse intervals (Sec. 3.3).
Q1c. Regions Rm in Eq. (2). Each Rm is a block of 10 consecutive encoder tokens; blocks do not overlap and start at the first token, and a shorter final block is kept if it has at least two tokens. Cm is the mean adjacent cosine distance within the block. Regions are used only for this analysis, never for token selection (Sec. 2.2).
Limitations. Following the reviewer's suggestion, we added Sec. 6, covering variability across models and budgets, loss of fine-grained acoustic information, and audio beyond 10 minutes or streaming.
We sincerely appreciate the reviewer's suggestions. We hope these controlled analyses and clarifications address the concerns regarding methodological motivation and performance consistency.