- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes FibVLA, an efficient temporal VLA framework that addresses the tension between capturing long-context temporal information and maintaining real-time inference efficiency. The framework introduces three components: (1) Logarithmic Hindsight Sampling, which constructs non-uniform temporal indices following a dense-near, sparse-far pattern with a Fibonacci sparsity constraint; (2) a Channel-wise Temporal Encoding (CTE) module that compresses multi-frame temporal dynamics into a single RGB image via frame differencing and recursive decay, mapping Near/Mid/Far temporal ranges to R/G/B channels; and (3) a Fibonacci Recurrent Inference strategy that binds the action chunk length to Fibonacci terms, enabling KV cache reuse across inference steps. Evaluated on LIBERO (96.8% avg, 95.2% Long), SimplerEnv-Bridge (67.3%), SimplerEnv-Fractal (72.1%), MIKASA-Robo (46.5%), and 7 real-world tasks (85.7/100 score), FibVLA demonstrates competitive performance with 177ms inference latency.
Critical strengths
-
This paper proposes FibVLA, an efficient temporal VLA framework that addresses the tension between capturing long-context temporal information and maintaining real-time inference efficiency.
-
The paper is well-structured and clearly written. Figure 1 provides an intuitive motivation for non-uniform sampling. Figure 2 clearly illustrates the overall architecture. The mathematical formulation in §3.3–3.5 is precise, and the proof in Appendix H is self-contained.
-
The idea of binding action chunk length to Fibonacci terms to enable KV cache reuse is a creative design.
Critical weaknesses
W1. Ablations fail to isolate the Fibonacci recurrent inference contribution from the sampling pattern. Table 5 removes only entire components (w/o Sampling, w/o CTE) and does not separate the Fibonacci KV-cache reuse mechanism from the logarithmic sampling pattern itself. Table 6 compares Fibonacci vs. Logarithmic vs. Long-Short sampling, but the "w/ Logarithmic" variant (201ms, 94.6%) still uses logarithmic sampling—just without Fibonacci alignment. A clean ablation holding sampling points fixed while toggling KV-cache reuse on/off is missing. Since the paper's core efficiency claim rests on this specific mechanism (§3.5, Eq. 8), the evidence does not yet cleanly demonstrate that the Fibonacci alignment—rather than the sampling density or CTE encoding—is the source of the speedup.
W2. Baseline comparison fairness is unclear regarding training data and fine-tuning protocol. Table 12 (Appendix F) shows FibVLA is fine-tuned on benchmark-specific data (e.g., 25,460 Bridge V2 episodes for SimplerEnv-Bridge; 26,152 Fractal episodes for SimplerEnv-Fractal). However, the paper does not state whether baselines (RT-1-X, OpenVLA, π₀, CogACT) are fine-tuned on the same data or evaluated zero-shot as pre-trained generalists. On SimplerEnv-Bridge (Table 2), FibVLA's 67.3% vs. π₀'s 55.7% is difficult to interpret without this clarification. Additionally, HiF-VLA—a direct temporal VLA competitor scoring 94.4% on LIBERO-Long (Table 9, within 0.8% of FibVLA)—appears only in the efficiency table (Table 6) but is absent from the main comparison table (Table 1).
W3. CTE module lacks hyperparameter specification and robustness analysis. The CTE module (§3.4) depends on a binary motion threshold ξ (Eq. 6), maximum intensity τ, and decay parameter δ (Eq. 7), but none of these values are reported in the paper or appendices. The frame differencing approach (Eq. 5) is inherently sensitive to camera noise, lighting changes, and static clutter, yet no sensitivity or failure-mode analysis is provided. Given that removing CTE causes a 4.0% drop on LIBERO-Long (Table 5), understanding the module's operating envelope is essential for assessing reliability.
W4. No statistical significance reporting across any experiment. All results are point estimates without confidence intervals, standard deviations, or significance tests. On LIBERO-Long, FibVLA's 95.2% vs. HiF-VLA's 94.4% (Table 9) is a 0.8% gap over 250 episodes (10 tasks × 25 episodes, per Table 10), likely within random variation. MIKASA-Robo (Table 4) evaluates only 4 tasks. Real-world experiments use 10 trials per task (Appendix E, Eq. 9). Without uncertainty quantification, the reliability of these margins—particularly the 0.8% LIBERO-Long gap and the 4-task MIKASA comparison—cannot be assessed.
W5. Real-world evaluation uses a non-standard metric with limited scope and unclear task selection. The real-world evaluation (Figure 5) employs a custom step-wise scoring rubric (0–2 points per sub-step, 5 sub-steps, 10 trials; Appendix E) rather than standard binary success rate, introducing subjective judgment (e.g., distinguishing "fluent" from "corrective" execution). Only 7 of 15 available tasks are evaluated, with selection criteria unexplained. All 7 tasks are tabletop pick-and-place or stacking variants; contact-rich, deformable-object, or truly dynamic tasks are absent. It is also unclear whether baselines (OpenVLA, OpenVLA-OFT, π₀) are fine-tuned on the same 700-episode dataset or evaluated zero
Questions for authors
-
For the SimplerEnv-Bridge and SimplerEnv-Fractal results (Tables 2–3), are the baselines (RT-1-X, OpenVLA, π₀, CogACT, etc.) fine-tuned on the same Bridge V2 / Fractal training data as FibVLA, or are they evaluated zero-shot as pre-trained generalist models? Please specify the training protocol for each baseline row.
-
Section 3.3 states the growth rate can be "flexibly adjusted," but Section 3.5 requires exact Fibonacci alignment () for KV cache reuse. In your actual experiments, does the sampling sequence satisfy exact Fibonacci equality at all indices, or only approximately? If approximately, how do you handle the misalignment, and what is the impact on inference accuracy?
-
What are the specific values of the motion threshold , maximum intensity , and decay parameter used in the CTE module (Eqs. 6–7)? How sensitive is performance to these values? A brief sweep of on LIBERO-Long would be informative.
-
HiF-VLA appears in Table 6 (efficiency) and Table 9 (LIBERO-Long, 94.4%) but is absent from the main Table 1. Could you include HiF-VLA results on all four simulation benchmarks? Given the 0.8% gap on LIBERO-Long, understanding the broader comparison is important.
-
For the real-world experiments (Figure 5), are OpenVLA, OpenVLA-OFT, and π₀ fine-tuned on the same 700-episode dataset as FibVLA? If not, the comparison is between a fine-tuned model and zero-shot/few-shot baselines, which would need to be stated explicitly.
-
How were the 7 real-world evaluation tasks selected from the 15 available? Were they selected before or after observing model performance?