- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes T-WLA, a multi-rate visuotactile policy for contact-rich dexterous manipulation. The main idea is to combine a relatively slow vision-language-action policy with a lightweight, high-frequency tactile residual editor.
The visual branch maintains a recurrent visual context bank and generates base action chunks using conditional flow matching. Between visual updates, the tactile branch processes recent tactile observations and uses the cached visual context and active action chunk to predict residual corrections for unexecuted actions. The authors additionally introduce future-image and future-pressure prediction objectives to regularize the learned representations during training. These auxiliary predictors are removed at inference.
The method is evaluated on tactile-conditioned future hand-motion prediction using EgoTouch and Tachin, as well as four real-world dexterous manipulation tasks. The reported results show improvements in hand-motion prediction, particularly finger-joint MPJPE, and an average success rate of 50.0% on the real-robot tasks.
Critical strengths
- Practical multi-rate control architecture.
The paper addresses an important problem in contact-rich manipulation: how to incorporate high-frequency tactile feedback without repeatedly invoking a computationally expensive visual policy. The proposed separation between base action generation and residual tactile correction is practically motivated. Caching visual context and modifying only the remaining unexecuted actions provides a coherent implementation of asynchronous feedback control.
- Evaluation across human-motion prediction and real-robot manipulation.
The paper evaluates the method on two tactile-conditioned hand-motion datasets and four real-world manipulation tasks. The improvements in finger-joint MPJPE are substantial, and the robot experiments provide some evidence of practical applicability. The inclusion of component ablations and visual-only evaluations is also useful for understanding the overall system.
Critical weaknesses
- Insufficient technical differentiation from existing methods and limited analysis of the proposed design.
My primary concern is the lack of a clear and convincing technical distinction between T-WLA and existing visuotactile manipulation methods.
The central idea of combining a slow visual policy with fast tactile feedback has already been extensively investigated, including in Reactive Diffusion Policy and T-Rex. Similarly, tactile residual correction has been explored in ViTaR, TouchWorld, and more recent approaches such as TacPAC. In particular, caching the base policy's information and using incoming tactile feedback to correct unexecuted actions is closely related to existing approaches.
Although the paper discusses some of these works in Related Work, the discussion largely describes their general approaches rather than identifying the fundamental technical differences. It remains unclear what new capability T-WLA provides that cannot be achieved by existing architectures.
The history-aware visual context may represent a distinguishing component. However, the paper does not sufficiently explain why this particular memory mechanism is necessary for asynchronous tactile correction, or how it fundamentally differs from simpler visual feature caching and temporal aggregation strategies.
Likewise, the future-image and future-pressure prediction objectives are relatively standard forms of auxiliary predictive supervision. The paper does not establish a distinctive technical insight regarding their interaction with the residual tactile editor.
Overall, the method appears to combine several previously explored ideas, but the paper does not provide sufficiently deep technical analysis or controlled comparisons to establish the necessity and originality of this particular combination. This substantially limits my assessment of its methodological contribution.
- Insufficient experimental evidence to isolate and validate the claimed contributions.
My second major concern is that the experimental comparisons do not convincingly establish which components are responsible for the reported performance improvements.
First, the real-robot results in Table 2 show that T-WLA achieves 47.25% average success without tactile input and 50.0% with tactile input. Thus, explicitly incorporating tactile feedback improves success by only 2.75 percentage points. The majority of the improvement over SmolVLA is already present without tactile input. On paper-cup nesting, adding tactile feedback provides no improvement at all.
This raises an important question about whether the proposed high-frequency tactile correction mechanism is responsible for the main empirical gains.
Second, the baseline comparisons do not sufficiently control for differences in architecture and execution frequency. For example, Table 1 reports substantially different effective tactile-correction frequencies for T-Rex and T-WLA (17.16 Hz versus 119.1 Hz). Consequently, the results do not clearly distinguish improvements due to the proposed residual editing mechanism from those due to different temporal update protocols.
Third, the ablation studies provide limited mechanistic evidence. Removing both world-prediction objectives during editor training changes EgoTouch finger-joint MPJPE only from 0.350 to 0.353 cm. Moreover, this ablation retains predictive supervision during visual backbone pretraining, so it does not isolate the contribution of predictive learning throughout the complete training pipeline.
Finally, the real-robot evaluation lacks direct comparisons against closely related tactile-reactive policies under matched settings. It also does not provide sufficient analysis of contact disturbances, correction behavior, or measured end-to-end inference latency, which are central to the claimed advantages of asynchronous tactile feedback.
Overall, while the reported improvements are encouraging, the current experiments do not sufficiently isolate the contributions of visual memory, tactile residual correction, and predictive supervision, or demonstrate why the proposed design is preferable to existing alternatives.
Questions for authors
- What is the fundamental technical difference between T-WLA and existing slow-fast or residual visuotactile policies?
In particular, how does T-WLA differ from T-Rex, Reactive Diffusion Policy, TouchWorld, ViTaR, and TacPAC in terms of its cached representations, tactile feedback integration, and action correction mechanism?
Beyond combining visual memory with a residual editor, what specific technical capability does T-WLA introduce that existing methods cannot provide? A more detailed mechanism-level comparison would be important for assessing the novelty of the work.
- How does the history-aware visual context specifically improve tactile correction?
The paper demonstrates that visual memory can improve hand-motion prediction, but it is unclear whether the memory and tactile correction mechanisms provide additional benefits when combined.
Could the authors provide controlled experiments comparing: (a) no visual memory and no tactile correction, (b) visual memory only, (c) tactile correction only, and (d) visual memory with tactile correction?
It would also be useful to compare the proposed recurrent context bank against simpler alternatives, such as caching the most recent visual features or using a short temporal observation window.
These comparisons would help establish whether the proposed memory mechanism provides a distinctive benefit to asynchronous tactile control.
- Why is the proposed residual editor preferable to existing tactile correction mechanisms?
The paper uses a Transformer followed by FiLM modulation to predict action-space residuals. However, it does not directly compare this design with alternative tactile integration approaches, such as feature-level residual adaptation, direct visuotactile fusion, or tactile-conditioned continuation of flow-based action generation.
Could the authors clarify the motivation for choosing this particular design and provide controlled evidence of its advantages in correction accuracy, computational efficiency, or contact recovery?
- How significant is the actual contribution of high-frequency tactile feedback to real-robot performance?
According to Table 2, adding tactile feedback improves average success from 47.25% to 50.0%, with no improvement on paper-cup nesting.
Could the authors explain why the improvement is relatively limited despite high-frequency tactile correction being a central contribution?
It would be particularly informative to report the number of independent evaluation trials, variability or confidence intervals, and contact-specific failure or recovery analyses. Evidence showing when and how the tactile editor changes the outcome of an ongoing manipulation would materially strengthen the paper.
- Are the reported control frequencies supported by actual runtime measurements, and how much does predictive supervision contribute?
The paper reports visual and tactile update frequencies of 39.7 Hz and 119.1 Hz, respectively. Are these measured end-to-end closed-loop operating frequencies or configured scheduling rates? What are the actual inference latencies of the visual branch and tactile editor?
Additionally, the world-prediction ablations in Table 3 remove auxiliary objectives during editor training but retain predictive supervision during visual pretraining. Could the authors clarify the contribution of predictive supervision across the complete training pipeline and demonstrate whether it leads to meaningful improvements in real-robot control?