- Rating
- 4
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The authors introduce Structured State Representation (SSR), a token-mixing operator that organizes source tokens into a compact bank of input-dependent states using learned centers before queries retrieve information from those states. SSR preserves the standard ((Q,K,V)\to Y) interface and reduces token-mixing complexity from quadratic to linear in sequence length for a fixed number of states. It also introduces an inductive bias through shared source organization, which the authors suggest may benefit certain tasks. The method is evaluated within two embodied policy frameworks, ACT and Diffusion Policy, through comparisons with Transformer and Mamba baselines. The experiments examine task performance, training dynamics, representation geometry, and computational characteristics.
Critical strengths
One strength of SSR is its compatibility with the standard attention interface, which allows it to replace attention modules within existing policy architectures. Its linear token-mixing complexity provides a clear computational advantage as sequence length increases. Tables 4 and 5 demonstrate reduced end-to-end FLOPs for projection-free SSR and substantial temporary-memory savings in the evaluated module-level benchmark. These results are promising, although the memory comparison depends on the particular attention implementation used. The policy experiments also demonstrate that SSR can remain competitive and improve performance in selected settings.
Another strength is the analysis of learned representations, which complements the performance comparisons. The visualizations suggest a more continuous organization with respect to episode progress, while high linear CKA indicates substantial representational similarity between SSR and the Transformer. Together, these observations are consistent with the interpretation that SSR changes how information is organized while retaining much of the Transformer’s representational structure. However, they do not directly establish preservation of all task-relevant information.
Critical weaknesses
SSR’s performance gains are task-dependent. In Table 1, SSR-P with center-based readout achieves the highest average success rate, but its improvements are concentrated on Transfer Cube, while it underperforms both the Transformer and Mamba on Bimanual Insertion. Although bolding the highest average is appropriate, this aggregate can obscure the tradeoff between tasks. The results therefore support improvements in selected settings rather than a consistent performance advantage.
The module-level memory comparison also requires qualification. Appendix C states that the Transformer reference uses nn.MultiheadAttention with need_weights=True, whereas SSR uses a TorchInductor-fused implementation. PyTorch recommends setting need_weights=False to enable optimized scaled dot-product attention and achieve the best performance. Consequently, Table 5 compares fused SSR against an attention configuration that requests attention weights, potentially increasing memory consumption unnecessarily. The reported reductions therefore do not establish the same advantage over optimized attention. Although the separate sequence-length benchmark uses SDPA, a corresponding comparison at the ACT configuration used in Table 5 would help establish the practical magnitude of the memory savings.
Questions for authors
1.The related work discusses Set Transformer, Slot Attention, and other approaches that organize information through compact intermediate representations, but these methods are not included in the experimental comparisons. How does SSR compare with these closely related alternatives under matched state capacity and training conditions? Such comparisons would help clarify the benefits of SSR’s specific organization and retrieval mechanism beyond its differences from standard attention and Mamba.
2.The paper identifies the inductive bias introduced by separating source organization from retrieval as its primary interest. However, the results do not clearly isolate the contribution of this design choice. Faster convergence is encouraging, but could also reflect differences in optimization, regularization, or model capacity. What evidence supports attributing the observed improvements specifically to the proposed inductive bias?
3.SSR’s relative performance varies across tasks: it improves some Transfer Cube settings but generally underperforms on ACT Bimanual Insertion and the additional ACT tasks. Can the authors identify conditions under which shared state aggregation is beneficial or detrimental? In particular, is there evidence supporting the hypothesis that aggregation removes fine geometric distinctions needed for precise control, beyond the observed differences in success rates?
Dear Reviewers
The author-reviewer discussion period will close soon. Please read and respond to authors if you have not done yet.
Thank you.
AC