- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposes MeRa, which transforms real-world spatial distances into attention biases through an MLP and incorporates them into multi-step latent refinement. Experiments on spatial recommendation tasks show that introducing distance biases improves prediction performance. The authors also provide ablation studies and theoretical analyses.
Critical strengths
The method is simple and easy to integrate with different backbones, with reported performance improvements across multiple datasets.
Critical weaknesses
- Limited novelty.
Incorporating spatial distances into attention has been extensively studied. This paper mainly applies this established mechanism to multi-step latent refinement, with the overall architecture remaining a straightforward combination of distance-biased attention, FFNs, and gated residual updates. The paper lacks sufficient comparisons with alternative ways of incorporating spatial information and fails to demonstrate any distinctive synergy between distance conditioning and multi-step reasoning. Overall, I find the methodological novelty insufficient for ICLR.
- Verbose writing and unclear focus.
The paper contains excessive repetitive qualifications and defensive discussions that obscure its core method and contributions. The presentation could be substantially more concise, and Figure 1 lacks clarity and intuitiveness.
- Limited value of the theoretical analysis.
The finite-depth displacement and sensitivity bounds in Theorem 1 follow directly from standard norm inequalities and Lipschitz assumptions. The fixed-memory access property in Theorem 2 is also an immediate consequence of the architecture. Neither theorem reveals any distinctive property of geometry-conditioned refinement or explains the observed performance gains. Consequently, the theoretical analysis provides little substantive support for the paper’s central claims.
- Serious concerns about experimental reliability.
Appendices E and F acknowledge severe misalignment between POI indices and spatial coordinates in the available code, while the original results cannot be reliably linked to specific code versions, data splits, or checkpoints. More importantly, subsequent experiments using a different implementation and evaluation protocol failed to consistently reproduce the originally reported improvements. Although these issues do not establish that the original experiments were incorrect, the current evidence is insufficient to reliably support the paper’s main empirical claims.
Questions for authors
What unique advantages does multi-step refinement offer over a single distance-aware attention layer? Can the authors provide experiments demonstrating a synergistic effect between distance conditioning and iterative refinement?