- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes HoloRoPE, a rotary positional encoding method designed for hierarchical wireless foundation models. First, the authors introduce Asymmetric Hybrid-Resolution Attention (AHRA), which aggregates neighboring subcarrier features in selected attention heads while preserving fine-grained information in the remaining heads. Second, they analyze the positional encoding mismatch introduced by regional aggregation and propose HoloRoPE, which applies content-dependent, frequency-aware amplitude modulation to regional keys while preserving their rotary phases. The proposed methods are evaluated on simulated channel datasets generated using DeepMIMO and Sionna, covering channel extrapolation, channel estimation, LoS/NLoS classification, and beam prediction. Experimental results demonstrate consistent improvements over conventional RoPE and other positional encoding baselines across different antenna configurations and model scales.
Critical strengths
-
The paper identifies a meaningful limitation of conventional RoPE when applied to pooled regional representations. Its analysis of geometric and content-dependent factors provides a reasonable theoretical motivation for the proposed HoloRoPE design, moving beyond purely empirical modifications to positional encoding.
-
The experimental evaluation is relatively comprehensive, covering multiple wireless tasks, antenna configurations, channel datasets, and model scales. The consistent improvements over conventional RoPE and other positional encoding methods suggest that HoloRoPE can enhance representation learning in wireless foundation models.
Critical weaknesses
-
The theoretical analysis does not sufficiently justify the proposed HoloRoPE design. Although the identified positional encoding mismatch involves both amplitude and phase, HoloRoPE only adjusts the amplitude while preserving the original phase. Moreover, comparisons with simpler learnable gating mechanisms and alternative regional position assignments are missing. These limitations raise concerns about whether the proposed formulation offers a substantive advantage over simpler alternatives.
-
The experimental evaluation lacks sufficient evidence of practical applicability and generalization. All experiments rely on simulated channels without validation using real-world CSI measurements. Essential system parameters, including antenna array sizes, subcarrier counts, and bandwidths, are not clearly specified. Furthermore, the channel extrapolation protocol does not clearly distinguish interpolation from genuine extrapolation. These limitations make it difficult to assess the effectiveness and scalability of HoloRoPE in realistic 5G and emerging 6G systems.
Questions for authors
-
The authors should clarify how amplitude-only modulation addresses positional encoding mismatches involving both amplitude and phase differences.
-
Comparisons with simpler learnable key-gating mechanisms and alternative regional position assignments are needed to establish the necessity of HoloRoPE.
-
Essential wireless system parameters, including antenna array sizes, subcarrier counts, carrier frequencies, and bandwidths, should be explicitly reported.
-
The channel extrapolation protocol should be clearly specified, particularly whether it involves genuine frequency or spatial extrapolation rather than interpolation or masked reconstruction.
-
Experiments using real-world measured CSI datasets are needed to demonstrate the practical effectiveness of HoloRoPE.
-
Cross-scenario and cross-dataset evaluations are needed to assess generalization across propagation environments, frequency bands, and antenna configurations.
-
Additional experiments should examine robustness under varying coherence bandwidths, delay spreads, and channel estimation noise levels, particularly when adjacent subcarriers exhibit weak correlation.
7 comments
Response to Reviewer bjpr (2/5)
Q2. Comparisons with simpler key gating and alternative regional position assignments.
We thank the reviewer for this suggestion and have added both kinds of alternatives to the revision (Tables 2 and 3). They are described in Section 3.2 and Appendix B.2. All variants share the same backbone, pooling, and training recipe and differ only in how the regional keys are encoded.
- RoPE-Center encodes each region at the center of its window instead of at its first patch.
- RoPE-Constituent rotates each patch's contribution to the pooled key at that patch's own coordinate and then sums the contributions.
- RoPE-ContGate scales each regional key using a learned scalar per region and regional head, predicted from the pooled content.
- RoPE-Gate does the same, but predicts the factor from both the pooled content and how much the features vary within the region. It is HoloRoPE's gate on its own.
- RoPE-Spec lets the gain change across rotary frequencies, with a strength predicted from how much the features vary within the region. It is HoloRoPE's spectral factor on its own.
- HoloRoPE combines the gate of RoPE-Gate with the frequency profile of RoPE-Spec.
Table R2: Regional position assignments and modulation controls on DeepMIMO with real-valued models (Tables 2 and 3, Section 3.2).
| DeepMIMO, real-valued | CExt ULA | CExt UPA | BPred-128 ULA | BPred-128 UPA |
|---|---|---|---|---|
| RoPE (window-start coordinate) | −40.12 | −38.37 | 66.90 | 60.38 |
| Position assignment | ||||
| RoPE-Center (window-center coordinate) | −40.30 | −38.35 | 67.33 | 61.51 |
| RoPE-Constituent (each patch at its own coordinate) | −40.54 | −38.68 | 68.73 | 62.54 |
| Simpler gating | ||||
| RoPE-ContGate (gate on pooled content) | −40.37 | −38.54 | 68.77 | 62.79 |
| RoPE-Gate (gate on content and dispersion) | −40.63 | −38.79 | 68.24 | 63.11 |
| Frequency profile only | ||||
| RoPE-Spec (learned spectral factor) | −40.96 | −38.99 | 70.08 | 62.32 |
| HoloRoPE | −41.14 | −39.19 | 70.31 | 65.30 |
All alternatives improve CExt under both arrays except RoPE-Center, which yields a small improvement under ULA but a slight degradation under UPA. HoloRoPE is the best variant in all 24 entries of Table 2 (4 tasks × 2 arrays × real/EH/EC). In CExt, the spectral factor alone improves on RoPE by 0.84/0.62 dB with only 0.03%/0.02% additional parameters under ULA/UPA, respectively (Tables 2 and 9, Appendix C.2), more than either gate, which adds about 3.3% and gives at most 0.51/0.42 dB. These results support the effectiveness of adaptive spectral modulation beyond increasing gating capacity.
Additional controls apply content-only gating to native-resolution keys (RoPE-NatContGate). HoloRoPE outperforms both native-resolution and regional content-only gating across all 24 task–array–family combinations in Table 6 (Appendix C.1), further supporting benefits beyond content-only gating.
Response to Reviewer bjpr (3/5)
Q3. System parameters.
We thank the reviewer for pointing this out. Appendix B.3 specifies the dataset configurations and frequency sampling procedures. The reference system parameters are summarized below.
Table R3: Reference system configurations for DeepMIMO, Sionna, and DICHASUS (Appendix B.3).
| Parameter | DeepMIMO | Sionna | DICHASUS (measured) |
|---|---|---|---|
| Channel model | Site-specific ray tracing | 3GPP TR 38.901 | Outdoor measurements |
| Array | 32-element ULA or 8×8 UPA | 32-element ULA or 8×8 UPA | 2×8 receive array |
| Antenna spacing | 0.5λ | 0.5λ | Approximately 0.5λ |
| Carrier frequency | 3.5 GHz | 3.5 GHz | 1.272 GHz |
| Nominal bandwidth | 11.52 MHz | 11.52 MHz | 50 MHz |
| Input frequency samples | 32 | 32 | 128 |
| Effective frequency sampling interval | 360 kHz | 360 kHz | 390.625 kHz |
For Sionna, the original grid contains 384 subcarriers spaced 30 kHz apart. Selecting the first subcarrier from each of 32 resource blocks yields the input frequency samples listed above (Appendix B.3).
These are reference configurations rather than the full range of settings evaluated. Appendices C.5–C.6 report additional experiments across propagation domains, antenna and frequency configurations, and channel conditions. Table 16 evaluates ULA configurations with {8, 16, 32, 64} antennas and {16, 32, 64, 128} frequency samples. Table 17 evaluates frequency sampling intervals of 90, 180, 360, and 720 kHz under both ULA and UPA (Appendix C.5, discussed further in Q6).
Q4. Channel extrapolation protocol.
We agree that the protocol should be stated explicitly. The random target-selection pattern used in the main benchmark evaluates recovery of distributed missing observations. We additionally evaluate three structured patterns defined in Appendix B.1: frequency extrapolation selects a contiguous block at the upper end of the subcarrier axis, spatial extrapolation selects a contiguous block at the end of the antenna axis, and joint extrapolation selects a rectangular corner block spanning the ends of both axes. The target-selection ratio ranges from 0.25 to 0.50 for ULA and from 0.50 to 0.75 for UPA.
Table 10 in Appendix C.3 reports the full results for the real-valued, equal-head-count (EH), and equal-cache-size (EC) variants under all four target-selection patterns. The real-valued results for the three structured extrapolation settings are summarized below:
Table R4: Structured channel extrapolation with real-valued models (Table 10, Appendix C.3).
| Pattern | CExt ULA, RoPE → HoloRoPE | CExt UPA, RoPE → HoloRoPE |
|---|---|---|
| Frequency | −26.49 → −27.04 | −24.50 → −25.61 |
| Spatial | −18.61 → −19.58 | −27.35 → −27.89 |
| Joint | −24.02 → −24.71 | −29.22 → −30.22 |
HoloRoPE improves performance in all three settings under both ULA and UPA. The same improvements hold for both EH and EC variants, covering all 18 paired comparisons across the three structured patterns, two array configurations, and three rotary families in Table 10. The results support its effectiveness beyond random target selection.
Response to Reviewer bjpr (1/5)
We thank the reviewer for the detailed comments and suggestions, and for the positive assessment of our motivation and experiments. We have further clarified in the main text the reasoning behind the motivation and purpose of HoloRoPE, which we believe addresses the reviewer's questions about the method. We have also added capacity-matched gating experiments and the broader experimental validation suggested by the reviewer, and specified the system parameter settings in the paper, making the overall argument and validation more complete. We respond to each question below. The first weakness corresponds to Q1–Q2 and the second to Q3–Q7.
Q1. How does amplitude-only modulation relate to a difference that involves both amplitude and phase?
The comparison between the common-coordinate and constituent-coordinate encodings is meant to reveal how regional encoding depends on geometry, rotary frequency, and content, and the learnable modulation is built on these dependencies. We do not presuppose the constituent-coordinate encoding as the optimal target, nor do we take removing the magnitude and phase differences between the two encodings as a training objective (Appendices A.5–A.6). We thank the reviewer for raising this question, and we have clarified this logic in the revised manuscript. Section 2.3 now includes a paragraph on phase and magnitude effects, which the argument below follows.
Common-coordinate encoding assigns the same positional phase to all constituent contributions. For the geometric factor of a regular window, the phase corresponds to a shift to the window center, while its magnitude falls below one as the rotary frequency grows from zero in the low-frequency regime when the coordinate variance is nonzero (Eq. (10), Appendix A.4). For this geometric component, the remaining phase difference only amounts to moving the representative coordinate to the window center. We added this variant to the revision (RoPE-Center, Table 2), and it changes CExt only marginally, from −40.12/−38.37 dB for RoPE to −40.30/−38.35 dB (ULA/UPA). Across the evaluated rotary families and arrays, the change is at most 0.32 dB (Section 3.2).
The phase of the content–position residual depends on regional features and cannot generally be represented by a position-only rotation (Phase and Magnitude Effects, Section 2.3).
Changing the representative coordinate alone cannot adjust component magnitudes. This motivates content-conditioned magnitude modulation while retaining the common-coordinate phases. HoloRoPE adaptively modulates regional magnitudes and improves CExt to −41.14/−39.19 dB (Table 2). Table 3 directly compares common-coordinate RoPE, constituent-coordinate encoding, and HoloRoPE. The real-valued CExt results are:
Table R1: Common- and constituent-coordinate encoding on DeepMIMO with real-valued models (Table 3, Section 3.2).
RoPE-Constituent improves CExt over common-coordinate RoPE by 0.42/0.31 dB under ULA/UPA, respectively, supporting our motivation to account for positional information within aggregated regions. RoPE-Constituent retains the individual positional phases of the constituent contributions before summation, whereas HoloRoPE changes only magnitudes and keeps the common-coordinate phases. HoloRoPE still improves on RoPE-Constituent by a further 0.60/0.51 dB and is the best of the three in all 24 entries of Table 3, so the observed gains can be achieved without changing the common-coordinate phases.