- Rating
- 2
- Confidence
- 2(+1)
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes Atom Atlas. Each demand selects coordinates from a shared -atom orthonormal bank, and analyzes the tradeoff between shared capacity, demand-specific utility, and sparse coordinate access.
Critical strengths
The experimental section is extensive.
Critical weaknesses
My main concern is clarity and presentation, particularly in the introduction. It is a bit difficult for me to follow up why this problem, what others do, and what the authors propose consequently. If the author intends to trade a compressed introduction for later contents, I think it is compressed too much. For example, in 'Locodec (Luo et al., 2026) represents speech by low-rate spherical vectors with progressively decodable coordinates. Our stereo-music adaptation tests whether one order serves demands ranging from local fidelity to source, frequency, and long-range structure.', I don't see a clear motivation for this paper's design. Substantial paper logic flow modification may be needed.
Also, the authors should polish the figure presentation.
Questions for authors
Can the authors ripple out the introduction around the core issues, limitations of existing work, and the consequent motivations for proposed solutions? For example, why a shared K-dimensional view is insufficient and why K-of-M sparse access is the appropriate solution, before introducing the geometric machinery?
7 comments
Response for Authors
Thank authors for the response. I acknowledge that the additional example and revised figures improve the presentation to some extent. However, my main concern regarding the clarity and accessibility of the paper, especially in introduction, remains insufficiently addressed.
The introduction is still too compressed and difficult to follow for readers unfamiliar with the topic. In particular, the illustrative example explains why different tasks may require different representations, but does not sufficiently motivate the specific need for the proposed sparse interface over conventional task-specific projections. I believe the paper requires a substantial restructuring of its introductory logic, rather than incremental wording changes, to clearly establish the problem, motivation, and significance of the proposed approach. Due to the substantial revision needed for illustrative clarity, I would lower my score to 1. Thank you.
Response to 73iW: From task-specific views to shared coordinate access
Thank you for re-reading our revised paper and clarifying the remaining concern. We agree that showing why demands favor different views does not by itself explain the additional motivation for coordinate-subset access, since conventional task-specific dense projections already provide different views. In response, we have reorganized the Introduction so that the problem, the shared-coordinate goal, and the role of the analysis form a continuous argument. The motivation now develops before the Locodec background and the contribution list. The specific changes are as follows:
-
Problem and existing alternative. We retain the opening explanation that a common prefix gives every demand the same compact view, although source, frequency and temporal requirements may favor different directions. The second paragraph now explicitly acknowledges task-specific dense projections as a flexible way to provide different -dimensional views.
-
Shared coordinates and the research question. The second paragraph distinguishes the shared capacity from the coordinates read by each consumer. It explains how selected index sets identify each demand's view and how their overlap records direction reuse. The question is then how much of the dense-view utility this coordinate-subset organization retains.
-
Connection to Atlas and the analysis. In the third paragraph, Atlas's shared orthonormal dictionary follows from this goal. Dense views in the same -dimensional span permit task-specific linear combinations, making the coordinate restriction and the role of the realization analysis explicit. The analysis characterizes when the chosen dense-view subspaces admit exact realization and bounds the operator utility lost through approximation. Demand relations connect this account to comparing the structure of view preferences across tokenizers without aligning axes. We retain the original contribution sequence, with matched nonlinear consumers providing the separate evaluation of predictive utility.
Dense and sparse interfaces can both reuse computed coordinates. The comparison includes cached and precomposed dense implementations, as well as learned projections and full-width inputs (Section 5.4 and Appendices R–T). Precomposed Dense and Atlas have similar observed deployment costs in the measured workloads. We retain that empirical scope while making the central motivation clearer: organizing demand-specific utility through a shared coordinate interface and quantifying its trade-off relative to flexible dense views. Thank you for prompting us to explain this connection more carefully.
Response to 73iW (1/1): Motivation and figure presentation
Response to 73iW (1/1): Motivation and figure presentation
Thank you for identifying where the motivation and the transition to our design needed a clearer explanation. We have added a concrete shared-view example before the tokenizer-specific background and polished Figures 1–3 and their captions to clarify the interface choice and the interpretation of the results. The revised Introduction presents the interface question before the geometric machinery.
Motivation and explanatory order
The opening asks how a frozen tokenizer should expose latent directions to different downstream demands at a fixed consumer input width K. A common prefix or shared rank-K view supplies the same directions to every demand. When demands prefer different directions, this can create a utility compromise. The short introductory example makes this issue concrete before the Locodec background.
K-of-M access separates the two budgets involved in that compromise. One shared bank defines M atom coordinates, while each demand reads a subset of K. Different demands can select different subsets while each consumer still receives K coordinates. This motivates representing demand-specific views by addresses into one reusable bank. Dense task-specific views in the same shared span provide the reference for quantifying the utility retained under this coordinate-subset constraint.
For illustration, consider two demands favoring orthogonal axes, with one active coordinate per consumer. A single shared rank-one view cannot attain both demand-specific optima. With normalized axis utilities, its best worst-demand regret is 1/2. A bank containing both axes lets each demand read its own coordinate, with active width one and shared capacity two. This explains why allowing different compact views can help while each consumer's input width remains fixed.
The revised Introduction places the Locodec context after the short example, so the tokenizer-specific background follows the interface motivation. The operator analysis then formalizes shared-view compromise and sparse realization, while the consumer experiments assess predictive utility for the stated tasks and baselines.
Figure presentation and result navigation
We refined the presentation within the original three-figure structure, retaining every plotted value:
The added relation controls and width/MIDI comparisons appear in Figures 5 and 8, with direct pointers from Sections 5.2 and 5.4. Main Table 3 collects six predictive contrasts by task, budget, baseline, metric and interval; Appendix Table 25 provides the expanded summary. We also checked appendix figure placement and table typography for readability.