- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces a novel framework for low-rank adaptation that operates on a fixed bank of reference and gradient-informed candidate directions. The idea sounds and the results are interesting.
Critical strengths
the idea is very interesting.
according to the results, aperture seems very effective and useful for the community.
Critical weaknesses
The paper lacks discussions and comparisons with two important related works, namely CCM-LoRA and Gated LoRA. A comparison with these methods would consistently strengthen the contribution of the paper.
Notation should be revised: vectors and matrices should be bold, otherwise they represent scalars!
Sec 5.1 could be revised to be less-llm generated. Also, I got a little bit lost among RQ1,2,3,4, tier 1,2,3, and stage 1,2.
While the paper seems nicely motivated and presented, the experimental section seems written in rush. So, even though the method seems effective, the paper lacks a detailed discussion on the results. Also there is space left, so it would have been nice to place some visualizations to qualitatively evaluate the impact of aperture. I think this part could be improved to improve the quality of the paper.
Minor concerns:
Formatting should be revised. figure 1 is placed at the bottom overlapping with page number.
controlled empirical validation is not a contribution.
The policy implemented by Aperture in section 3 should be moved to the method section.
Questions for authors
could the authors compare with the two relevant literature methods in the experiments and discuss the results?
4 comments
Maybe you forgot to upload the updated the paper? I can't see the changes.
reply to reviewer jAwf
I have now uploaded the updated PDF. Thank you for pointing this out, and I apologize for the oversight. I hope our responses and revisions have adequately addressed all your concerns. If you have any further questions or suggestions, we would be happy to clarify them.
Thanks for the rebuttal. I appreciate the new experiments. Nevertheless, the review is still totally llm-based, making the paper not ready for a conference as the writing quality does not match the required quality for publishing at ICLR. I show here some examples to help the authors understand that submitting and publishing papers should be taken seriously and that it is important to study how papers should be done before asking llms to write/do/revise them. Just a couple of examples:
-
caption of fig.1, "The short labels inside the allocator panel now name the three decisions." Now? it was supposed to be a ready paper, not a report on the changes
-
Third contribution starts with "across three seeds". This cannot be a contribution, this is a mere implementative detail that is standard, while llms tend to be over-specific on implementation details, this is a scientific paper and experimental details should only go in the experimental section.
-
The experimental discussion lacks, as llms just report some results like "APERTUREgains+2.03/+1.24, +0.72/+1.28,and+3.06/+1.99points",which is a useless information as it is already contained in the tables, while instead one expect a discussion or a comment on the results, rather than just replicating the numbers.
Overall, I find that the paper is not ready for this conference.
Response to Reviewer jAwf
We have carefully addressed all concerns through additional comparisons with CCM-LoRA and Gated LoRA and allocation-swap experiments, clarification of tensor notation and the distinction between the problem formulation and the method, and improvements to the experimental organization, results discussion, qualitative examples, figure layout, and contribution statement. The corresponding revisions have been incorporated into the manuscript.
Paired results are MUSIC-AVQA/AVE; gains are percentage points (pp).
W1 & Q1 (CCM-LoRA and Gated LoRA).
CCM-LoRA routes inputs among existing rank directions under an expected-rank budget; Gated LoRA gates rank-one mini-experts. APERTURE additionally rotates directions toward gradient-informed residuals and allocates shared support across audio and vision.
We compared both methods on LLaMA-2-7B (seed 42), matching the split, update budget, and validation-based selection while retaining their native architectures and capacity settings:
Gains are +4.07/+4.43 pp over CCM-LoRA (video-clustered 95% CIs [3.21,4.93]/[3.29,5.57]) and +3.83/+4.24 pp over Gated LoRA ([2.97,4.69]/[3.10,5.38]). Static-Alloc$^+$ and APERTURE each train 3,507,712 parameters; APERTURE averages eight active rows per site.
Matched-support controls (±0.10 rows per modality) show that random residual directions, zero rotation, and separate modality budgets reduce accuracy by 4.31/4.40, 2.70/3.43, and 1.43/1.20 pp. Some main-table bank/zero-angle rows also differ in budget control, so they do not isolate independent causal effects.
Revision. Sec. 2 (p. 3), Sec. 5.1 (p. 8), Sec. 5.2 (p. 9); Tables 7 (p. 28), 21–23 (pp. 39–40).
[1] Rafiuddin and Abdullah, Context-Conditioned Masked LoRA, Findings of ACL 2026.
[2] Eom et al., Gated LoRA: Dual-Purpose Projections for Parameter-Efficient Mini-Expert Fine-Tuning, ICLR 2026 submission.
W2 (Notation).
We standardized bold uppercase matrices, bold lowercase vectors, and italic scalars, with dimensions at first use. Eq. 9 now clarifies that unit directions are scaled by reference row norms before learned gating.
Revision. Secs. 3–4.4 (pp. 4–7); Apps. A.1 (p. 16), A.4/A.6.
W3 (Organization).
We replaced RQ labels with an experimental overview, Tier labels with backbone names, and S1–S3 with direction orientation, within-modality support, and cross-modal allocation. Stage 1/2 now denote reference-adapter/allocator training only. Sec. 5.1 explains each control's purpose; Figure 2's labels and matrix notation match the text.
Revision. Sec. 5.1 (p. 7), Secs. 5.2–5.4 (pp. 8–10), App. B (pp. 24–35), Figures 1–2 (pp. 2–5).
W4 (Interpretation and qualitative evidence).
We swapped allocations between audio/visual questions about the same video while fixing weights, rotated directions, row rankings, and the eight-row budget. The 1,420 unlabeled pairs comprise 2,840 evaluations across 612 videos (64.3% of eligible pairs), selected for allocations differing by at least two audio rows.
Swapping reduces accuracy 76.83→71.41%, a 5.42 pp drop (video-clustered bootstrap 95% CI [3.86,6.98]), with 214 right-to-wrong versus 60 wrong-to-right flips.
For video 00005455, the audio question “Which instrument makes sounds before the violin?” uses 6 audio + 2 visual rows and correctly predicts piano; swapping to 2+6 changes the answer to violin. The visual question “What is the instrument on the left of the violinist?” uses 2+6, correctly predicts piano, and changes to cello under 6+2. Thus the same video's correct answers depend on question-appropriate allocation.
These interventions complement question-shuffling controls and support–demand correlation (ρ=0.46, versus 0.08 with shuffled questions; Table 2b).
Revision. Sec. 5.2 (p. 9), Sec. 5.4 (pp. 9–10); Tables 28–29 (App. C.6, pp. 42–43).
Minor 1 (Figure layout). Figure 1 is now at the top of p. 2, clear of the footer.
Minor 2 (Contribution). The third contribution now states the three-seed mean gains +4.16 pp on MUSIC-AVQA and +2.23 pp on AVE over parameter-matched Static-Alloc$^+$ (Sec. 1, p. 3).
Minor 3 (Formulation versus method). Sec. 3 (p. 4) gives the general measurement/allocation formulation; method-specific rotations, gates, and budget regularization appear in Secs. 4.2–4.3 (pp. 5–6).
We hope these analyses address your concerns.