- Rating
- 3(+2)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes MIP², a molecular-language projector that combines reversible 2D–3D feature fusion, orthogonal information-preserving projection, and atom-level attention. The method guarantees recovery of pretrained molecular encoder features and reports improvements across several molecular tasks.
Critical strengths
-
The proposed projector provides a clear mathematical guarantee of feature recoverability, supported by numerical verification.
-
The experiments cover multiple downstream tasks and LLM backbones, with useful ablation studies.
Critical weaknesses
-
The importance of exact recoverability is insufficiently justified. The paper demonstrates that encoder features can be recovered, but does not clearly explain why this property is necessary or beneficial for downstream tasks. Non-recoverable embeddings may still preserve task-relevant information and perform equally well.
-
The performance gains are not convincingly attributed to recoverability. Removing the orthogonal constraint changes both recoverability and the representation architecture. Thus, the improvements could arise from architectural regularization rather than information preservation itself.
-
Baseline comparisons are not fully controlled. MIP² has more parameters than the MLP baseline, while Q-Former uses a different tokenization strategy. Several comparisons also rely on previously reported results under different experimental settings.
Questions for authors
-
Can the authors demonstrate that existing projectors actually lose task-relevant molecular information, and that such information loss negatively affects downstream performance?
-
Can the authors isolate the benefit of exact recoverability from other architectural factors through more controlled, parameter-matched comparisons?
3 comments
Thank you for your detailed rebuttal. Your responses have addressed my concerns, and I have updated my score to 3.
Thank you.
Thanks for your follow-up. We appreciate your insightful comments. Clarifying the importance of exact recoverability is essential for justifying our motivation. We will incorporate the additional results into the camera-ready version. Again, thank you for your constructive feedback.
Thank you for recognizing the mathematical guarantee and experimental coverage. Hope our response could address your concerns.
W1 and Q1: Task-relevant information retention and downstream utility
The submission already includes a controlled intervention demonstrating downstream use of the preserved channel. Specifically, Section 3.5, in the paragraph “Inference-time intervention on the two branches,” and Fig. 2(c) report the effect of removing the preserved branch while keeping all trained weights fixed and matching molecular embedding RMS. MoleculeQA accuracy drops from 71.28% to 58.76%. This intervention demonstrates that the trained model uses the preserved information for molecular prediction, extending the evidence beyond numerical feature recovery.
To directly examine existing projectors, we additionally train independent feature decoders and linear probes on their frozen representations, using held-out molecules and matched decoder capacity and training budgets. All reconstruction results below use independently trained decoders, providing a common evaluation protocol across projectors.
MIP² achieves lower reconstruction error for both modalities and stronger structural probe performance. Relative to MLP, it improves functional-group F1 by 5.25 percentage points, demonstrating improved accessibility of task-relevant molecular content under the same readout budget.
W2, W3, and Q2: Controlling architecture, capacity, and tokenization
Our constraint ablation changes only the complementary-subspace projection of the residual, with no change to the trainable architecture or parameter count:
(I−QQ⊤)Gϕ(u)⟶Gϕ(u).
Both variants retain the same reversible fusion, Q, Gϕ, dimensions, learned scales, QR updates, tokenization, attention, and training protocol. The comparison therefore isolates enforcement of the complementary-subspace constraint. Specifically, Q⊤r(u)=0 prevents nonlinear adaptation from overwriting the anchor coordinates.
We further match the MLP’s total projector parameter budget, including fusion, while retaining the same fusion architecture, atom-level tokenization, attention, and training configuration. We also evaluate an N-token Q-Former to match MIP²’s molecular token count.
MIP² exceeds the parameter-matched MLP by 1.55 percentage points and the N-token Q-Former by 4.25 points in mean total accuracy. Its advantage therefore persists under matched projector capacity and matched molecular token count.
The N-token Q-Former uses a trainable 600×768 query bank, activating the first N queries for a molecule with N heavy atoms. Its Q-Former, blending, LayerNorm, and output-projection architectures are retained, with their weights initialized directly from the released checkpoint. The first 8 queries are copied from the pretrained queries, additional queries are initialized by cycling these vectors with small, seeded Gaussian perturbations. All query embeddings are trainable, query padding is masked, and only valid outputs are passed to the LLM. This variant reuses the pretrained interface with an expanded query bank. We also retain the original eight-query checkpoint configuration as the established baseline.
Published baseline scores are explicitly identified as reference results, with their sources and original training regimes documented. Our projector-specific conclusions are supported by comparisons rerun under a unified training and evaluation protocol.
We respectfully hope you could increase your overall rating if our response have addressed your concerns.