- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes ElectrolyteFM for predicting multiple electrolyte properties. It combines property-specific experts, a shared expert pool, formulation–property-conditioned routing, and residual adapters to exploit cross-property information while mitigating negative transfer. Experiments on Electrolyte12 and an independent sodium-electrolyte dataset demonstrate competitive prediction performance and promising generalization.
Critical strengths
- The paper tackles an important problem in electrolyte formulation design by developing a unified framework for predicting multiple physicochemical properties.
- The directed cross-property transfer analysis reveals beneficial, harmful, and asymmetric transfer effects among the 12 electrolyte properties, which provides empirical motivation for selective knowledge sharing.
- ElectrolyteFM integrates property-specific experts, a shared expert pool, formulation–property-conditioned routing, and residual adapters to combine shared and property-specific knowledge.
- Experiments on Electrolyte12 and an independent sodium-electrolyte dataset show competitive multi-property prediction performance and promising zero-shot generalization, with few-shot adaptation further improving predictive performance.
Critical weaknesses
- ElectrolyteFM, although designing exclusive branches to store common knowledge and property-specific knowledge respectively, still enables these branches to learn redundant representation automatically. One cannot tell how much these branches are learning complementary representation instead of redundant one.
- SpKL and ShKL pursue individual objectives and contain individual differentiable parts, which makes disentangling individual property learning and cross-property knowledge sharing challenging.
- Such directed transfer scores on the test set encourage designing the following framework. However, such results may not indicate how to design our model and select hyperparameters, which could lead to test-set leakage.
- Such ablation studies are unable to well illustrate how our formulation–property-conditioned router can minimize negative transfer.
- The multi-task learning bases MMoE (2018) and PLE (2020) may not represent the state-of-the-art methods. Adding state-of-the-art techniques as baselines would make our comparison more complete.
Questions for authors
- Further analysis is needed to determine whether the shared and property-specific branches learn complementary representations or merely redundant ones.
- Controlled experiments under identical training conditions are needed to isolate the respective contributions of SpKL and ShKL.
- The authors should clarify whether the directed transfer scores computed on the test set influenced model design or hyperparameter selection, and explain how potential test-set leakage was avoided.
- Comparisons with fixed routing and property-only routing are needed to better establish that the formulation–property-conditioned router effectively mitigates negative transfer.
- Comparisons with more recent multi-task learning methods are needed to better establish the advantages of ElectrolyteFM over existing approaches.
6 comments
Q4: Routing and Negative Transfer (W4/Q4)
A4: Thank you for the question. We clarify that negative-transfer mitigation arises from the combined SpKL–ShKL–S2SKF framework, rather than routing alone. SpKL preserves independently learned property-specific knowledge, ShKL captures reusable cross-property information, and S2SKF integrates them through frozen residual fusion. The grouped results in Table 11 provide supporting evidence.
To isolate the router's contribution, we additionally compare four routing strategies:
| Routing Strategy | Macro NMAE ↓ |
|---|---|
| Formulation + Property (Ours) | 0.1569 ± 0.0002 |
| Formulation-Only | 0.1579 ± 0.0014 |
| Property-Only | 0.1592 ± 0.0014 |
| Uniform Weights | 0.1586 ± 0.0017 |
Property-only uses , while uniform routing uses fixed weights . All strategies follow the same data splits and validation-based model selection protocol.
The full formulation–property-conditioned router achieves the lowest mean error. Notably, property-only routing does not outperform uniform routing, whereas incorporating formulation information yields better average performance. This supports the value of input-dependent expert allocation beyond fixed property preferences.
Thus, we attribute negative-transfer mitigation to the overall knowledge learning and fusion framework, while the routing ablation demonstrates the additional predictive benefit of formulation–property conditioning.
We have revised our paper and added the above results to Appendix G.5 (Table 18), including routing protocols; grouped results are included in Appendix F.1 (Table 11).
Q5: Recent Multi-Task Baselines (W5/Q5)
A5: Thank you for the suggestion. MMoE and PLE are representative expert-sharing architectures, and our original paper already includes recent electrolyte-specific prediction methods. To broaden the multi-task comparison, we additionally evaluate FairGrad (ICML 2024) and PIVRG (CVPR 2025), which address multi-task optimization from a different perspective.
| Method | Macro NMAE ↓ | OOD MAE (mS/cm) ↓ |
|---|---|---|
| STL | 0.1669 ± 0.0014 | 3.233 ± 0.357 |
| MMoE (2018) | 0.1627 ± 0.0013 | 3.407 ± 0.652 |
| FairGrad (2024) | 0.1610 ± 0.0026 | 3.428 ± 0.701 |
| PIVRG (2025) | 0.1618 ± 0.0023 | 3.491 ± 0.789 |
| PLE (2020) | 0.1611 ± 0.0001 | 2.731 ± 0.080 |
| ElectrolyteFM (Ours) | 0.1569 ± 0.0002 | 2.591 ± 0.227 |
ElectrolyteFM achieves the lowest mean error on both metrics, outperforming the additional recent multi-task baselines on Electrolyte12 and maintaining competitive generalization on the independent sodium-electrolyte dataset.
Across five paired seeds, its Macro NMAE improvement over FairGrad is 0.00409 ± 0.00277, providing further evidence of its average predictive advantage across different random seeds.
These comparisons extend our evaluation beyond classical expert-sharing architectures and support the effectiveness of staged knowledge learning and fusion relative to recent multi-task optimization approaches.
We have revised our paper and added the above results to Appendix G.1 (Table 14).
References
- Ma et al. Modeling Task Relationships in Multi-task Learning with Multi-gate Mixture-of-Experts. KDD, 2018.
- Tang et al. Progressive Layered Extraction (PLE). RecSys, 2020.
- Ban & Ji. Fair Resource Allocation in Multi-Task Learning. ICML, 2024.
- Qin et al. Revisiting Fairness in Multitask Learning: A Performance-Driven Approach for Variance Reduction. CVPR, 2025.
Dear Reviewer,
As the rebuttal and discussion process draws to a close, we would like to emphasize the importance of addressing any outstanding points before the deadline. Please ensure that the authors’ responses have been considered and share any final observations while the discussion remains open.
Thank you for your valuable time and engagement.
Thank you for the review. We address your concerns through additional representation analyses, controlled ablations, and comparisons with recent multi-task learning methods. Unless otherwise specified, results are reported as mean ± SD over five seeds.
Q1: Representation Complementarity (W1/Q1)
A1: Thank you for the question. We conducted a linear CKA analysis on the same validation samples:
These results indicate representational differences while retaining some overlap. Importantly, our objective is predictive complementarity rather than strictly disentangled representations. The full model outperforms either branch alone (Table 4), suggesting that combining the two representations provides additional predictive value beyond either individual branch.
Together, the CKA analysis and predictive ablations support the usefulness of learning and integrating property-specific and shared knowledge.
Q2: Contributions of SpKL and ShKL (W2/Q2)
A2: Thank you for the question. As detailed in Sections 3.3–3.5, SpKL independently learns property-specific representations from single-property supervision, while ShKL learns shared experts using multi-property supervision. During S2SKF, both learned branches are frozen, and only the residual adapters and prediction heads are optimized. This design separates the optimization of property-specific and shared knowledge without requiring strictly disentangled representations.
We evaluate their individual and combined predictive contributions through branch ablations. Table 4 shows that the full model outperforms either branch alone. We further repeated this comparison over five seeds (Appendix G.2, Table 15):
Relative to STL, their Macro NMAE changes are +11.25%, −0.90%, and −5.99%, respectively. Although ShKL alone improves aggregate performance, the full model achieves further gains and outperforms STL on 9/12 properties, compared with 4/12 for ShKL. This indicates that shared-to-specific fusion benefits a broader range of properties rather than merely improving the aggregate metric.
To further examine the staged learning strategy, we compare it with direct joint optimization under the same final architecture. Even after 60 epochs, joint optimization underperforms staged training on both ID (0.1615 vs. 0.1569) and OOD (3.397 vs. 2.591 mS/cm).
Unlike joint optimization, our approach preserves independently learned property-specific representations while integrating shared knowledge through frozen residual fusion. These results support the contributions of both branches and the effectiveness of staged learning.
Please refer to Section 4.4.2 (Table 4) and Appendix F.2 (Table 12) for more details. We have added the above new five-seed results in Appendices G.2–G.3 (Tables 15–16).
Q3: Directed Transfer Analysis and Potential Test-Set Leakage (W3/Q3)
A3: Thank you for raising this concern. We clarify the role of the directed transfer analysis and its relationship to ElectrolyteFM's development.