- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes UniGame, a framework for consolidating multiple game-specific LoRA experts into a unified model through shared–specific parameter decomposition. The method consists of three components: Cross-Game Subspace Sharing (CSS), which extracts reusable adaptation directions; Game-Conditioned Effect Projection (GEP), which preserves game-specific transformations; and Private Residual Adaptation (PRA), which compensates for information not captured by the shared subspace. UniGame operates on independently trained experts without requiring joint multi-game training. Experiments across five board and card games demonstrate a 40% reduction in adapter parameters while largely preserving specialist gameplay performance. Additional ablations and representation analyses investigate the contributions of the proposed components.
Critical strengths
- Practical and efficient expert consolidation. UniGame addresses a relevant deployment challenge by consolidating independently trained game specialists without requiring additional gameplay training. The reported 40% reduction in adapter parameters while maintaining near-specialist performance demonstrates the practical value of the approach.
Critical weaknesses
- Limited methodological novelty. The proposed shared–specific LoRA decomposition is closely related to existing approaches such as LiLoRA [1] and Compress then Serve [2]. The paper does not sufficiently establish its distinctive algorithmic contributions or provide direct comparisons with closely related methods, limiting its novelty.
- Insufficient evidence for cross-game sharing. The same-budget Pure-private baseline achieves comparable gameplay performance and better offline policy fidelity. Without statistical comparisons against this baseline, it remains unclear whether cross-game sharing provides a meaningful advantage over independent adapter compression, weakening the paper's central empirical claim.
References
[1] Che, C., et al. "LoRA in LoRA: Towards Parameter-Efficient Architecture Expansion for Continual Visual Instruction Tuning." Proceedings of the AAAI Conference on Artificial Intelligence, 2026. https://doi.org/10.1609/aaai.v40i24.39082
[2] Br̈uel-Gabrielsson, R., et al. "Compress then Serve: Serving Thousands of LoRA Adapters with Little Overhead." Proceedings of the 42nd International Conference on Machine Learning (ICML), 2025. https://proceedings.mlr.press/v267/gabrielsson25a.html
Questions for authors
- Methodological novelty: What are the key algorithmic differences between UniGame and existing approaches such as Compress then Serve and Compress then Merge, beyond their different application settings?
- Effectiveness of cross-game sharing: Can the authors provide paired statistical comparisons against the same-budget Pure-private baseline to establish whether cross-game sharing yields meaningful performance improvements?
- Experimental consistency: Why do Table 4 and Table 8 report different Riichi Mahjong results (34.50% vs. 39.40%) for the activation-weighted configuration? Were different checkpoints or evaluation protocols used?
3 comments
W2 and Q2: Does sharing outperform the same-budget Pure-private baseline?
Response to W2 and Q2: The current experiments do not establish that advantage. Pure-private sets shared rank to zero and independently applies truncated SVD under the same uniform Frobenius objective. At 26.15M, its private ranks are [5,5,5,4,5] for [DDZ, Limit, Leduc, Riichi, Guandan]. Its paired differences appear in Table S1. All formal intervals at 26.15M and 34.87M include or touch zero; at 17.43M, Guandan favors Pure-private by 5.00 pp and Limit/rule by 0.0206 Table S2.
The existing and additional controls answer narrower questions. Appendix A.5.5 and Table 12 already report 85.32% explained energy for a leave-one-game-out basis, versus 79.37% for a single-source basis and 65.43% for a random basis (p. 19, L982–1013). They specify target-game calibration and interpret these as recoverability results. The participation discussion likewise excludes direct gameplay claims (Sec. 4.3, p. 9, L467–475). UniGame's Leduc/rule gains over equal-budget Shared-only are +0.4091 [0.3673, 0.4515] at 17.43M and +0.1340 [0.1102, 0.1583] at 26.15M. These support private-capacity allocation within a shared representation, not an advantage of sharing over independent compression. We therefore present sharing as a representation choice with measured trade-offs.
Table S1. Main-table paired differences
Differences are UniGame minus each column comparator. Brackets show paired 95% cluster-bootstrap intervals. Win/Top-2 differences use percentage points; poker differences use native payoff units. See the evaluation and selection protocol for resampling units and scope.
| Primary metric | Source 43.58M | Pure-private 26.15M | S+P 26.15M | S+P 34.87M |
|---|---|---|---|---|
| DDZ/WP | +0.70 [-0.90, 2.30] | +1.00 [-0.30, 2.30] | +0.70 [-0.90, 2.30] | +1.20 [-0.10, 2.60] |
| Limit/teacher | +0.0046 [-0.0029, 0.0117] | +0.0030 [-0.0034, 0.0094] | -0.0097 [-0.0234, 0.0044] | +0.0041 [-0.0031, 0.0110] |
| Leduc/rule | 0 [0, 0] | 0 [0, 0] | 0 [0, 0] | 0 [0, 0] |
| Riichi/v4 | -0.80 [-4.80, 3.20] | -2.40 [-6.20, 1.40] | +3.00 [-1.60, 7.60] | +0.40 [-3.40, 4.20] |
| Guandan/Koi | +0.50 [-3.25, 4.25] | +1.00 [-2.25, 4.50] | +2.00 [-1.25, 5.25] | +1.75 [-1.00, 4.75] |
Q3: Why do the activation-weighted Riichi entries differ between Tables 4 and 8?
Response to Q3: The verified activation-weighted Riichi result is 39.40% (197/500), as reported in Appendix Table 8 (p. 16, L811–822). Table 4 incorrectly prints 34.50% for “Shared basis, activation” in the Riichi column (p. 8, L410–416). The basis_activation record gives 197/500, versus uniform's 190/500 = 38.00%, on seeds 62000–62124, seed key 20260907, with four seats per seed.
We will correct the Table 4 entry to 39.40% and replace the accompanying statement that uniform fitting outperforms activation weighting on Riichi (p. 8, L402–405) with Table 8's observed +1.40 pp [−2.40, 5.20] activation-minus-uniform comparison. This does not establish a statistically significant advantage.
The separate readout comparison in Table S7 also contains a 39.40% Shared B + private result and a 34.50% Pure-private Guandan result. These are different configurations and records; their attribution does not by itself explain the printed Table 4 entry. The earlier 35.0%/Mortal v4 and 38.6%/release4p labels likewise concern separate matchups and do not relabel CtS's 38.6%/v4 result.
Table S7. Additional readout comparison: configuration–game–opponent–metric attribution
| Configuration (approximately 26.15M) | Riichi / Mortal v4 / Top-2 | Guandan / Koi / win rate |
|---|---|---|
| UniGame | 38.00% | 35.50% |
| Shared B + private | 39.40% | 35.00% |
| Pure-private | 40.40% | 34.50% |
The 39.40% Shared B + private entry belongs to this additional readout comparison; this table does not resolve the printed manuscript Table 4 discrepancy by itself. A separate activation-weighted shared-basis run also gives 39.40% (197/500) versus uniform's 38.00% (190/500); those are distinct configurations and records. The 34.50% entry above is Pure-private's Guandan win rate; GEP Shared matrix, activation independently also reports 34.50% on Guandan. Riichi values are Top-2 rates, not first-place rates.
Thank you again for your time and thoughtful feedback on UniGame. We would like to kindly follow up on our response and would be grateful to hear whether it has helped address your concerns, when you have a chance.
If any questions remain or further clarification would be helpful, we would be happy to provide it. We sincerely appreciate your time and consideration.
We thank the reviewer for focusing on the closest methods and the evidence specifically attributable to sharing.
W1 and Q1: What are the algorithmic differences from LiLoRA, CtS, and CtM?
Response to W1 and Q1: UniGame fits Tg≈BgAs+CgDg to frozen source updates under a storage budget. Its independent private residual can represent directions outside the shared input row space. LiLoRA uses a nested form (B0+Bg′Ag′)A and continual training; task-specific changes pass through shared A. CtS uses shared left/right factors USgVT with task-specific cores. CtM aligns and merges task coordinates into one update, whereas UniGame retains game-conditioned updates. Section 2 already discusses CtS and MoDE (p. 3, L148–154). The representation and its limits are specified in Eqs. (3) and (5), with derivations in Appendix A.2.1–A.2.4 (p. 13, L648–701). The contribution is this budget-constrained formulation and analysis; standard SVD is not itself a novelty claim.
The direct CtS experiment is new evidence beyond that related-work discussion: we reproduced single-cluster JD-Full at 26.146688M parameters, versus 26.148864M for UniGame. Table S3 gives all five primary metrics. The clearest gain is in Leduc: +0.5504 [0.5128, 0.5888] against rule, with positive pointwise intervals against three additional opponents (Table S4). Limit/rule improves by +0.0285 [0.0195, 0.0375]; the other primary-game intervals include zero. This is a specific advantage over the tested CtS configuration, not a cross-game superiority result. Exact ranks, fitting settings, and the new artifact-consistency checks appear in Table S6 and its accompanying text.
Table S3. Primary-game UniGame–CtS comparison
Intervals are paired 95% cluster-bootstrap intervals; resampling units and evaluation scope are specified in the evaluation and selection protocol.
Table S4. UniGame–CtS Leduc comparison across opponents
Rule/teacher use 5,000 paired seeds each; random/20%-randomized DQN use 1,000 each, with two seats. Additional Limit/rule improves by +0.0285 [0.0195, 0.0375]; both added Limit-opponent intervals include zero. For context, at 17.43M UniGame–Shared-only against random Limit is -0.144 [-0.265, -0.0285], illustrating opponent-dependent effects.