- Rating
- 2(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes IMC-CLINIC, a post-training clipping-calibration method for analog in-memory computing (IMC) inference. The key idea is to optimize activation and weight clipping jointly using an analytical surrogate for MatMul output error that includes operand rounding/clipping error, accumulated clipping bias, and ADC quantization error. The method uses analytical gradients and an approximate Hessian in a safeguarded Newton-style solver. Experiments on four LLMs under an 8-bit weight/activation and 9-bit ADC IMC simulation show substantially better perplexity and zero-shot accuracy than a sequential weight/activation grid-search baseline, while reducing calibration time.
Critical strengths
Well-motivated formulation. Unlike conventional digital clipping calibration, activation and weight clipping in analog IMC jointly control both operand quantization error and output-referred ADC error. The proposed objective explicitly models this coupling, including the potentially coherent bias induced by clipping.
Critical weaknesses
-
Limited comparsion with direct empirical IMC-output-MSE optimization. The paper includes an ADC-aware alternating empirical-MSE search, but this comparison appears limited to one model and uses a relatively coarse coordinate-search procedure. A stronger matched comparison against direct empirical IMC-output-MSE optimization across models and under comparable evaluation budgets is necessary to substantiate the claim that the surrogate is both accurate and practically preferable.
-
Missing of calibrated circuit-level model covering important nonidealities in analog IMC. Inhernet hardware nonidealities, such as device variation, nonlinearity, ADC transfer-function mismatch, IR drop may alter both the output-error decomposition and the optimal clipping policy. The injected Gaussian-noise study is useful but does not fully establish robustness to realistic analog IMC behavior.
Questions for authors
-
Can the authors provide matched results against a stronger direct empirical optimizer of ADC-enabled IMC MatMul output MSE across all four evaluated models?
-
How sensitive are the selected clipping factors and the relative advantage over the baselines to nonidealities not represented by the current simulator, such as nonuniform ADC transfer curves, correlated or signal-dependent ADC noise, analog accumulation nonlinearity, and device mismatch?
4 comments
Response to Reviewer iah6 (References)
[1] Zhang, W., Ando, S., Chen, Y. C., & Yoshioka, K. (2025). Asim: Modeling and analyzing inference accuracy of sram-based analog cim circuits. IEEE Transactions on Very Large Scale Integration (VLSI) Systems.
[2] Zhang, H., Bai, Y., Shen, J., Du, Y., & Du, L. (2024). Linearity performance of charge domain in-memory computing: Analysis and calibration. Integrated Circuits and Systems, 1(1), 43-52.
Response to Authors
Thank you for the detailed response and for extending the comparison with the ADC-aware empirical-MSE alternating-search baseline to all four evaluated models.
The strengthened comparison is helpful. In particular, using the same calibration data and IMC configuration, increasing the search resolution from 11 to 21 points, and reporting both downstream accuracy and calibration speed provide a more meaningful evaluation of the proposed analytical surrogate and optimizer. The reported results suggest that IMC-CLINIC is competitive with, and often preferable to, the stronger direct empirical-search baseline under the evaluated simulation setting.
However, my second concern is not yet fully addressed in the current response. The original experiments appear to use a particular IMC simulator/noise model, whereas practical analog IMC systems can exhibit additional effects, including nonuniform or nonlinear ADC transfer characteristics, correlated or signal-dependent ADC noise, analog accumulation nonlinearity, IR drop, and device mismatch. The response states that the method provides robustness benefits under “extensive nonidealities,” but it does not specify which additional nonidealities were evaluated, their parameter ranges, whether the clipping factors were re-calibrated under each setting, or the corresponding quantitative comparison against the baselines.
To substantiate the robustness claim, I encourage the authors to include a clearly documented sensitivity/robustness study covering at least several nonidealities not represented by the original simulator. This study should report the perturbation models and magnitudes, the calibration protocol, and the relative performance of IMC-CLINIC and relevant baselines. If such experiments are beyond the scope of the revision, the claims should be appropriately narrowed to the evaluated IMC noise and ADC model.
Overall, the expanded empirical-optimizer comparison substantially addresses my first concern. My remaining assessment depends primarily on clarification and evidence regarding robustness to broader analog IMC nonidealities.
Response to Reviewer iah6
We thank the reviewer for acknowledging that our additional ADC-aware empirical-MSE comparisons help clarify the optimization efficiency of IMC-CLINIC.
We also appreciate the request for more explicit details on analog IMC nonidealities. These experiments are included in Appendix H.2 of the revised manuscript, but our previous response did not sufficiently summarize their settings and quantitative results. We clarify them below.
Robustness to Analog IMC Nonidealities (Appendix H.2).
We extend our simulator to separately evaluate eight nonidealities, including MAC/ADC gain and offset variations, ADC integral nonlinearity (INL), static device mismatch, spatially correlated noise, and signal-dependent noise.
Importantly, all clipping factors are calibrated only once under nominal conditions and held fixed throughout the nonideality sweeps, without recalibration or modification of the analytical surrogate. This directly evaluates robustness to previously unmodeled hardware perturbations. The following results report WikiText-2 perplexity (PPL), where lower is better:
| Nonideality | Perturbation | W/A Grid Search PPL | IMC-CLINIC PPL |
|---|---|---|---|
| Nominal | None | 19.12 | 12.27 |
| MAC gain variation | σ = 2% | 18.23 | 12.46 |
| MAC offset variation | σ = 0.1 LSB | 31.14 | 13.40 |
| ADC gain variation | σ = 2% | 17.64 | 12.61 |
| ADC offset variation | σ = 0.1 LSB | 32.19 | 13.33 |
| ADC integral nonlinearity (INL) | Peak = 0.5 LSB | 332.15 | 23.63 |
| Static device mismatch | σ = 4% | 19.90 | 12.78 |
| Spatially correlated analog noise | ρ = 0–1 | ~21.90 | ~12.65 |
| Signal-dependent analog noise | Coefficient = 0–2 | 21.90–22.13 | ~12.65 |
Across all evaluated perturbations, IMC-CLINIC consistently outperforms conventional W/A grid-search clipping. Notably, under 0.5-LSB ADC INL, IMC-CLINIC achieves a PPL of 23.63 versus 332.15 for W/A grid search, despite neither method being recalibrated for this nonideality. These experiments demonstrate that the accuracy advantage of IMC-CLINIC extends beyond the nominal Gaussian-noise model to a broader range of modeled hardware imperfections.
We emphasize that these are behavioral sensitivity studies rather than a fully silicon-calibrated circuit model. Our framework targets high-SNR IMC architectures with sufficiently linear MAC operations; detailed modeling of IR drop and substantial accumulation nonlinearity remains outside the present scope.
We hope these quantitative results and the clarified calibration protocol directly address the reviewer's concerns, and we appreciate the continued feedback.
Response to Reviewer iah6
We thank the reviewer for recognizing the motivation and mathematical formulation of IMC-CLINIC, and we appreciate the suggestions related to the strength of the experimental validation.
The two concerns are (1) the realism of analog IMC nonidealities of our simulation and (2) the comparison against our own stronger ADC-aware optimization baseline.
In response, we strengthen our evaluation along both points. The additional results below show that IMC-CLINIC (1) further provides robustness benefits in the presence of extensive nonidealities, and (2) is both more accurate and faster compared to the strengthened baseline across models and workloads.
Extended Robustness Evaluation Under Analog IMC Nonidealities
We thank the reviewer for highlighting the importance of realistic analog IMC nonidealities. We agree that evaluating these effects is important for understanding the robustness and applicability of IMC-CLINIC.
Our original simulation follows prior studies showing that Gaussian noise can approximate certain nonidealities in SRAM-based analog IMC, with validation against silicon measurements [1]. Prior work also demonstrates that systematic gain and offset errors can be mitigated through hardware calibration [2].
To directly address the reviewer's concern, we have extended our simulator to separately model six additional nonidealities: residual MAC gain/offset errors, residual ADC gain/offset errors, ADC integral nonlinearity (INL), static device/column mismatch, correlated noise, and signal-dependent noise. These models capture a broader range of analog imperfections beyond the original additive Gaussian-noise assumption, including residual static hardware variation, affine MAC/ADC errors, ADC transfer-function nonlinearity, and random noise with spatial correlation or signal dependence.
We provide detailed modeling assumptions and experimental results in Appendix H.2. Across the evaluated conditions, IMC-CLINIC maintains its accuracy advantage over the baselines. In several high-severity cases, particularly large MAC/ADC offsets and ADC INL, the no-clipping and W/A grid-search baselines degrade substantially, whereas IMC-CLINIC exhibits smaller accuracy degradation. For example, under 0.1 LSB MAC offset variation, the PPL of IMC-CLINIC increases from 12.27 to 13.40, whereas that of W/A grid search increases from 19.12 to 31.14. These results provide additional evidence of robustness under the modeled nonidealities.
Finally, we clarify that IMC-CLINIC primarily targets high-SNR IMC architectures with sufficiently linear MAC operations (Appendix A.1). While the extended experiments cover several important nonidealities, they do not constitute a fully silicon-calibrated circuit model. Extending the analytical surrogate to architectures with substantial IR drop, device variation, or temporal drift may require technology-specific modeling and remains an important direction for future work.
Additional Experiments against the Strengthened Baseline
We thank the reviewer for emphasizing the importance of stronger ADC-aware baselines. We agree that these comparisons help distinguish the benefits of the IMC-aware objective from those of the optimization algorithm.
Our main-table comparisons focus on established methods to demonstrate improvements over prior work. To further isolate the optimization contribution, we extend the ADC-aware empirical-MSE alternating search to all four models, including a finer 21-point search (Appendix H.1). All methods use the same calibration data and IMC configuration, and are evaluated on WikiText-2 perplexity and seven commonsense reasoning tasks.
IMC-CLINIC achieves the best downstream accuracy on three of four models. On LLaMA-3.1-8B, the 21-point search performs only 0.23 percentage points better, within the observed seed variation. Meanwhile, IMC-CLINIC achieves geometric-mean calibration speedups of 4.90X and 8.50X over the 11-point and 21-point searches, respectively, excluding initialization.
Increasing the empirical search resolution from 11 to 21 points provides little additional downstream improvement, suggesting diminishing returns from finer search. Separately, we verify ε-optimality with respect to our analytical surrogate (Appendix G), supporting the effectiveness of the proposed optimizer.
Together, these results demonstrate that IMC-CLINIC achieves competitive or better downstream accuracy than direct ADC-aware empirical optimization, while substantially reducing calibration cost.
We want to emphasize that our central contribution lies in the joint analytical formulation of operand and ADC errors and the development of an efficient optimization algorithm. With the additional evidence addressing the two experimental concerns, we believe now this will allow the reviewer to reassess our central contribution. We thank for the review again and welcome any further feedback.