- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes COMPASS, an adaptive gray-box membership inference attack against vision large language models (VLLMs). The authors investigate model sensitivity to Gaussian image perturbations across a wide range of noise magnitudes and observe that the direction and strength of membership signals vary across model–dataset pairs. In particular, small perturbations can produce a regime where members exhibit lower output divergence than non-members, contrary to the behavior observed under larger perturbations. Based on this observation, COMPASS calibrates the perturbation magnitude and membership-score orientation using an unlabeled target set and a known non-member reference set. Two variants are developed using Rényi-normalized KL divergence and Rényi divergence, combined with max-k aggregation. Experiments on LLaVA-1.5, MiniGPT-4, and HuluMed-32B demonstrate improvements over several existing membership inference baselines on general-domain and medical-image datasets.
Critical strengths
-
The paper systematically investigates how membership signals change across Gaussian noise magnitudes and identifies a low-noise regime in which members exhibit lower output divergence than non-members. The observation that both the optimal noise magnitude and membership-score orientation vary across model–dataset pairs provides a useful perspective on perturbation-based membership inference for VLLMs.
-
COMPASS introduces a reference-guided mechanism that selects the perturbation magnitude and score orientation without requiring labeled members in the target set. The evaluations cover different model architectures and training stages, including a medical-domain model. The reported improvements, particularly the AUC of 0.88 on LLaVA's instruction-tuning data and 0.64 on the medical dataset, suggest that adaptive perturbation analysis can provide stronger membership signals than the evaluated fixed-configuration baselines.
Critical weaknesses
1. The reliability of the proposed calibration mechanism under realistic membership distributions and reference-set shifts is insufficiently established.
The core contribution of COMPASS is its ability to infer both the optimal perturbation magnitude and score orientation from an unlabeled target set and a known non-member reference set. However, this procedure relies on the assumption that the non-member component of the target set and the reference set exhibit sufficiently similar divergence responses. Appendix D.2 explicitly shows that the observable calibration gap contains both the membership signal and a reference-distribution discrepancy term. When the member proportion is small or the reference distribution differs substantially, the discrepancy may dominate the signal, potentially causing incorrect noise selection or score orientation.
Importantly, the experiments use balanced target sets with a member proportion of 0.5, whereas realistic membership inference often involves much lower and unknown member prevalence. The paper does not systematically evaluate how calibration behaves under varying membership proportions, target-set sizes, or reference-set distributions. Although Appendix D.2 claims robustness to reference-set shifts, the cited Figure 4 primarily compares estimated and oracle noise levels rather than providing an explicit reference-distribution shift study. Since calibration is the central component of COMPASS, its reliability beyond the balanced evaluation setting remains insufficiently demonstrated.
2. The experimental design does not adequately rule out numerical artifacts, dataset-source confounding, or advantages arising from unequal baseline calibration.
First, the strongest membership signals frequently occur under extremely small Gaussian perturbations. According to Eq. (5), perturbations are applied to images represented in the 0–255 intensity range, while the low-noise regime includes standard deviations far below one intensity level. Such perturbations may be sensitive to floating-point precision, image quantization, and preprocessing implementations. The paper does not establish whether the observed membership signals persist under standard image representations or alternative preprocessing pipelines. This raises questions about whether the low-noise behavior reflects stable model-level membership information or implementation-dependent numerical effects.
Second, the medical evaluation constructs members and non-members from different datasets, PubMedVision and EndoBench. Appendix E reports that a blind classifier achieves an AUC of 0.954 before filtering, indicating substantial source differences. Although the authors filter the data to reduce this discrepancy, a single ResNet-18-based diagnostic does not fully exclude residual source-specific signals. Independent source-matching controls would strengthen the attribution of the reported AUC improvement to membership rather than dataset characteristics.
Finally, COMPASS benefits from adaptive noise selection, score-orientation calibration, and multiple divergence configurations, while the baselines are evaluated under more restricted settings. For example, Aug-KL achieves an AUC of 0.42 on the medical dataset, which would become 0.58 under score inversion alone. Therefore, part of the reported improvement may arise from calibration rather than the proposed divergence measures themselves. The absence of systematically calibrated baselines and component-wise ablations makes it difficult to isolate the actual contribution of COMPASS.
Questions for authors
-
All reported target sets use a balanced member-to-non-member ratio. How does COMPASS perform when the actual member proportion is substantially lower, such as 1%, 5%, or 10%?
-
How sensitive are the selected noise magnitude and score orientation to the reference-set distribution? Can the authors provide controlled experiments using reference sets with different levels of distributional mismatch?
-
Since calibration uses aggregate divergence statistics from the unlabeled target set, how many target samples are required for reliable noise-level and score-orientation estimation?
-
The low-noise regime includes perturbations much smaller than one intensity level in the 0–255 image domain. Do the reported membership signals persist after 8-bit quantization, image re-encoding, or changes in preprocessing precision?
-
What are the separate contributions of noise-level selection, score-orientation calibration, Rényi normalization, and max-k aggregation? Can the authors provide an ablation that progressively introduces these components?
-
Appendix B.2 reports approximately 12 hours to collect 32 noise-level measurements for a 600-sample LLaVA evaluation on an H200 GPU. How does this calibration cost scale with model size and dataset size, and how practical is the attack when only a small number of candidate images are available?