acceptodds
Withdrawn from ICLR 2027

Defending Wearable VLMs Against Private Attribute Inference

Withdrawn from ICLR 2027, so left out of the paper lists and the map.

Abstract

Split vision-language model (VLM) assistants may transmit visual tokens from a trusted edge device to a downstream language model. These tokens support the user's requested task but can also encode private attributes of the wearer or nearby people. A source model that avoids stating those attributes may still expose them through its transmitted tokens to a newly trained attacker. We study this privacy–utility tension using a paired benchmark of 3,221 image-question records from Reddit posts and converted VQA datasets. Each record has a utility question and available evidence-supported labels for location, income, sex/gender, or interests. The benchmark is a single-image proxy for wearable assistance, not smart-glasses footage or continuous first-person video. We propose Token-Guided Attribute Privacy (TGAP), a lightweight residual adapter that transforms post-resampler visual tokens inside the trusted boundary before transmission while keeping the source VLM frozen. Its objective combines utility preservation and identity regularization with source-model privacy suppression and an auxiliary private-attribute decoder that acts on token representations. On MiniCPM-V, TGAP reduces source-model privacy accuracy from 56.7% to 7.4%, a 49.3% reduction, while relaxed utility changes from 76.6% to 74.4%. Separately, fresh attacker bridges and heads trained directly on filtered tokens show lower average attribute recoverability across four frozen surrogate LLM families. These results support empirical mitigation at the token interface, while residual leakage and attacker-dependent outcomes remain.

Primary area:
alignment, fairness, safety, privacy, and societal considerations
Keywords:
vision-language models, multimodal privacy, private attribute inference, representation leakage, privacy-utility tradeoff, split inference, wearable AI

Reviews

Among:
Shape:
1234this paper, Bottom 10%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 1.67 over 3 reviews, above 10% of the others.
Reviewer_JsAGOpenReview ↗
Rating
2
Confidence
2
Informativeness
1
Presentation
2
Soundness
2
Read review
Paper summary

The paper proposes TGAP, a lightweight residual adapter applied to post-resampler visual tokens before transmission in a split VLM pipeline. With the source VLM frozen, the adapter is trained to preserve utility, suppress correct private-attribute answers, and increase the uncertainty of an auxiliary attribute predictor, while limiting changes to the original tokens. Evaluation on a paired privacy–utility benchmark shows improved trade-offs over hard token masking and attention masking in several model settings. Additional experiments assess attribute recovery by separately trained attackers with frozen LLM backbones.

Critical strengths

The proposed post-resampler token modulation offers a lightweight way to reduce measured privacy leakage while preserving utility-task performance in several evaluated settings. The paper evaluates both semantic and representation leakage. Compared with hard masking and attention masking, TGAP achieves better privacy–utility trade-offs in several evaluated settings.

Critical weaknesses

1. Limited methodological novelty

TGAP combines utility preservation, private-label suppression, entropy maximization, and representation manipulation. These ideas have substantial precedents: MaxEnt-ARL uses entropy-based privacy suppression, STPrivacy modifies visual token embeddings, and Shredder learns perturbations while freezing the pretrained network. The authors should clarify the technical novelty.

References:

  • Roy and Boddeti. Mitigating Information Leakage in Image Representations: A Maximum Entropy Approach. CVPR 2019. Paper · Code
  • Li et al. STPrivacy: Spatio-Temporal Privacy-Preserving Action Recognition. ICCV 2023. Paper · Code
  • Mireshghallah et al. Shredder: Learning Noise Distributions to Protect Inference Privacy. ASPLOS 2020. Paper

2. Insufficient baseline comparisons

The main comparisons use hard masking and attention masking. Neither learns a transformation under comparable supervision. Stronger comparisons should adapt learned representation defenses and learned-noise methods to the same interface, with matched training budgets and attacker protocols.

Appendix E.7 provides additional controls, but does not establish a matched comparison with learned token-space defenses.

Relevant baselines:

3. Limited wearable validity

The benchmark consists of single images from Reddit and VQA datasets, which do not adequately capture continuous, first-person wearable use. Consequently, the evaluation leaves temporal privacy accumulation untested. Although the paper acknowledges this proxy setting, a fixed, reproducible evaluation set and experiments on real wearable sequences are needed to substantiate claims about wearable deployment.

4. Restricted attacker adaptation

The adaptive attacks freeze the LLM backbone and train only the bridge and prediction head, limiting the attacker’s adaptation capacity. The authors should also evaluate attacks that adapt the backbone through LoRA to assess whether the privacy gains persist against a stronger attacker.

Reference:

  • Hu et al. LoRA: Low-Rank Adaptation of Large Language Models. ICLR 2022. Paper · Code

5. Inconsistent statistics in Table 4

Table 4 reports mean ± standard deviation over three seeds, but several entries are mathematically incompatible with three nonnegative scores. For three such scores, the sample standard deviation cannot exceed sqrt(3) times the mean. Phi-3.5-V TGAP P.Cont is 0.002 ± 0.012, which violates this bound even after accounting for rounding. Other violations include Phi-3.5-V TGAP P.Acc (0.061 ± 0.134), P.Rel (0.006 ± 0.015), and P.WR (0.003 ± 0.013), as well as InternVL2.5 TGAP P.Cont (0.013 ± 0.036). The authors should release the per-seed scores and aggregation code, explain these discrepancies, and correct the table.

Questions for authors

Please refer to the weakness.

Reviewer_EAHcOpenReview ↗
Rating
2
Confidence
3
Informativeness
2
Presentation
3
Soundness
2
Read review
Paper summary

This paper investigates private-attribute inference risks in split vision-language models, where intermediate visual tokens transmitted from trusted devices may reveal sensitive information. The authors propose Token-Guided Attribute Privacy (TGAP), a lightweight residual adapter that modifies visual tokens before transmission while keeping the VLM backbone frozen. TGAP combines utility preservation, identity regularization, semantic privacy suppression, and an auxiliary private-attribute decoder to reduce privacy leakage. The paper also introduces a paired privacy–utility benchmark and evaluates the method across multiple VLMs. Experimental results demonstrate substantial reductions in source-model privacy accuracy on some models while largely preserving utility, with additional evaluations showing reduced attribute recoverability under several external attackers.

Critical strengths
  1. The paper addresses an important privacy risk in split VLM systems by distinguishing semantic leakage from representation-level leakage. This distinction is valuable because preventing the source model from disclosing sensitive attributes does not necessarily prevent their recovery from intermediate visual representations.

  2. TGAP demonstrates substantial privacy reductions with relatively limited utility degradation on MiniCPM-V. The inclusion of freshly trained external attackers provides additional evidence beyond source-model output suppression and strengthens the empirical evaluation.

Critical weaknesses
  1. TGAP largely combines established residual adapters, adversarial privacy objectives, and regularization techniques. Its advantages over standard privacy-preserving representation learning methods are not sufficiently established. Moreover, the ablation results suggest that semantic privacy suppression accounts for most of the improvement, while the claimed contribution of image-driven representation suppression is not directly validated through adaptive attacker ablations.

  2. The benchmark relies on Reddit images and conventional VQA datasets rather than actual wearable-device data. Some private-attribute labels are supported by associated text rather than necessarily recoverable from the image itself, raising concerns about the interpretation of privacy accuracy. Additionally, the main token-level baselines are relatively simple, and the adaptive attackers keep their LLM backbones frozen. Stronger matched baselines and attack evaluations are needed to support the broader privacy claims.

Questions for authors

1.Can the authors compare TGAP against a parameter-matched adversarial representation learning baseline under the same training and evaluation settings?

2.How much does the image-driven privacy objective improve resistance to freshly trained external attackers? Can the authors provide corresponding representation-level ablation results?

3.What proportion of the privacy labels can be inferred from image evidence alone, without relying on associated text or metadata? Are the reported results consistent on this subset?

Reviewer_iSQEOpenReview ↗
Rating
1
Confidence
3
Informativeness
2
Presentation
2
Soundness
1
Read review
Paper summary

This paper investigates private-attribute leakage from intermediate visual tokens in split vision-language model (VLM) systems, motivated by wearable AI assistants. The authors argue that preventing a VLM from explicitly disclosing private information does not necessarily prevent an external attacker from recovering the same information from transmitted visual representations.

To address this problem, the paper proposes Token-Guided Attribute Privacy (TGAP), a lightweight residual adapter inserted after the visual resampler. The original VLM remains frozen, while TGAP is optimized using a combination of utility preservation, identity regularization, semantic privacy suppression, and representation-level private-attribute suppression.

The authors also construct a paired privacy–utility benchmark containing 3,221 image-question records with available annotations for location, income, sex/gender, and interests. Experiments are conducted on five open-source VLMs, with additional adaptive-readout attacks using four surrogate model families. The reported results suggest reductions in source-model privacy disclosure and lower attribute recoverability from filtered visual tokens, with varying degrees of utility preservation across architectures.

Critical strengths
  1. Relevant and well-motivated privacy problem.

The paper addresses an important issue in split VLM inference: intermediate visual representations may reveal private information even when the source model does not explicitly disclose it. Distinguishing semantic disclosure from representation-level attribute recovery is a meaningful formulation for privacy protection at the visual-token interface.

  1. Evaluation beyond source-model refusal behavior.

The authors do not rely exclusively on measuring whether the original VLM answers private-attribute questions. They additionally evaluate freshly trained attacker bridges and prediction heads operating directly on filtered visual tokens. The inclusion of paired privacy–utility evaluation, objective ablations, annotation audits, and cross-model experiments is also valuable.

These are meaningful strengths of the experimental design. However, the reliability and generality of the reported conclusions are substantially weakened by the issues discussed below.

Critical weaknesses
  1. Serious numerical inconsistencies and insufficiently independent performance evaluation.

My primary concern is that several statistical results reported in Table 4 are mathematically inconsistent with the stated evaluation procedure.

Table 4 explicitly reports mean ± standard deviation over three seeds. However, several reported metrics cannot arise from three non-negative observations under this definition.

For example, the TGAP results for Phi-3.5-Vision include:

  • P.Acc: 0.061 ± 0.134
  • P.Cont: 0.002 ± 0.012
  • P.Rel: 0.006 ± 0.015
  • P.WR: 0.003 ± 0.013

For three non-negative observations with mean μ, the maximum possible sample standard deviation is sqrt(3) × μ.

Consequently, a mean of 0.002 cannot have a sample standard deviation of 0.012, since the theoretical maximum is approximately 0.00346. The other listed metrics also violate this constraint. These differences cannot be explained by ordinary rounding.

Similar inconsistencies appear in other rows, such as the InternVL2.5 TGAP results.

This raises a fundamental concern regarding the correctness of the reported statistical aggregation. It is unclear whether the values are incorrectly calculated, taken from different experimental populations, or reported using an undocumented aggregation procedure.

The issue is particularly important because the paper relies on multi-seed results to establish the robustness of its privacy–utility improvements across different VLM architectures.

A second concern is the evaluation protocol described in Appendix A, Table 9. The same 617-record validation split is explicitly used for both model selection and reporting source-model performance.

Using the model-selection validation set as the final evaluation set introduces potential selection bias, particularly when checkpoints or hyperparameters are chosen based on validation performance. Repeating the procedure across three seeds does not provide an independent final test set.

Furthermore, the dataset contains Reddit-derived records, but the paper does not sufficiently establish whether related posts, repeated images, or records associated with the same author can appear across training and validation partitions. This does not demonstrate actual data leakage, but the splitting and deduplication procedures require clarification.

Taken together, the mathematically inconsistent statistical reporting and the lack of an independent final evaluation set substantially reduce confidence in the central empirical claims.

Before the reported improvements can be considered reliable, the authors should provide per-seed results, the corresponding aggregation code, and corrected evaluations on a genuinely independent test partition.

  1. Insufficient evidence that TGAP reliably suppresses private information contained in visual representations.

The paper's central claim is that TGAP reduces private-attribute information available through transmitted visual tokens while preserving the information required for legitimate utility tasks.

However, several aspects of the evaluation limit the strength of this conclusion.

First, the benchmark permits privacy attributes to be annotated using associated Reddit titles, captions, or other textual metadata. In contrast, the evaluated VLM and token-level attackers primarily receive visual information.

This creates a potentially important mismatch between the evidence used to construct the target labels and the evidence available to the evaluated models.

For example, an author's income may be explicitly reported in the accompanying post text but not be visually recoverable from the image. Similarly, location or interests may be supported by associated metadata rather than identifiable visual features.

Such annotations may be correct as metadata labels, but their correctness does not establish that the corresponding attributes were recoverable from the original image or its visual tokens.

The paper does not sufficiently distinguish attributes supported by visual evidence from those supported only by external textual information. Without this distinction, it is difficult to determine whether reduced attribute prediction accuracy reflects genuine privacy protection or limitations in the information available to the attacker.

Second, although the adaptive-readout experiments are a meaningful improvement over frozen-decoder transfer, the evaluated attackers remain restricted. The surrogate LLM backbones are frozen, and only the input bridges and prediction heads are trained.

Furthermore, the representation-level attack evaluation covers only sex, income, and country-level location, with relatively small validation subsets for some attributes. The experiments do not establish comparable protection for interests or finer-grained location information.

Appendix C.2 also shows that the attribute-level improvements are not uniformly statistically supported. Although eleven of twelve attacker–attribute combinations exhibit lower mean balanced accuracy after filtering, only four have reported 95% confidence intervals that exclude zero.

Third, the objective ablation in Table 5 primarily reports source-model privacy metrics. Removing semantic privacy suppression causes a particularly large deterioration in these metrics, but the paper does not provide the corresponding adaptive-attacker results for each loss ablation.

Consequently, the independent contribution of representation-level privacy suppression to resistance against newly trained attackers is not adequately isolated.

Finally, utility preservation is not consistent across architectures. For InternVL2.5, relaxed utility decreases from 0.660 to 0.551, representing a substantial degradation. The paper also relies on a single-image proxy benchmark rather than actual wearable first-person sequences. Although these limitations are partially acknowledged, they further restrict the scope of the conclusions.

Overall, the results provide preliminary evidence that TGAP can reduce attribute recoverability under the evaluated attack settings. However, they do not sufficiently establish robust or generalizable privacy protection at the visual-token interface.

Combined with the unresolved statistical inconsistencies, these limitations substantially weaken the paper's empirical and methodological contributions.

Questions for authors

Q1. Can the authors explain and correct the mathematically inconsistent statistics in Table 4?

Table 4 reports mean ± standard deviation across three seeds, yet several non-negative metrics violate the maximum possible sample standard deviation for three observations.

For example, Phi-3.5-Vision TGAP reports P.Cont = 0.002 ± 0.012, which is impossible under the stated aggregation procedure.

Can the authors provide the underlying per-seed results, clarify the precise aggregation unit, and explain how these statistics were obtained?

Do similar errors affect other tables, reported privacy–utility improvements, or the conclusions regarding cross-model robustness?

Q2. How does the evaluation distinguish visually recoverable private attributes from labels supported only by external metadata?

The benchmark permits attribute annotations based on associated post text, while the evaluated attacks primarily operate on visual tokens.

Can the authors report how many privacy labels are supported directly by image content versus associated textual metadata?

More importantly, can the authors separately evaluate privacy protection on attributes that are demonstrably recoverable from the original visual representation?

Can the authors also clarify the data-splitting procedure, including any author-level or near-duplicate controls, and provide results on a test set not used for model selection?

Q3. What evidence establishes the independent effectiveness of representation-level privacy suppression against adaptive attackers?

The adaptive-readout evaluation freezes the surrogate LLM backbones and trains only bridges and prediction heads. Several attribute-level confidence intervals also include zero.

Can the authors clarify how the claimed representation-level protection generalizes to stronger adaptive attackers, such as jointly fine-tuned surrogate models or independent attribute-reconstruction methods?

In addition, can the authors report adaptive-attacker performance for the objective ablations in Table 5, particularly when the image-driven representation suppression term is removed?

This would help determine whether the proposed representation-level objective provides protection beyond changing the source model's privacy-related output behavior.

Answers to these questions, particularly Q1 and Q2, would materially affect my assessment of the paper's soundness and overall contribution.

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Discussion (0)

Sign in to comment.