- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes RECAST, a contract-preserving framework for reducing source-content exposure in multimodal numerical reasoning through fixed remote interfaces. The method locally extracts a textual evidence-query record, jointly rewrites source-specific topics and entities, remaps numerical values with a locally invertible map, reconstructs protected chart or speech inputs, and executes a returned program after restoring the original operands locally. The engineering design is reasonable, and the assessment scope covers both graphical and audio tasks.
Critical strengths
- The paper focuses on the "source-content exposure" issue in fixed interface remote multimodal services. For services that require uploading images, charts or voice inputs, merely generating sanitized text usually fails to meet the interface requirements; RECAST has designed a deployable processing flow to address this practical limitation, with the task setting having a relatively clear application background.
- The shared evidence-query record and local recovery of original operands give the system a clear utility objective: the remote model identifies operations over protected inputs, while the client restores the original operands before final execution. This separation is well matched to numerical-reasoning tasks that require preserving relational structure.
Critical weaknesses
- RECAST primarily integrates existing text rewriting, reversible numerical substitution, media reconstruction, and local program execution. The paper does not provide sufficient component-level baselines to show that the shared record, joint rewriting, and reconstruction agent yield gains beyond a simple composition of existing components.
- The retention audit covers only solver-bound requests and excludes external reconstruction or review services that may process protected records or derived artifacts. Therefore, the reported retention rate does not characterize the source-exposure risk of the complete pipeline.
- The judge-based retention metric measures whether a fixed judge flags source information as retained, but it does not directly assess attack success. In particular, the evaluation does not test source retrieval, linkage through preserved relational or numerical patterns, or attribute inference.
Questions for authors
- Could the authors add simple-composition baselines, for example by combining an existing numerical-protection method with an off-the-shelf chart renderer or TTS system? Could they also ablate the independent contributions of the shared record, joint rewriting, and reconstruction agent?
- Could the authors evaluate source retrieval, linkage, or re-identification under an end-to-end threat model that includes all external reconstruction and review services, rather than relying only on judge-based retention?