- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies gradient-free adaptation of frozen multimodal large language models to target medical image classification datasets. The proposed clinician mimetic workflow constructs two dataset-specific context states without updating the parameters of Qwen3-VL-8B.
Critical strengths
- The paper distinguishes query-specific visual evidence from reusable cross-case diagnostic heuristics. This is a sensible design because a small number of retrieved images and a compact experience bank can encode complementary forms of target-dataset information without maintaining a separate fine-tuned MLLM checkpoint for every dataset.
Critical weaknesses
-
The DECS retrieval key can become inconsistent with the actual evidence presented to the MLLM. The paper explicitly states that the refined key is not intended to reproduce its associated exemplar. This weakens the interpretation that DECS retrieves representative diagnostic evidence. The paper should quantify key-image mismatch and compare against consistent alternatives. This concern is central because DECS is used both for test-time visual context and for selecting the cases from which SRES constructs experience.
-
The main comparison is unfair. More specifically, it does not match in supervision, context, or computation. If I understand correctly, the method uses substantially more labeled information, model calls, generated tokens, and inference-time context than the reported retrieval baselines.
Questions for authors
-
MedMNIST was originally designed as a lightweight, MNIST-like benchmark for rapid prototyping, and several of its tasks rely on heavily standardized images. There are so many large-scale professional clinical datasets (such as MIMIC, CheXpert, CT-Rate), why is the 2D MedMNIST an adequate primary benchmark for the paper's claim of adapting MLLMs to heterogeneous, real-world medical-image distributions?
-
What is the final Experience Bank length in entries and tokens for every dataset? Can the authors compare against an equal-token static class summary or equal-token randomly generated memory?
-
How many Qwen forward passes, generated tokens, GPU hours, and wall-clock hours are required to construct each Experience Bank?How does this compare with training a linear probe or LoRA adapter on the same target split?
Thank you for the detailed response. However, several concerns remain unaddressed.
W1: My question was not about the rationale of refining keys, which the response restates. My concerns are about quantifying the mismatch between refined keys and their paired images and comparing against consistent retrieval alternatives. Table 3 shows an aggregate gain but does not isolate this effect.
Q2: The response only promises to add equal-token static class summaries and randomly generated memory. No results are provided. So the question is still open on whether the gains come from the diagnostic content of the ExperienceBank, ather than from extra context tokens alone.
Q1: There is no direct response to my Q1.