- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper studies the structural choices of multimodal test-time adaptation methods, including prompt tuning and residual adapters. It mainly focuses on comparing the combination of adapters and prompt tuning, termed Prompt+Adapter, with the prompt-tuning-only method. It also introduces identical initialization for adapters and gradient analysis. The results claim that Prompt+Adapter exceeds the performance of prompt78 while introducing negligible parameter capacity across several multimodal settings.
Critical strengths
- It provides empirical evidence on comparing the performance of the combination of prompt and adapter with the prompt-only method.
- This paper includes comprehensive and solid experimental designs supporting the effect of Prompt+Adapter.
- It seeks a balance between the parameters of prompts and adaptors that could achieves superior performance of Prompt+Adapter over Prompt78 with comparable trainable parameters.
Critical weaknesses
- The contribution is incremental, which simply combines two existing methods under controlled capacity.
- The improvements of Prompt+Adapter over Prompt78 and BriMPR is limited in Mean-test-accuracy.
- Its paper writing is poor and hard to follow.
- The experiments are only conducted on one backbone CAV-MAE, lacking backbone ablations.
Questions for authors
- What’s the crucial motivation for combining adapters and prompts?
- What might be the differences or advantages of adapters and prompts for tailoring the multimodal test-time adaptation task?
- Why is the adapter-only configuration absent in the comparison?
- This paper only reported one prompt-adapter parameter allocation in its main experiments. Could different ratios yield better performance, and is the reported one the best?
- Will the adaptation capacity for multimodal TTA tasks be different compared to other tasks? As maybe some tasks will be more influenced by the context provided by prompt tuning, while others might exhibit stronger performance when adapters are applied to adapt representations. What makes the reported prompt-adapter parameter ratio effective for multimodal TTA tasks?