- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes AQUA (Adaptive QUerying and Alignment), a prototype-learning framework for few-shot action recognition. The method contains three key components: InvQ, CMAlign and CMAdapt. Extensive experiments on four benchmarks (HMDB51, Kinetics, UCF101, and SSv2) with three different backbones (ResNet-50, CLIP-RN50, CLIP-ViT-B) and the ablation studies confirm the individual contribution of each component, and the detailed implementation specifications along with the reproducibility statement provide sufficient information for replication.
Critical strengths
-
The proposed framework is well-structured, with three complementary components that address different aspects of few-shot action recognition in a progressive manner. Specifically, InvQ extracts class-consistent visual representations from support videos, CMAlign introduces semantic regularization to improve their discriminability, and CMAdapt further refines textual prototypes based on visual-textual consistency. This progressive design provides a coherent motivation for the overall framework.
-
The prototype construction directly addresses sample-specific variations in limited support data by explicitly guiding attention aggregation with cross-shot commonality scores. Support-only prototypes can also be reused across queries within an episode.
Critical weaknesses
-
Performance on SSv2 under the 1-shot setting remains below leading baselines, including CLIP-FSAR, indicating limited competitiveness on actions requiring fine-grained temporal discrimination.
-
The frame similarity in Eq. 4 may assign high commonality scores to shared backgrounds, objects, or scenes. Although CMAlign provides class-level semantic supervision, it does not explicitly distinguish action evidence from shared contextual cues, leaving the claimed invariance insufficiently validated.
Questions for authors
-
Why do the authors choose LoRA over adapters? Temporal adapters could enable finer-grained temporal modeling and potentially improve performance on SSv2. Could the authors compare the gains from LoRA and temporal adapters under matched trainable parameter counts and computational budgets?
-
What accounts for the performance gap to CLIP-FSAR on SSv2 1-shot, and how does InvQ help when cross-shot commonality is unavailable?