- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper proposed CoLAG, a two-stage training-free method to improve the performance of open-vocabulary species recognition of MLLMs. CoLAG first retrieves relevant candidates, and then reasons over the retrieved candidates. The method was tested on five bird datasets and two other datasets (Pokemon and Fish) and improved the open-vocabulary species recognition of MLLMs on these datasets.
Critical strengths
None
Critical weaknesses
-
The problem is not well-motivated and the paper is poorly written. There is no discussion on why MLLMs are needed for species recognition, while the paper acknowledges that “standard MLLMs rely on implicit parametric knowledge and struggle to compare fine-grained attributes among visually similar species, causing confusion in open-vocabulary settings.” The fact that “the candidate set is large, evolving, and often unbounded” does not mean that species recognition needs to be treated as an open-vocabulary recognition problem. Why is text description needed to tackle this problem? If text description is necessary, this approach cannot be generalized to species without detailed descriptions, making this approach useless for those species. It is also unclear why species recognition should be treated as an “open-vocabulary” problem instead of an open-set recognition problem (to detect the species not in the training set) or a one-shot learning problem given that CoLAG requires an anchor image for each species. The paper does not study BioCLIP (Stevens et al., 2024), BioCLIP v2 (Gu et al., 2026), BioCAP (Zhang et al., 2026), or BioTrove-CLIP(Yang et al., 2024), foundation models trained for species recognition, but used general-purposed, much bigger MLLMs instead, making the solution unnecessarily complicated. The Pokemon dataset is also completely irrelevant to species recognition.
-
There is no discussion on BioCLIP, BioCLIP v2, BioCAP, or BioTrove-CLIP in the related work. Table 1 only includes results of CLIP, OpenCLIP, and SigLIP. None of the models was trained for species recognition. What’s the performance drop of the four CLIP-based species recognition models? Besides, in the result section, BioCLIP was evaluated for retrieval, but not for recognition. Why? On the contrary, BioCLIP was trained for specifically species recognition, not retrieval. Since CoLAG needs an anchor image for each species, what’s the performance of one-shot classification of BioCLIP, BioCLIP v2, or DINOv3 (Siméoni et al., 2025)? Or use these images for linear probing? All of these can serve as a strong baseline and should be evaluated before using CoLAG.
Stevens, Samuel, et al. "Bioclip: A vision foundation model for the tree of life." 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2024.
Gu, Jianyang, et al. "Bioclip 2: Emergent properties from scaling hierarchical contrastive learning." Advances in Neural Information Processing Systems 38 (2026): 102778-102811.
Zhang, Ziheng, et al. "BioCAP: exploiting synthetic captions beyond labels in biological foundation models." International Conference on Learning Representations. Vol. 2026. 2026.
Yang, Chih-Hsuan, et al. "Biotrove: A large curated image dataset enabling ai for biodiversity." Advances in Neural Information Processing Systems 37 (2024): 102101-102120.
Siméoni, Oriane, et al. "Dinov3." arXiv preprint arXiv:2508.10104 (2025).
Questions for authors
- Is there a description dataset for FishNet? If so, what was it curated? There is no description of this dataset
- The paper is poorly written. For example, Section 4.1 is very unclear and difficult to read, especially the definition for the “chunks”. What is a “tower”? There’s no definition nor citation for “DINO”. Which version of DINO was used? “Congener” is a jargon. Use “within the same genus”.
Minor issues
- Line 211 - there’s no definition of the signed generalized mean.
- Section 4.1 - \Pi is often used as the product operator. Even though it is defined as the unit vector normalization in the paper, it is still very confusing.
- Use \citep instead of \cite for in-line citations; it is very difficult to read now
- Line 111 - 112: “species may be unseen, reclassified, or novel” - what’s the difference between unseen and novel?
- Inconsistent font: CoLAG (italic) in Lines 65 and 74 vs CoLAG in the method section. Inconsistency in section 4.2 as well.