- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
PLSC addresses semi-supervised multimodal new intent discovery using labeled examples of known intents and unlabeled examples containing both known and novel intents. It combines multimodal pretraining with iterative clustering, supervised contrastive refreshes using known labels, density-based sample selection, and a gradual increase in pseudo-label classification weight. An MLLM judges whether representative sample pairs express the same intent using text and video. These relations become soft penalties in constrained centroid refinement, with known-class centers held fixed during correction; the corrected centers initialize subsequent clustering. Experiments cover MIntRec, MIntRec2.0, and MELD-DA at different known-class ratios. Component ablations support benefits from progressive training and, in some settings, semantic feedback, although attribution relative to matched alternatives remains incomplete.
Critical strengths
-
A meaningful task and a concrete feedback mechanism. Discovering new intents from partially labeled multimodal data is practically relevant. PLSC converts MLLM judgments into local same/different-intent relations and uses finite penalties to influence subsequent clustering, rather than requiring generated intent names to define the categories. The feedback interface is explicit, and the appendix documents prompts and computational costs.
-
Component ablations demonstrate useful conditional gains. The paper does more than report improvements of the full pipeline. At a known-class ratio of 0.25, the pseudo-label weight schedule improves the reported average of four clustering metrics by 2.18, 2.43, and 3.51 percentage points across the three datasets. Holding centroid optimization in place while removing semantic penalties reduces this average by 0.11, 0.30, and 2.50 pp, respectively. These results support the usefulness of progressive supervision and show that semantic feedback can make a meaningful contribution, particularly on MELD-DA in this setting.
Critical weaknesses
-
The incremental contribution over closely related approaches is insufficiently isolated. UMC already provides multimodal contrastive learning, density-based selection, and iterative clustering. LLM-derived pairwise relations are also established: LANID uses them for representation learning, and Viswanathan et al., Large Language Models Enable Few-Shot Clustering (TACL 2024, Section 2.2), use LLM-generated pairwise must-link/cannot-link constraints in PCKMeans, with weighted penalties for constraint violations. PLSC adds known-class refreshes, gradual pseudo-label supervision, and a specific centroid-feedback loop, but the current component-removal experiments do not establish their advantage over a simple matched combination of these existing ideas. Moreover, the baseline descriptions do not clearly establish matching of modality inputs, backbones, and external-model access. This is an attribution gap, not evidence that the comparisons are necessarily unfair. Given the limited methodological distance, it materially weakens the case for acceptance.
-
The mechanism evidence is narrower than the motivation suggests. Cross-modal inconsistency is a plausible source of instability, but supervised refreshes and gradual pseudo-label weighting can also help ordinary single-modality clustering. Removing pretraining does not isolate the benefit of additional modalities or establish that cross-modal conflict has been reduced. The direct structural analysis is also modest: in Section 5.2, MIntRec2.0 weighted intent purity changes from 0.4569 to 0.4576 after correction, while silhouette remains nearly unchanged. This supports preservation of structure more clearly than substantial repair of intent boundaries in that setting. Together with the dataset-dependent feedback gains and unreported uncertainty of paired performance differences in the key ablations, the results leave the scope and mechanism of the claimed improvement insufficiently established.
Questions for authors
-
Clarification of the comparison and incremental value: Please specify the modalities, backbone, and external-model access used by the main baselines. Is there an existing comparison against a simple semi-supervised UMC-based system under matched inputs and supervision, with comparable relational feedback and query budget? If not, one representative matched comparison would be particularly informative; reproducing every related method is unnecessary. This comparison would help establish the method’s incremental contribution.
-
Clarification of the evidence for the central motivation: Are results available comparing text-only and full multimodal inputs while keeping the training strategy and feedback configuration fixed? Please also provide paired per-seed differences, or their uncertainty estimates, for the existing semantic-penalty ablation. These would help distinguish the contribution of modality inputs from training changes and assess whether the smaller feedback gains are stable. If cross-modal inconsistency is intended only as motivation rather than an experimentally established mechanism, please clarify that scope.