- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper studies how accumulated updates affect streaming test-time adaptation (TTA) for open-vocabulary semantic segmentation. The authors argue that these updates can both help and hurt performance over a long test stream. They propose Profiled State Recovery (PSR), which monitors the adaptation state and restores some or all adaptable parameters when a trigger condition is met, before resuming adaptation.
I have several major concerns about the paper.
First, the problem setup is difficult to follow. It took me considerable effort to understand how “persistent state” differs from the familiar distinction between episodic TTA, where the model is reset, and continual TTA, where updates carry over. The paper introduces too much terminology before explaining the basic setting, what existing methods fail to address, and what new research question it aims to answer.
Second, the motivation is not convincing. The argument seems to be that parameters may drift during continual adaptation, so a recovery mechanism is needed. However, the paper does not clearly demonstrate a reproducible failure of existing methods or explain why state recovery is a distinct research problem rather than an engineering extension of continual TTA.
Overall, the paper needs clearer writing, stronger justification for the method, and more convincing experiments. The terminology makes a relatively straightforward setting harder to understand, and the current evidence does not adequately support the framework or its conclusions.
Critical strengths
None
Critical weaknesses
-
The writing and logical organization are highly confusing.
-
The proposed method is technically very naive, while the manuscript substantially overcomplicates its presentation.
-
The lack of qualitative segmentation results is a major experimental omission.
-
The figures are difficult to interpret and their presentation quality is concerning.
Questions for authors
I do not believe the current manuscript meets the standard for acceptance at ICLR.
The underlying topic—managing accumulated adaptation state in long-running TTA systems—may be worth studying. However, the current paper does not clearly establish a sufficiently important new research problem, the proposed method appears technically limited, the presentation substantially overcomplicates a simple mechanism, and the experimental evidence is not convincing. In particular, for a paper centered on open-vocabulary semantic segmentation, the complete absence of qualitative segmentation results is difficult to justify.