- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Classwise State Routing (CSR), a label-calibrated framework for frozen diffusion segmentation. Motivated by the observation that classes often prefer different layer–timestep states from the strongest shared state, CSR estimates downstream classwise reliability, selects a compact state pool through complementary class coverage, and performs fixed class-conditioned response fusion followed by concentration calibration. No model parameters are updated. Experiments across four datasets and six backend–task settings show improvements in 10 of 12 OVSS comparisons and all 12 category-agnostic comparisons.
Critical strengths
S1. The idea is fresh and well motivated, with a convincing connection between observation and design. Figure 2 shows that reliable states occupy a compact region, yet class preferences remain heterogeneous within it: 17 of 19 Cityscapes classes prefer a state other than the strongest shared state. Using classwise downstream reliability rather than a single global ranking is a sensible direction, and separating shared-pool selection from class-conditioned fusion translates this insight into a practical design. The compact pool addresses the cost of evaluating many states at inference, while Table 2 isolates the benefit of class conditioning under a fixed pool.
S2. Extensive analyses substantiate the method beyond the main performance table. The paper examines calibration-set size, subset reselection, diffusion-noise sensitivity, alternative backbones, and computational cost. In particular, subset reselection retains positive mIoU gains despite changes in the selected states, and the backbone experiments demonstrate that the procedure remains useful after recalibration. The explicit separation of pooling, class-conditioned weighting, response calibration, and decoder calibration makes the reported gains easier to interpret and supports the practical credibility of the framework.
Critical weaknesses
W1. The calibration budget lacks an actionable selection criterion. Using different image counts across datasets is reasonable, and the required subsets are small. However, the paper does not explain how a practitioner should choose that count. Figure 4 shows non-monotonic performance as the budget increases, so more calibration images do not straightforwardly identify a better operating point. An analysis of whether held-out calibration performance, reliability-estimate stability, or diminishing coverage gains can identify a suitable budget would make the method more reproducible and usable without consulting evaluation labels.
W2. The scope of class-conditioned generalization remains limited to calibration-supported categories. All benchmark classes are represented in the OVSS calibration subsets, while unsupported classes fall back to shared reliability. The experiments therefore establish the effectiveness of class-conditioned routing for supported categories, but do not show how much benefit remains for novel categories, an important aspect of the open-vocabulary setting. A held-out-class experiment comparing class-conditioned routing for supported classes with the shared fallback for unsupported classes would clarify this boundary.
Questions for authors
- How were the calibration budgets of 50/30/100/50 images chosen? Have you investigated a stopping or budget-selection criterion using only calibration data disjoint from evaluation, such as performance on a held-out calibration subset, reliability-estimate stability, or diminishing class-coverage gains? Can such a criterion identify an effective operating point despite the non-monotonic trend in Figure 4, without updating model parameters?
- How does CSR perform when some evaluation categories are excluded from calibration? Please distinguish performance on supported and unsupported categories, and compare the shared-reliability fallback with the original baseline and uniform state fusion.