- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents ASS, a large-scale dataset for airport semantic segmentation comprising 250 video sequences and over 140,000 pixel-annotated frames across 18 semantic categories. The authors document various challenges specific to airport environments—extreme multi-scale objects, non-compact shapes (e.g., aircraft wings), inter-class similarity, and varying weather/lighting conditions—and benchmark 20 existing segmentation methods, observing substantial performance degradation. Additionally, they propose SPWSeg, a weakly supervised approach that leverages 3D shape models to generate synthetic training samples with image-level labels, using these to regularize segmentation predictions. The method is evaluated on ASS and Cityscapes with reported improvements over IRNet.
Critical strengths
1.Airport surveillance is a practically important yet underexplored setting for semantic segmentation. The collection effort represents a substantial investment. If accompanied by clear evaluation protocols and public release, this dataset could enable research on segmentation in long-range surveillance contexts that differ markedly from standard street-scene benchmarks.
- The paper correctly identifies that standard segmentation methods struggle with non-compact object geometries that are prevalent in airport scenes. The proposed direction of incorporating shape priors addresses a real limitation of purely appearance-based learning, particularly when annotations are weak or incomplete.
Critical weaknesses
1.The paper conflates two contributions—synthetic training samples and the shape-prior regularization—without ablation to separate their effects.
2.Critical details are missing. The train/val/test split construction is undescribed—whether frames from the same video can appear in different sets is unclear. The dataset claims 18 categories, yet Table 1 reports only 12. Annotation quality metrics (number of annotators, inter-annotator agreement) are absent, and challenges like "extreme multi-scale" are illustrated qualitatively but never quantified.
Questions for authors
1.The paper lists multiple challenges (scale variation, shape, similarity, weather) but does not establish their relative importance. Can you provide a controlled study to quantify which factors contribute most to performance degradation?
2.For SPWSeg, the shape constraint is applied via a loss term that encourages predicted masks to match shape prototypes. How is this constraint computed when a class appears multiple times in an image (e.g., several aircraft), when objects are partially occluded, or when only truncated views are available?