- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
RT-ISTR extends the D-FINE detector to instance segmentation by introducing a lightweight Multi-scale Mask Enhancement module and reusing detection query embeddings for mask prediction. The module combines shallow backbone features with encoder features through upsampling and addition, and masks are generated through a dot product between query-derived embeddings and prototype masks. Experiments on COCO and a self-built Traditional Chinese Medicine microscopy dataset report competitive segmentation accuracy with relatively low computational cost. However, the evaluation does not convincingly establish the robustness of the gains, their generality to microscopy, or the claimed real-time deployment benefit.
Critical strengths
A straightforward and potentially useful engineering design. Reusing D-FINE’s detection queries and adding a lightweight mask-generation branch is a practical way to extend a strong detector to instance segmentation. Sharing the backbone, encoder, and decoder could make the approach attractive when detection and segmentation are both required.
Promising computational efficiency at some model scales. The reported results include configurations with competitive mask accuracy and substantially fewer FLOPs than relevant baselines. For example, RT-ISTR-M achieves 43.2 mask AP on COCO with 66.8 GFLOPs, compared with YOLO26-M’s 42.1 AP and 121.5 GFLOPs. These results suggest potential value, provided the comparisons and actual runtime benefits are validated.
Critical weaknesses
The microscopy evaluation is too limited and insufficiently documented. The central motivation concerns microscopic images with ambiguous boundaries, clutter, and overlapping instances, but the microscopy evidence comes exclusively from the self-built TCM dataset. COCO provides useful general-purpose evaluation but does not establish generalization across microscopy tasks or acquisition conditions.
Essential TCM dataset information is missing, including image and instance counts, category composition, annotation procedures, and train/validation/test split construction. It is therefore difficult to assess the dataset’s difficulty, the independence of the evaluation samples, or the reproducibility of the results. Furthermore, aggregate AP and selected visualizations do not directly substantiate the claimed improvements in boundary fidelity or separation of densely overlapping instances. Validation on an independent microscopy benchmark would materially strengthen the application-specific contribution.
The magnitude and reliability of the accuracy–speed improvement are not convincingly established. On TCM, RT-ISTR-L improves mask AP from YOLOv8-L’s 80.3 to 82.1, a gain of 1.8 percentage points. On COCO, its advantage over YOLO26-L is only 0.1 AP, while RT-ISTR-X achieves lower mask AP than YOLO26-X, 45.7 versus 47.0. Reduced FLOPs are a positive result, but these comparisons support an accuracy–compute trade-off more clearly than consistent accuracy superiority. Without repeated runs or uncertainty estimates, the robustness of the smaller gains remains unknown.
More importantly, the runtime reporting is inconsistent: the abstract and conclusion state 64 FPS for RT-ISTR-L, whereas Table 1 and Section 3.2.1 report 23 FPS. The inference protocol is insufficiently specified to establish a fair latency comparison, and no deployment results substantiate the claims about resource-constrained edge applications. Since real-time performance is a central contribution, this discrepancy directly affects the assessment of usefulness.
The ablation also compares MME with a shallow-feature baseline rather than a clearly defined, competitive multiscale mask head. This does not adequately isolate the benefit of the proposed fusion design from the general benefit of adding semantic features.
Questions for authors
Dataset and evaluation clarification: Please provide the TCM dataset size, categories, instance counts, annotation process, and split construction. Are images from the same specimen or acquisition session kept within one split? Were hyperparameters selected on a separate validation set?
Robustness of the gains: Do the reported improvements persist across independent training runs under matched training, pretraining, and input-resolution settings? In particular, how should the 1.8-point TCM improvement and 0.1-point COCO improvement be interpreted relative to run-to-run variability?
Runtime and practical usefulness: Please reconcile the 64 FPS and 23 FPS results. What hardware, batch size, numerical precision, inference implementation, and timing boundaries were used? A matched batch-one, end-to-end latency comparison on microscopic images would materially affect my assessment of the real-time contribution.
Ablation clarification: What exactly is retained in the baseline without MME, and why does its mask AP deteriorate so substantially? How does MME compare with a conventional multiscale mask head added to the same D-FINE backbone and decoder under a comparable computational budget?