- Rating
- 4
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
Flumina treats features from four CNN tokenizer stages as persistent states within a shared Transformer, rather than sending them to the decoder through separate skip connections. All states are projected onto a common token grid; each sublayer reads a feature-wise combination, applies one shared transformation, and writes updates back through identity residual paths. Final states are restored to their corresponding scales for decoding. The key contribution is a useful organization of structural information throughout representation learning, supported by five segmentation benchmarks and targeted architectural controls.
Critical strengths
-
An elegant and consequential architectural idea. The paper separates the requirement to preserve structure from the conventional choice of encoder-decoder skips. Distinct scale-grounded states remain available and participate in shared transformations throughout the backbone, while attention operates on one sequence. Although tokenization and multi-stream computation have precedents, their organization here offers a concrete, reusable answer to the structure/representation problem in dense prediction. This conceptual clarity is the main reason for my clear-accept recommendation.
-
Evidence directly supports the distinctive contribution. Table 5 compares different-scale initialization with replicated states while retaining multiple streams: the proposed initialization improves mean Dice by 1.51 points; it also exceeds early fusion by 2.30 points. Five-task evaluations, three-seed main comparisons, strong baselines including nnU-Net, and measured inference performance reinforce the value beyond an appealing diagram. The control suite makes the central design substantially more convincing.
Critical weaknesses
None that warrants rejection. The residual contraction argument motivates the design but does not prove preservation of anatomical detail in final representations. Small single-seed micro-design differences, such as identity versus mHC, should not be presented as universal superiority. These limitations do not undermine the more substantial contribution of scale-grounded persistent states and its broad empirical support.
Questions for authors
Two clarifications would help calibrate the evidence without requiring a substantially expanded study:
- Is the scale-grounded versus replicated-state improvement consistent in any available repeat runs? This is the central comparison; I do not request repeating every micro-design ablation.
- Can the main statistical claims distinguish dataset-level effects from pooled-case significance and account for repeated BraTS examinations within patients? This concerns uncertainty estimation, not the patient-disjoint training/test split.
My recommendation is clear acceptance based on the architectural contribution and existing evidence; these questions are intended to refine the scope of the claims.
4 comments
Response to Reviewer tSjn (Part 2/2)
Q2: Further details on the statistical analysis.
Per-dataset statistical analysis. Thank you for this suggestion. We have now added per-dataset statistical analyses of DSC, with comparisons between each Flumina variant and the baselines. The table below summarizes the number of statistically significant comparisons. As shown in the table, most comparisons show statistically significant differences, further supporting Flumina’s competitive segmentation performance. We also revised Appendix G.5 to provide detailed statistical results.
| Variant | AMOS-22 | LiTS | KiTS-23 | BraTS-25-GLI | MAMA-MIA | Total |
|---|---|---|---|---|---|---|
| Flumina-S | ||||||
| Flumina-B | ||||||
| Flumina-M | ||||||
| Flumina-L | ||||||
| Total |
Note. Entries show the number of significant case-level DSC comparisons () out of the total tested. Greener shades indicate higher proportions.
Patient-level statistical analysis on BraTS-25-GLI. As detailed in Appendix D, the BraTS-25-GLI test split contains 578 examinations from 366 patients. Following your suggestion, we have averaged the DSC across examinations for each patient and repeated the significance tests at the patient level. The table below report the p-values. The differences between Flumina and most baselines remain statistically significant. For Flumina-M and Flumina-L, all comparisons are statistically significant.
| Variant | U-Net | CoTr | SwinUNETR | UNETR | MedNeXt | UNETR++ |
|---|---|---|---|---|---|---|
| Flumina-S | ||||||
| Flumina-B | ||||||
| Flumina-M | ||||||
| Flumina-L | ||||||
| SegMamba | Zig-RiR | SegMamba-V2 | Primus | CROWn | Primus-V2 | |
| Flumina-S | ||||||
| Flumina-B | ||||||
| Flumina-M | ||||||
| Flumina-L |
Note. Patient-level -values below 0.001 are shown as . denotes , denotes , and denotes .
Thanks for running these extra checks. The one I most wanted to see was whether starting each stream with features from a different scale still helped across multiple runs. Seeing Flumina-B come out ahead on all five datasets in the three-seed averages makes me more confident in that design choice. Averaging the repeat scans for each patient also addresses my concern about the BraTS analysis. I’m keeping my rating at 4.
Dear Reviewer tSjn,
Thank you again for your valuable comments and constructive suggestions. We truly appreciate your support for our work!
Best regards,
Authors of Submission 22518
Response to Reviewer tSjn (Part 1/2)
We sincerely thank the reviewer for recognizing Flumina’s architectural contribution and for providing constructive feedback. We respond to your questions point by point below.
Q1: Consistency of scale-grounded versus replicated initialization across repeated runs.
Thank you for this suggestion. We acknowledge the importance of repeated runs across random seeds. To make the conclusions of our ablation study more convincing, we have repeated the comparison with the replicated-state variant using multiple random seeds. The results are reported in the table below. After averaging DSC scores over three random seeds, we found that Flumina-B outperformed the replicated-state variant on all five datasets, with an overall mean DSC of 83.64% versus 82.53% across datasets.
Note. Average is the mean DSC (%) across the five datasets. The highest score in each column is shown in bold. Values in red indicate decreases from Flumina-B (3-seed mean) in percentage points.