- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes QGA-TTT, a global feature aggregation module for medical image segmentation built on test-time training layers. At each of the three deepest skip connections of a convolutional encoder–decoder, spatial features are concatenated with learned queries shared across images. A single gradient step fits head-wise affine fast weights from this working set, and all positions read information through the fitted maps. The module retains the query representations across two successive blocks, averages two separately parameterized fitting branches within each block, and injects the resulting correction through a learnable channel-wise gate. The paper evaluates the method on nine public datasets, including six 2D and three volumetric segmentation tasks. It reports the highest Dice score among the evaluated methods on every dataset. Additional experiments examine component ablations, computational cost, boundary accuracy, fitted-map spectra, and distances between maps fitted to different images.
Critical strengths
The broad evaluation covers nine heterogeneous datasets and includes convolutional, attention-based, state-space, and existing TTT architectures.
Critical weaknesses
-
Limited novelty. The main components (including fitting weights within the forward pass, inner learner, and auxiliary tokens) have precedents in existing TTT and Transformer literature. The contribution beyond combining these established designs is insufficiently elaborated.
-
In the 2D setting, QGA-TTT nearly doubles nnU-Net’s parameter count (87.3M vs. 46.3M). It remains unclear how much improvement comes from the proposed TTT mechanism versus increased model capacity.
-
Table 3 covers only two datasets, providing limited support to analyze the contribution of each component. Moreover, carrying queries across blocks reduces performance on both datasets when paired fitting is disabled, and this degradation is lack of explanation.
-
The Table 3 baseline, with all three listed components disabled, outperforms all competing methods shown in Table 1 on both m2caiSeg and Endoscapes datasets. It raises concerns about comparison fairness and the attribution of gains.
-
Overlapping markers and curves in Figure 4 obscure individual results and make the intended comparisons difficult to interpret.
-
The writing is poor. The manuscript requires substantial rewriting to improve clarity and precision.
Questions for authors
-
What is the substantive methodological advance over prior TTT methods, beyond combining established components?
-
Which components account for the parameter increase from 46.3M to 87.3M? Can you provide a parameter-matched comparison with nnU-Net to separate the benefits of the proposed TTT mechanism from those of increased capacity?
-
Can you provide ablations on additional datasets to assess whether the claimed component benefits generalize?
-
Why does carrying queries across blocks reduce performance when paired fitting is disabled?
-
Why the baseline shown in Table 3 outperforms all competing methods on both m2caiSeg and Endoscapes datasets?