- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
RTAF replaces a dense volumetric feature transformation with a grouped Gaussian-basis mapping using CP-parameterized weights and a lightweight local convolutional branch. A learned channel prior and input-dependent spatial gate modulate the branch inputs. The module is evaluated in ResNet-18/50 classification and nnU-Netv2 segmentation. Its contribution is a compressed nonlinear representation block with empirical accuracy-cost benefits, rather than a new mechanism for dynamically skipping computation.
Critical strengths
-
Useful cross-task evidence on existing backbones. ResNet-18 improves AUC and accuracy on all six reported MedMNIST3D datasets. The five-fold nnU-Netv2 task means all improve, with overall Dice increasing from 81.83 to 82.64 and larger gains on Heart and Colon. These insertion results support a reusable module contribution rather than only a new architecture ranking.
-
Substantial block-level compression with informative internal controls. At the profiled shape, parameters fall from 1769.73K to 248.65K and FLOPs from 231.93G to 45.17G relative to dense Conv3D. Table 3 includes a grouped-linear replacement for the Gaussian mapping: at comparable parameter count it scores 96.71 versus 97.47 Dice. The dense-weight comparison also supports the parameter-saving role of CP factorization. Together these results justify recognizing a limited but useful accuracy-cost contribution.
Critical weaknesses
The main limitation is uncertainty about the trade-off against conventional lightweight replacements at the same insertion points. The existing grouped-linear ablation is informative, but a standard depthwise/grouped convolutional replacement would better establish whether the added nonlinear construction is preferable to a simpler option. This limits confidence in the strength of the contribution, but does not outweigh the cross-task positive evidence. Block-level FLOP savings should not be presented as measured end-to-end acceleration, and the reported ResNet-50 Synapse and prostate peripheral-zone regressions limit universal claims.
Questions for authors
Could the authors provide an existing or small representative comparison against a conventional lightweight replacement at the same network locations and under the same training protocol, with parameter/operation counts? The existing grouped-linear ablation is acknowledged; this question concerns the practical value relative to a common alternative. Clarifying which matched-backbone baselines were rerun under the same settings would also help interpret the improvements.
I lean toward acceptance based on the demonstrated module-level savings and broad positive results. I do not require exhaustive multi-task ablations or an anatomical interpretation of the gate.
3 comments
Thank you for adding the comparisons at the same insertion points and for rerunning the classification backbones in a shared codebase. The parameter-matched depthwise baseline on Spleen directly addresses my main concern. RTAF improves Dice by 0.71 points at nearly the same parameter and FLOP counts. The NoduleMNIST3D results also help establish the scope of the benefit, with SCConv-3D leading on ResNet-18 and RTAF leading on ResNet-50. These results strengthen the case for RTAF as a reusable lightweight block. I remain at weak acceptance.
Response to Reviewer hxd3
Thank you for taking the time to review the additional experiments. Your suggestion helped us clarify the accuracy–cost trade-off of RTAF and how it varies across backbones. We have included the Spleen comparison in Table 4 and the NoduleMNIST3D results in Table 9 of Appendix F.
Response to Reviewer hxd3
Comparison with conventional lightweight replacements
Thank you for recognizing the gains from inserting RTAF into existing classification and segmentation backbones, as well as the block-level savings and the role of the grouped-linear ablation. We appreciate your suggestion to compare RTAF with standard lightweight replacements at the same network locations.
The new results on Task09 Spleen and NoduleMNIST3D show that RTAF retains an advantage over conventional lightweight replacements.
We evaluated depthwise-separable convolution (DW), a parameter-matched DW variant (DW-budget), SCConv-3D, and Dynamic Conv-3D on MSD Task09 Spleen and NoduleMNIST3D. Within each backbone, all replacements used the same insertion points and training protocol as RTAF. The parameter and FLOP counts in the tables are for the full networks.
Task09 Spleen
At nearly the same parameter count as DW-budget, RTAF reaches 97.47, a gain of 0.71 Dice points with 0.48% more FLOPs. Standard DW has the lowest parameter and operation counts, with Dice 1.01 points below RTAF. Compared with the original nnU-Netv2, RTAF reduces parameters by 21.42% and FLOPs by 6.68%, with a 0.12-point increase in Dice.
NoduleMNIST3D
Compared with DW-budget, RTAF improves AUC by 0.006 on both backbones and accuracy by 1.3 and 2.3 percentage points on ResNet-18 and ResNet-50, respectively. The parameter counts differ by less than 0.07%, and RTAF uses 0.37% more FLOPs on ResNet-18 and 1.11% more on ResNet-50.
On ResNet-18, SCConv-3D gives the highest AUC and accuracy and uses slightly fewer FLOPs than RTAF, with 0.129M more parameters. Compared with the original ResNet-18, RTAF improves AUC from 0.882 to 0.889 and reduces parameters by 23.06%, while accuracy falls from 0.860 to 0.855. On ResNet-50, RTAF gives the highest AUC and accuracy among the tested variants.
Full-network parameters and FLOPs
We agree that full-network counts are useful for interpreting the savings in Fig. 4a. The 80.52% FLOP reduction in that figure applies to a single block at the profiled input shape. The table below shows the full-network counts after replacing selected blocks with RTAF. We did not measure end-to-end latency.
RTAF reduces full-network parameters by 23.06% and 43.02% on ResNet-18 and ResNet-50, respectively, and FLOPs by 4.80% and 13.24%. Across the five MSD tasks, the corresponding reductions are 20.29–33.86% for parameters and 3.88–12.49% for FLOPs.
We will add the Spleen comparison to Sec. 4.4 immediately after the component ablations. We will place the full classification table in the appendix. Since nnU-Netv2 configures the network and input patch size separately for each dataset, we will report the exact counts for each task plan in the appendix.