- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper addresses 3D registration for serial-section volume electron microscopy (vEM). ReStack-Mamba first applies a Local Elastic Aligner (LEA), a RAFT-style iterative optical-flow estimator, to correct in-plane deformation between adjacent sections. Two independently trained, z-preserving StackMamba stages then serialize the feature volume along the three orthogonal XY, XZ, and YZ planes, model each plane with a separate residual Mamba branch, and adaptively fuse them to predict bounded in-plane residual displacement fields; the second stage is trained on the residual errors of the first stage’s frozen output. Finally, a deterministic axial Gaussian smoothing plus trimmed-mean post-processing suppresses outlying corrections.
Critical strengths
-
Well-motivated problem decomposition. vEM registration is decomposed into two coupled subproblems—within-section local elastic deformation correction and cross-section axial-consistency refinement—with a clear correspondence between them; Figure 1’s illustration of the error-accumulation mechanism is intuitive and effective.
-
The z-preserving tri-plane Mamba design fits the task structure. The encoder downsamples only in-plane and retains the full section sequence; the XY/XZ/YZ scans capture within-section morphology and axial discontinuity respectively, and Mamba’s linear complexity suits long section stacks.
-
Complete and well-controlled experiments and ablations. Six simulated volumes span five tissues, plus one real stack; the evaluation includes a per-section error-accumulation analysis and deformation-severity robustness experiments, with controlled comparisons (identical input stacks, identical contrast windows); the component ablation and the stage-design ablation (including the “Stage 1 applied twice with shared weights” control) are well conceived.
Critical weaknesses
- Unresolved objective conflict in the two-stage design: corrections for axial consistency may sacrifice in-plane fidelity, and the safeguards are only soft constraints
The paper decomposes registration into two “coupled” subproblems—in-plane deformation and axial consistency—yet optimizes them with two serial stages, sidestepping the cost of the coupling itself: the second stage targets axial consistency, but its corrections are in-plane residual fields; in ambiguous regions with missing or blurred structures, “axial consistency” can only be achieved at the cost of pairwise fidelity between adjacent sections. The safeguards are exclusively soft constraints—the identity, magnitude, and anchor regularization terms of Eq. (10) and the bounded residual. No loss term explicitly anchors pairwise alignment against being sacrificed, and no experiment quantifies this trade-off. Moreover, these regularizers penalize all corrections indiscriminately, without distinguishing fidelity-preserving from destructive ones, which inherently conflicts with the goal of “learning a correction.” The XY column of Table 2 confirms the risk: after adding Stage 1, in-plane PSNR slightly decreases and in-plane SSIM rises only marginally; Stage 2 leaves it unchanged; the only appreciable in-plane gain comes from the post-processing—which is not a learned module.
- The necessity of the second-stage learning module is unproven, and the bulk of the pipeline’s gain comes from non-learned post-processing
The paper’s central narrative is that “the second stage learns residual corrections beyond the first stage,” but the authors’ own controlled experiments do not support it: in the component ablation (Table 2), all metrics remain essentially unchanged after the second stage is added; in the stage ablation (Table 3), the independently trained second stage shows no substantive difference from the naive control of “Stage 1 applied twice with shared weights”; and the bulk of the pipeline’s gain comes from the deterministic smoothing post-processing. “Training two stages” is not evidence that “both stages contribute”—this is attribution by circular argument. Combined with Point 1, the more plausible explanation is that the protective regularizers have sealed off the learnable space: the second stage achieves safety, not effectiveness.
- The evaluation protocol is coupled with the smoothing post-processing, casting doubt on the interpretability of the gains
The final step of the pipeline is a smoothing operation along the z axis (Gaussian smoothing plus trimmed mean), while the primary metrics—SSIM/PSNR—are computed on XZ/YZ views, and the undeformed reference volume is naturally smooth along z. Consequently, any z-direction smoothing—regardless of whether it improves alignment—mechanically inflates these metrics. This is not an implementation detail but a design flaw of the evaluation protocol: the metrics reward “smoothness,” and the method happens to smooth; this coupling makes the gains in the main tables uninterpretable as genuine alignment improvement. The authors themselves acknowledge in Appendix S6 that the operation smooths fine texture. Breaking this coupling requires controlled experiments: comparisons with the post-processing removed, with the same post-processing applied uniformly to all methods, or with smoothing-insensitive evaluations (e.g., downstream segmentation benefits). Absent these experiments, the paper cannot answer how much of the gain over vEMRec reflects alignment quality and how much reflects metric bias.
- The most direct competing baseline is missing, leaving the method’s position in the SOTA landscape unclear
The paper cites NeuroTrajReg (NeurIPS 2025)—which uses the same OpenOrganelle data and the same SSIM/MI evaluation protocol and is the most direct competing method—yet includes no quantitative comparison; ssEMnet (cited), as well as GaussReg / EMReg, both compared in NeuroTrajReg, are likewise absent. Among the existing baselines, TrakEM2 (2012) and EFSR are clearly weak. Without a comparison against the most direct competitor, readers cannot determine the method’s true position within the current SOTA lineage, and the central claim of “improvement over the strongest baseline” loses its reference point.
- The evaluation protocol is set on the method-favorable side, and reporting seems selectively
The overall design—optical-flow LEA first, learned modules handling only small residuals—naturally fits smooth elastic deformation; the evaluation protocol accordingly consists of simulated smooth Gaussian elastic fields, and the deformation-severity experiment merely rescales the same fixed deformation fields, excluding real sectioning artifacts such as folds, tears, missing sections, and intensity drift (the authors acknowledge in Appendix S6 that these are out of scope). The method’s assumptions and the evaluation protocol are isomorphic, forming a circle: validating a method with exactly the deformation type it assumes. Real data comprises a single stack evaluated only qualitatively, so performance under real artifacts cannot be judged. Meanwhile, the main table (Table 1) shows only the three volumes with the largest gains over vEMRec; the other three, relegated to the appendix, show markedly smaller gains, and the abstract’s “approximately 10%” and “best aggregate PSNR” claims rest on this selected subset.
Questions for authors
Please see the weaknesses as shown above.
4 comments
Response to Reviewer ux75 (2/3)
W2. Independent Stage 2 versus applying Stage 1 twice
We thank the reviewer for distinguishing the use of a second stage from evidence of its contribution. With revised regularization, independent Stage 2 provides a measurable gain over two shared-weight refinement passes on EPFL. The original regularization configuration did not show this advantage.
We fix initial alignment, disable final filtering, and use the same frozen segmenter. Stage 1 is trained for 24 epochs; independent Stage 2 receives 24 additional epochs. The comparison uses EPFL deformation seed 46 and reports means ± sample SD across training initializations 43, 44, and 45. Axial SSIM averages XZ and YZ SSIM.
Table W2-1. Independent versus shared-weight refinement
| Configuration | Training epochs | Axial SSIM | Dice |
|---|---|---|---|
| Stage 1 | 24 | 0.48364 ± 0.00006 | 0.75005 ± 0.00009 |
| Stage 1 twice, shared weights | 24 | 0.48491 ± 0.00010 | 0.75213 ± 0.00008 |
| Independent Stage 2 (1×) | 24 + 24 | 0.48473 ± 0.00003 | 0.75182 ± 0.00006 |
| Independent Stage 2 (0.5×) | 24 + 24 | 0.48786 ± 0.00002 | 0.75517 ± 0.00022 |
Compared with shared weights, revised independent Stage 2 improves Dice by 0.00304 and axial SSIM by 0.00295. Original 1× Stage 2 is slightly below the shared-weight control on both metrics. The increase in residual magnitude from 0.07641 to 0.14616 pixels in W1 further supports the interpretation that the original constraints restricted learnable correction.
Thus, the revised independent stage adds improvement beyond applying Stage 1 twice. This increment is observed across three initializations and remains without final filtering: its contribution is measured by a direct comparison, rather than inferred from the two-stage design alone.
W3. Does final smoothing explain the main results?
We thank the reviewer for pointing out that axial image metrics can reward smoothing. With ReStack-Mamba's final filtering disabled, mean PSNR and SSIM across all six simulated volumes remain higher than vEMRec's. The advantage therefore cannot be attributed entirely to final smoothing.
We disable final Gaussian smoothing, trimmed-mean filtering, and optional displacement-field filtering, while fixing LEA weights and initial-alignment settings. The volumes are jrc_mus_liver, jrc_mus_pancreas, jrc_mus_liver3, jrc_mus_kidney, jrc_mus_heart, and jrc_mus_skin. The table reports equally weighted means across these six volumes, giving one aggregate value per metric for each method.
Table W3-1. Six-volume mean results without final postprocessing
| Method | PSNR (dB) | SSIM | NCC | MI |
|---|---|---|---|---|
| TrakEM2 | 21.0916 | 0.4611 | 0.8725 | 0.7912 |
| SEAMLeSS | 21.1745 | 0.4683 | 0.8766 | 0.8091 |
| EFSR | 14.5504 | 0.3335 | 0.3907 | 0.2113 |
| vEMRec | 24.9393 | 0.6606 | 0.9441 | 1.1451 |
| ReStack-Mamba | 25.1725 | 0.7065 | 0.9555 | 1.1620 |
Within each volume, PSNR/SSIM are weighted by valid slice counts per view. Archived TrakEM2, SEAMLeSS, and EFSR outputs are evaluated under the common protocol without additional filtering.
Relative to vEMRec, mean PSNR increases by 0.2332 dB, SSIM by 0.0459, NCC by 0.0114, and MI by 0.0169. ReStack-Mamba ranks first on all four aggregate metrics. The EPFL frozen-segmenter evaluation also gives Dice 0.75517 versus 0.74755 for vEMRec (complete comparison in W5), and the stage comparison above retains a Dice increment without final filtering. These downstream results provide evidence beyond image similarity, supporting registration benefits that do not depend on final smoothing.
Response to Reviewer ux75 (3/3)
W4. Direct competing baselines
We thank the reviewer for highlighting the limited coverage of the original comparison. We added an adaptation of public NeuroTrajReg code; ReStack-Mamba achieves higher values on all four metrics for the same six inputs. We retrain the adaptation using a reconstructed training pipeline and an 800-pixel field of view, with identical deformed inputs and a common evaluator.
Table W4-1. NeuroTrajReg / ReStack-Mamba on identical inputs
| Volume | PSNR (dB) | SSIM | NCC | MI |
|---|---|---|---|---|
| Liver | 21.2159 / 23.6821 | 0.4199 / 0.5866 | 0.7788 / 0.8716 | 0.7635 / 1.0840 |
| Pancreas | 21.2104 / 24.4632 | 0.4399 / 0.6398 | 0.8458 / 0.9284 | 0.7943 / 1.1335 |
| Liver3 | 22.2694 / 26.4430 | 0.5221 / 0.7223 | 0.9224 / 0.9718 | 0.9898 / 1.3738 |
| Kidney | 20.4989 / 24.4893 | 0.4315 / 0.6562 | 0.8728 / 0.9511 | 0.7565 / 1.1273 |
| Heart | 22.4297 / 26.6779 | 0.5637 / 0.7351 | 0.9548 / 0.9834 | 0.8966 / 1.1811 |
| Skin | 21.1276 / 24.9752 | 0.4861 / 0.6645 | 0.9288 / 0.9710 | 0.7481 / 1.0360 |
Each pair lists adapted NeuroTrajReg / ReStack-Mamba; bold indicates the better value. Deformation seed: 45. Volume names map to the six jrc_mus volumes listed in W3. PSNR/SSIM are weighted by valid slice counts; NCC/MI are computed over the full volume.
PSNR improves by approximately 2.47-4.25 dB and SSIM by 0.167-0.225 over this adapted implementation.
W5. Real-data validation and volume selection
We thank the reviewer for raising both concerns. We added segmentation on real VNC data without simulated deformation and on EPFL data with mitochondrial annotations under controlled deformation. The full six-volume summary also retains the advantage over vEMRec.
VNC directly tests real sections without adding Gaussian elastic deformation. All six methods use the same frozen segmenter, threshold 0.5, and reference annotations; metrics are computed per slice and then averaged.
Table W5-1. Real VNC segmentation (higher is better)
| Method | Dice | IoU | Precision | Recall |
|---|---|---|---|---|
| TrakEM2 | 0.55369 | 0.40554 | 0.55484 | 0.67112 |
| SEAMLeSS | 0.66331 | 0.49624 | 0.61938 | 0.71397 |
| EFSR | 0.57416 | 0.40848 | 0.56039 | 0.68852 |
| NeuroTrajReg | 0.66832 | 0.50186 | 0.61360 | 0.70706 |
| vEMRec | 0.66413 | 0.49715 | 0.62350 | 0.71042 |
| ReStack-Mamba | 0.68921 | 0.51165 | 0.63010 | 0.72828 |
Dice/IoU exceed vEMRec by 0.02508/0.01450. Precision and recall also lead all baselines: improved detection accompanies improved prediction accuracy. This extends evidence beyond image similarity under the assumed simulated deformations to downstream performance on a real acquisition sequence.
Regarding volume selection and “approximately 10%” in the abstract, the full six-volume mean relative axial-SSIM gain is 6.62%, with per-volume gains of 2.60%-12.26%. We average XZ/YZ SSIM for each method, calculate each volume's relative improvement over vEMRec, then average equally across volumes. The abstract now reports 6.62%, consistent with all six volumes. Mean PSNR without final filtering is also higher: 25.1725 versus 24.9393 dB (W3), so the aggregate advantage does not rely on selecting three volumes.
Table W5-2. EPFL controlled-deformation segmentation
| Method | Dice | IoU |
|---|---|---|
| TrakEM2 | 0.41266 | 0.25997 |
| SEAMLeSS | 0.69223 | 0.52932 |
| EFSR | 0.44656 | 0.28746 |
| NeuroTrajReg | 0.68375 | 0.51947 |
| vEMRec | 0.74755 | 0.59687 |
| ReStack-Mamba | 0.75517 | 0.60664 |
EPFL uses simulated deformation seed 46 on a real image volume, the same frozen segmenter, threshold 0.5, and reference annotations. Dice/IoU improve over vEMRec by 0.00762/0.00977, consistent with VNC.
The additional VNC segmentation evaluation addresses the lack of quantitative evidence on real acquisition data acknowledged in the original Appendix S6. Together with the annotated EPFL experiments and complete six-volume reporting, it strengthens the evidence for practical registration benefits beyond simulated deformations and qualitative observations.
After reading the authors' rebuttal
Thanks for the authors' rebuttal. The following questions are still unclear to me.
-
W5-1 reports mean IoU of 0.51165 and mean Dice of 0.68921 for ReStack-Mamba. With the same binary masks and slice weights, that mean IoU implies a mean Dice no higher than about 0.67694. Were empty masks or slice weights handled differently, and does the Dice gain over vEMRec remain 0.02508 under a common convention?
-
On EPFL, the independent Stage 2 outperforms a second pass of Stage 1 at 0.5× regularization but not at 1×. Halving the regularization also increases its mean absolute residual displacement from 0.076 to 0.146 pixels. At comparable mean displacement magnitudes, which errors, if any, does Stage 2 correct that the shared-weight pass misses?
I would maintain my origial socre at this stage.
Response to Reviewer ux75 (1/3)
W1. Axial consistency and in-plane fidelity
We thank the reviewer for highlighting this trade-off. With final filtering disabled, halving Stage 2 regularization improves XY, axial, and segmentation metrics together. On EPFL (deformation seed 46), initial alignment is fixed and both conditions use revised signed NCC; only the six Stage 2 regularization weights change.
Table W1-1. Fidelity and residual geometry
These results quantify the gains and geometric changes under weaker regularization.
**Coupled problems and module roles.**Our method assigns the two coupled subproblems to two distinct modules: LEA addresses local in-plane alignment between adjacent slices, while StackMamba addresses axial consistency across the stack. This division corresponds to LEA versus StackMamba, not to Stage 1 versus Stage 2. LEA produces an initially aligned stack; StackMamba then combines XY features with XZ/YZ context to predict bounded XY residuals that correct remaining cross-slice discontinuities. The subproblems remain geometrically coupled because moving one slice in XY changes its correspondence with both neighbors. Both refinement stages belong to StackMamba: Stage 1 refines the LEA output, and independently initialized Stage 2 learns remaining errors on fixed Stage 1 outputs. Overlapping-window predictions are fused into a whole-stack displacement field.
Pairwise similarity and regularization. The original adjacent-slice NCC squared covariance; revised signed NCC distinguishes positive and negative correlation. It directly guides pairwise correspondence, while variance weighting reduces low-texture contributions. Larger residuals and improved metrics after relaxation suggest that the original constraints limited useful correction.
Table W1-2. Common stage-specific weights
For stage s∈1,2, Iin is the input patch, I^ its refined output, and u the backward residual field. Both stages use:
\mathcal L^{(s)}={}&\mathcal L_{\rm sim}^{(s)} +\lambda_{\rm id}^{(s)}\mathcal L_{\rm id} +\lambda_{\rm mag}^{(s)}\mathcal L_{\rm mag} +\lambda_{\rm grad}^{(s)}\mathcal L_{\rm grad}\\\\ &+\lambda_{\rm anchor}^{(s)}\mathcal L_{\rm anchor} +\lambda_{z1}^{(s)}\mathcal L_{z1} +\lambda_{z2}^{(s)}\mathcal L_{z2}. \end{aligned}$$ $$\mathcal L_{\rm sim}^{(s)}=-\frac12\sum_{\ell\in\\{1,1/2\\}} \frac{\sum_p w_{\ell p}\rho_{\ell p}}{\max(1,\sum_p w_{\ell p})},$$ $$\rho_{\ell p}=\operatorname{clip}\left(\frac{c_{\ell p}}{\sqrt{(v^A_{\ell p}+\epsilon)(v^B_{\ell p}+\epsilon)}},-1,1\right), \quad w_{\ell p}=\operatorname{stopgrad}\left(\frac{v^B_{\ell p}}{v^B_{\ell p}+\epsilon}\right),\quad\epsilon=10^{-4}.$$ $A,B$ are later/earlier adjacent refined slices; $c$ is local covariance; $v^A,v^B$ are variances clamped to non-negative values. $\ell$ indexes scale; $p$ covers valid $9\times9$ windows over all adjacent pairs. Half-scale images use bilinear resizing with aligned corners; stopgrad stops gradients through the variance weight. $$\mathcal L_{\rm id}=\langle(\hat I-I_{\rm in})^2\rangle,\quad \mathcal L_{\rm mag}=\langle u^2\rangle,$$ $$\mathcal L_{\rm grad}=\frac13\sum_{d\in\\{x,y,z\\}}\langle(\Delta_d u)^2\rangle,\quad \mathcal L_{\rm anchor}=\langle u_1^2\rangle+\langle u_D^2\rangle+\langle(\bar u_{zxy})^2\rangle,$$ $$\mathcal L_{z1}=\langle|\Delta_z u|\rangle,\quad \mathcal L_{z2}=\langle|\Delta_z^2 u|\rangle.$$ $\langle\cdot\rangle$ denotes an elementwise mean; $\Delta_d$ is a forward difference. $D$ is patch depth; $u_1,u_D$ are first/last-slice displacements; $\bar u_{zxy}$ is each component's spatial mean. Identity/magnitude constrain image and displacement changes; gradients/axial differences control continuity; anchoring limits boundary and mean drift. All main volumes and deformation strengths share these weights. The revised balance improves in-plane, axial, and downstream metrics together.