- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The main component of this paper is to use vessel-map-generated synthetic pairs to train retinal keypoint detection and correspondence establishment models. The high-level idea is interesting but the detailed technical design is moderately novel and is not well justified. The proposed retinal-constrained training, vascular feature attention and Support-Aware Polynomial refinement are technically concerning. Experiments are moderately convincing and lack rigorous comparison.
Critical strengths
-
Putting aside the basic augmentation-based methods used for synthetic pairs and lack of theoretical justification of how this handles the appearance gap at detection with real modalities. The idea to generate synthetic pairs from vessel maps seems novel and is interesting.
-
The size of the test set is good (over 1000 pairs) for MRIR. But the opacity of the dataset then weakens this strength.
Critical weaknesses
-
The RSPAR is mainly empirically justified by the final registration performance, which is not convincing enough. There's no theoretical justification of why the vessel-map synthesized (using basic augmentation methods) image-trained models can handle the domain appearance difference with the real modalities. The author also didn't provide any direct ablation nor simple demonstration on the detected keypoints qualities, e.g., whether they reflect real anatomical structures such as vessel bifurcations, which are useful for registration.
-
The vessel loss in RSPAR encourages detecting keypoints on vessels, however, not all locations on the vessels are useful for retinal matching and registration. The method doesn't handle this issue nor explore and compare options which further encourage the keypoints to be detected on structurally more distinctive locations.
-
The proposed Vascular Geometry-Aware Attention is not fundamentally different from the attention mechanism commonly used in image correspondence models such as SuperGlue, which lacks novelty. The name "Vascular Vascular Geometry-Aware Attention" is also overselling the method. The only thing about vessels is that the inputs are keypoints that are encouraged to be detected from the vessel. The formation of the descriptor fed into the RVCG doesn't have any adaptation to vessel features, nor does the model design reflect unique thinking on "how we should address and match features from retinal vessels".
-
Superpoint-Lightglue established sparse correspondence doesn't provide exact sub-pixel level precision between the source and target keypoints, so in RGE, the control point locations can be inaccurate and so is the computed delta. Additionally, even with the blocky strategy, the computation is also largely depending on the sparsity of the keypoints around. Together this can easily cause local distortion in the registration. The author didn't discuss regularization methods to handle this issue. I also don't see any qualitative result on the final registered image in both the main paper and the appendix, which makes the registration quality dubious. Furthermore, since this topic is about deformable residual alignment, the author also needs to compare with the dense corresondence-based retinal registration baselines.
-
The author didn't compare with vessel segmentation-based registration methods, which generally shows better performance for MRIR than directly establishing correspondence from images.
-
Annotated retinal vessel map is scarce, the RSPAR is fundamentally limited by this constraint, which prevents extending this method to larger training dataset to achieve higher generalization, robustness and accuracy.
-
The details of the main test set (MICRO) is largely unavailable (what modalities and pairs, number of images for each of them), which makes the experiment much less convincing. And it is especially critical since this paper heavily relies on empirical justification.
-
The ablation study is incomplete. For example, to empirically justify the effectiveness of RGE, at least another experiment w.o. RSPAR and RGE and with VGA needs to be provided.
-
I mentioned this in 4 but reckon it's necessary to have a separate entry for this: As a paper for image registration, there's not any quantitative results on the registration but only on the correspondence. A nice-looking correspondence chart doesn't always guarantee good registration performance. For well tuned SOTA methods (this leads to another issue, see next entry), the correspondence charts usually all look very good, so a further comparison on actual registration quality is needed.
-
From what I can read from the paper, most of the baselines are not finetuned with the same data or at least on retinal images. This significantly weakens the baselines and the credibility of this paper.
Questions for authors
See weakness section