- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper presents CryoTracer, a method to trace filaments in cryo-EM images. Each filament is predicted directly as an ordered line with five points, using an adapted RF-DETR. The loss is based on the Fréchet distance and does not depend on the direction of the line. The model is first trained on synthetic images and then fine-tuned on real annotations. On two datasets (TMV and an in-house α-synuclein dataset) it clearly outperforms Topaz, crYOLO and the RELION AmyTracer. The authors also release new annotations for EMPIAR-10022.
Critical strengths
- The paper brings direct polyline prediction, known from map and lane detection, to filament picking in cryo-EM. Together with the synthetic pretraining it clearly improves over the particle pickers that are used in cryo-EM pipelines today. The idea itself is not new, but the transfer to this domain works well.
- The ablations are well done and show the effect of the synthetic pretraining, the Fréchet loss and the architecture choices. The new annotations for EMPIAR-10022 are useful for the community.
Further strengths:
- The setting with only a few annotated images is realistic.
- Code is provided and the main results are averaged over several seeds.
Critical weaknesses
- Important filament tracing methods are missing. Most important is TARDIS [1], which does instance segmentation of filaments in electron microscopy images and is open source. Its pretrained models are developed and demonstrated mainly on cryo-ET tomograms (and TIRF fluorescence), so it is not clear whether they transfer to 2D cryo-EM micrographs such as those used here. It should still be included as a baseline, as was done for AmyTracer, or the paper should explain why it cannot be used. Other established tracing methods are also neither discussed nor compared: SOAX [2], SIFNE [3], FIESTA [4], MTrack [5], Liu et al. [6–8], DRIFT [9], Masoudi et al. [10] and KnotResolver [11]. The current baselines are mostly particle pickers, and the metric rewards complete filaments, so it is unclear how large the gain over real tracing methods is.
- It is not shown that the method generalizes. Only two datasets are used, and one of them is private. On α-synuclein, images from the same recording session are in the training and in the test set. They share the sample and the recording conditions.
Further weaknesses (can be fixed in a revision):
- The related work also misses other relevant areas.
- Synthetic training data for microscopy, for example AnyStar [12], CARE [13], MicSim_FluoMT [14], biobeam [15] and SynthMT [16]. This matters here, because the model trained only on synthetic data does not work at all on real data. So the gap between the synthetic and the real images is large.
- Generalist segmentation models like SAM 3 [19], and their microscopy variants such as µSAM [20], CellSAM [21] and Cellpose-SAM [22]. SAM 3 with a text prompt would be an easy additional baseline.
- Polyline prediction outside microscopy.
Without this context, the novelty of the method is overstated.
[1] R. Kiewisz et al. Accurate and fast segmentation of filaments and membranes in micrographs and tomograms with TARDIS. bioRxiv, 2024.
[2] T. Xu et al. SOAX: a software for quantification of 3D biopolymer networks. Scientific Reports, 2015.
[3] Z. Zhang, Y. Nishimura, P. Kanchanawong. Extracting microtubule networks from superresolution single-molecule localization microscopy data. Molecular Biology of the Cell, 2017.
[4] F. Ruhnow, D. Zwicker, S. Diez. Tracking single particles and elongated filaments with nanometer precision. Biophysical Journal, 2011.
[5] V. Kapoor et al. MTrack: automated detection, tracking, and analysis of dynamic microtubules. Scientific Reports, 2019.
[6] Y. Liu et al. Densely connected stacked U-network for filament segmentation in microscopy images. ECCV Workshops, 2018.
[7] Y. Liu et al. Intersection to overpass: instance segmentation on filamentous structures with an orientation-aware neural network and terminus pairing algorithm. CVPR Workshops, 2019.
[8] Y. Liu, J. Caplan, C. Kambhamettu. Extraction and quantification of actin cytoskeleton in microscopic images using a deep learning based framework and a curve clustering model. ICPR, 2022.
[9] Y. Liu, S. Peng, J. Caplan, C. Kambhamettu. Pick and trace: instance segmentation for filamentous objects with a recurrent neural network. MICCAI, 2023.
[10] S. Masoudi et al. Instance-level microtubule tracking. IEEE Transactions on Medical Imaging, 2020.
[11] D. Khatri, S. A. Yadav, C. A. Athale. KnotResolver: tracking self-intersecting filaments in microscopy using directed graphs. Bioinformatics, 2024.
[12] N. Dey et al. AnyStar: domain randomized universal star-convex 3D instance segmentation. WACV, 2024.
[13] M. Weigert et al. Content-aware image restoration: pushing the limits of fluorescence microscopy. Nature Methods, 2018.
[14] A. A. Laydi et al. Adaptive attention residual U-Net for curvilinear structure segmentation in fluorescence microscopy and biomedical images. arXiv, 2025.
[15] M. Weigert et al. Biobeam: multiplexed wave-optical simulations of light-sheet microscopy. PLOS Computational Biology, 2018.
[16] M. Koddenbrock et al. Synthetic data enables human-grade microtubule analysis with foundation models for segmentation. PLOS Computational Biology, 2026.
[19] N. Carion et al. SAM 3: segment anything with concepts. arXiv, 2025.
[20] A. Archit et al. Segment anything for microscopy. Nature Methods, 2025.
[21] M. Marks et al. CellSAM: a foundation model for cell segmentation. Nature Methods, 2025.
[22] M. Pachitariu, M. Rariden, C. Stringer. Cellpose-SAM: superhuman generalization for cellular segmentation. bioRxiv, 2025.
Questions for authors
Clarification and additional analysis (the answers could change my assessment):
- How does CryoTracer compare to TARDIS [1] on your datasets? If TARDIS cannot be used on 2D cryo-EM images, please explain why.
- How much of the improvement on α-synuclein comes from images of the same session in training and test? Can you report results with a split by session?
- How exactly are the Topaz outputs converted into filaments? As I understand it, each filament becomes a straight segment between its end points, while the ground truth can be curved. What is the effect of this endpoint interpolation on the Topaz scores? Would the ranking change if the traces followed the picked coordinates?
Suggestions (not part of my assessment):
- Please report Skeleton IoU (SKIoU [6,16]), or explain why it does not fit. It compares the center lines directly and does not depend on the chosen box width like Box IoU does. It can be computed on your existing predictions without retraining.
- The baselines were run once, while CryoTracer is averaged over five seeds. Reporting the variation for the baselines as well would make the comparison fairer.
- Five points per filament is not enough for strongly curved filaments, as you note yourselves. A flexible number of points or a spline could help.