- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper's proposition is the skin lesion representations should preserve clinical meaningful relationships across different acquisitions method and condition. With self-supervised representation learning as the motivation, they introduced Cross-dataset INter-view relational Distillation with Evidence-masked Recovery and Stabilization (CINDERS), with a teacher-student model. The main contribution is formulating self-supervised learning as relational recovery from incomplete evidence, demonstrated through a shared student, and evaluated learned representation through internal and external cross-acquisiation retrieval.
Critical strengths
The proposed Establish-Break-Rebuild-Consolidate in the method, an interesting idea in representation learning. Formulating SSL as relational recovery from incomplete evidence, demonstrated through a shared student, and evaluated learned representation through internal and external cross-acquisiation retrieval.
Critical weaknesses
The research questions can be clearer and improve the clarity of the association with the results reported. The review and references are not up-to-date, particularly, Table 1 is comparing with dated method 2020-2022, how about recent works between 2023-2026. It is promising to demonstrate the learned representation through internal and external cross-acquisition retrieval, but lack evidence of this improves the recognition rate. The evaluation lack robustness and rigour.
Questions for authors
Table 1 is comparing with dated method 2020-2022, how about recent works from CVPR 2026? With the improved of learned representation (or your results section), how do these perform on cross-domain in skin lesion recognition? Can this method be generalized to other domain, like natural objects?
3 comments
Result for natural image generalisation
Thanks for your response. Could you please outline what are the changes on the revised manuscript (if you have one, please upload). The generalisation aspect is not clear and no results reported in the authors' responses. I'll keep my score for now.
Thank you for your follow-up. We have prepared a revised manuscript and supplementary material, with the modifications highlighted in blue. We summarize the changes below.
1. Changes in the revised manuscript
- Introduction (p. 2): Refined the contributions to distinguish relational Rebuild, evidence removal, and temporal staging.
- Related Work (p. 3): Expanded the discussion of recent relational self-supervised learning and added cross-modal representation learning.
- Method (pp. 4–7): Clarified the relational objectives, teacher–student input formations, physical patch-token removal, and temporally staged optimization.
- Controlled ablations (Table 2, p. 8): Added multi-seed experiments comparing relational Rebuild, MAE reconstruction, and feature matching under attention-guided and random masking. These comparisons use ten runs per setting and directly examine whether relational recovery provides improvements beyond conventional reconstruction and feature distillation.
- External recognition (Table 5, p. 10): Expanded the linear-probe evaluation to report precision and recall alongside AUC on MILK10K and DDI.
- Supplementary material: Added detailed experiments on relational versus similarity-KL distillation, within- versus cross-acquisition relationships, masking ratios, temporal staging, and class-wise recognition performance.
2. Clarification of generalization evidence
The external Derm7pt–MILK10K retrieval evaluation was already included in the original manuscript (Table 4). We retain this experiment in the revised version and highlight its results here to clarify the generalization evidence.
Unlike the internal DermaMNIST-C/PAD-UFES-20 evaluation, this experiment measures retrieval between two independently collected external datasets. Each query searches the other dataset, with the evaluation covering both within-acquisition and cross-acquisition retrieval.
Compared with frozen DINOv3, CINDERS achieves:
- Dermoscopic-to-clinical R@1: 23.63% to 36.72%.
- Clinical-to-dermoscopic R@1: 29.87% to 35.72%.
- Four-direction mean R@1: 29.61% to 36.65%.
- Cross-acquisition harmonic mean: 26.38% to 36.21%.
These existing results demonstrate improved representation compatibility across external dermatology datasets and acquisition conditions. They complement the newly added controlled ablations, which isolate the contribution of relational Rebuild.
3. Scope of generalization
Our experimental evidence supports generalization across independently collected skin-lesion datasets and clinical/dermoscopic acquisition conditions. It does not establish generalization to unrelated natural-image datasets, which remains an important direction for future evaluation.
We hope this summary clarifies the manuscript revisions and the distinction between the newly added experimental evidence and the external generalization results already reported in the original submission.
Thank you for your constructive comments. We clarify the research questions and provide experiments on training objectives, masking, staging, and external recognition.
Weakness 1 (research questions). We study three questions: (1) Does recovering the intact teacher’s relational structure from incomplete visual evidence improve retrieval across both within-acquisition (D→D, C→C) and cross-acquisition (D→C, C→D) settings? (2) How do the strategy and extent of evidence removal affect relational representation learning? (3) Does temporal staging improve optimization beyond relational Rebuild?
To evaluate the learning objective, we compared relational Rebuild, MAE, and feature matching under two mask-selection strategies: the 40 highest-attention patches versus 40 randomly selected patches. Each setting used 10 runs of 50 training epochs. Relation achieved Mean4/Cross-HM of 58.05/44.25% (attention) and 58.40/44.46% (random), versus MAE’s 52.67/34.27% and 53.51/36.02%. The Cross-HM improvements over MAE were +9.98/+8.45 points, with p=1.31×10−11/1.78×10−10, respectively. A separate 10-run staging comparison gives a +1.41-point Cross-HM improvement (p=0.0306).
Weakness 2 (recent methods, 2023–2026). We expand the related-work discussion to Relational Representation Learning (Maes et al., 2025), X-Sample Contrastive Loss (Sobal et al., ICLR 2025), and Relational Visual Similarity (CVPR 2026). These provide important precedents for relational learning; the latter studies relations among elements within images, whereas CINDERS learns to recover relationships between images after evidence removal across unpaired acquisition domains. Our SSL comparisons train the DFF using each method’s objective while the pretrained DINOv3 backbone remains frozen.
To distinguish our relational objective from conventional distillation, we compared it with similarity-KL and feature matching using attention-selected masking of 123 patches, same-state optimization, and 10 runs of 100 training epochs:
Relation improves Mean4 by 6.43/7.77 points and Cross-HM by 11.02/12.99 points over similarity-KL/feature matching.
Weakness 3 (skin-lesion recognition). We evaluated linear-probe classification on external MILK10K and DDI datasets. We froze the representation network, trained a linear classifier on labeled training samples, and evaluated held-out diagnostic AUC using the 10 runs with random selection of 40 masked patches:
Relational Rebuild achieves the highest mean AUC in these two datasets. Differences are modest, so retrieval remains the principal evaluation outcome. Unlike classification, which only requires representations to separate diagnostic classes, retrieval requires preserving fine-grained inter-image relationships while bridging substantial appearance differences across acquisition modalities, making it a more demanding test of the relational representation targeted by our method.
Weakness 4 (robustness and masking policy). We compared teacher-attention selection against random masking for 40, 96, and 123 patches out of 196, with each experiment trained for 100 epochs. The table reports fine-diagnosis retrieval R@1 (%), mean ± standard deviation across runs:
With 40 masked patches, Top improves D→C by 9.83 points but reduces C→D by 14.79 relative to Random; Random has higher Mean4 and Cross-HM. With 96 patches, attention selection improves both aggregate metrics; with 123, Top and Random are comparable overall. This inconsistent evidence across masking ratios means we do not claim that attention-based mask selection is universally favorable.
Question (natural-image generalization). Relational Representation Learning demonstrates relational modeling on CIFAR-10, CIFAR-100, and ImageNet-100, supporting the broader principle beyond medical images. CINDERS requires no lesion diagnosis labels or paired lesions for training. However, that prior study does not test CINDERS’s Break–Rebuild mechanism; experiments on natural objects remain an important future direction.