- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes SigDINO, and extention of DINO for offline signature verification. The main difference between the original is that the proposed method extracts intermediate layer patch features to preserve local details, then uses structure matching to establish correspondences between patches. It then uses the matching costs to determine the distance which is used for signature verification. They test on four datasets including cross-language evaluations.
Critical strengths
The authors have strong empirical performance across various languages. In addition, the results from DetailSemNet supports the base idea of this paper that local patches/details distance can improve signature verification performance. Even though the paper is incremental, there are some interesting parts.
Critical weaknesses
-
It's not totally discounting, but most of the performance seems to come from the DINOv3. For example, in Table 6, raw DINOv3 beats 7/11, 10/11, 4/5, 1/1 of the competitors respectively without the proposed method. Of course, I can understand that the last little bit is important, it just weakens the claims by SigDINO.
-
Equation (5) is very tuned. Specifically, layer 17 and the residual connected layer 23 are used. This seems hyper specific to this case and might not generalize to other problem sets. The authors do have some ablation, in Table 6, they report a few other stroke token layer patch proposals. However, I would like to see a larger range of tests, especially because it seems strange that the performance increases between 14 and 20. In addition, the choice of layer 23 isn't looked at all. A bigger problem is that it's not clear if the choice of layer number was chosen with a validation set or with the test set.
Questions for authors
-
Why is ChiSig left out of some of the evaluations (ex:cross language and the appendix)?
-
How are any of the specific parameters selected (ex: weight sensitivity vs matching distance, layer number, patch size, etc.)? Specifically, I know there are tables that show the empirical results, but are these empirical results done using a validation set? or are they chosen based on the test set?
3a. In Eq. (5), the equation is . Isn't this just ? what's the rationale for emphasizing L17 by double and subtracting L23?
3b. I don't think Figure 3 accurately reflects the Eq. (5). According to the caption, "Residual" is the difference between L17 and L23. But, looking at L17 and L23, I don7t think that's true. If you look closely, there are parts not lit up by theither L17 or L23 but are lit up in "Residual". If it was the difference, these areas should also not be lit up (ex: the areas between characters). In addition, there are places lit up by both and are still lit up on "Residual" (ex: the centers of characters). In addition "Enchanced" should be the sum of "Residual" and L17, but it doesn't appear to be the case at all. For example the upper right corner is lit up on "Residual" but not on "Enhanced". Actually, "Enhanced" looks almost the same as L17 except in a different color pallet.
8 comments
Response to Reviewer s2gT: W2/Q3a - Layer selection and the residual formulation in Equation (5)
Response to Reviewer s2gT: W2/Q3a - Layer selection and the residual formulation in Equation (5) Thank you for this valuable question. Equation (5) is algebraically equivalent to . We adopt this residual formulation to clarify our design rationale: we build upon the representation at layer L17, and inject the difference between L17 and the final layer L23 as a corrective signal.
Why intermediate layers? Offline signature verification relies primarily on stroke geometry — spatial positions, connectivity and local layout — rather than on object-level semantic concepts. Analyses of pretrained visual backbone representations indicate that shallow layers retain texture detail, intermediate layers capture structural layout, and deep layers move toward abstract semantics. Intermediate layers therefore offer a favourable balance between spatial awareness and contextual structure, which benefits position-sensitive tasks (Amir et al., 2021). DINOv3 shows the same tendency: in its per-layer analysis, geometry-focused tasks perform better below the final layer, and its dense prediction pipeline aggregates several intermediate-layer features. These findings motivate the use of intermediate-layer features, while the exact indices are determined by ablation.
Why L17 and L23? Our ViT-L/16 backbone contains 24 Transformer blocks with zero-based indexing. L17 lies in the upper-middle range and L23 corresponds to the final block. Table R1 reports the ablation over alternative layer pairs and fusion strategies.
Table R1. Ablation on layer combinations and fusion strategies (EER, %). ChiSig is evaluated under the 1,658-writer protocol.
| Feature configuration | Bengali | Hindi | CEDAR | ChiSig | Avg |
|---|---|---|---|---|---|
| Single layer | |||||
| L17 | 1.65 | 2.38 | 0.14 | 1.67 | 1.46 |
| L23 | 2.93 | 3.47 | 0.22 | 4.62 | 2.81 |
| Simple fusion of L17 and L23 | |||||
| L17 + L23 | 2.04 | 2.08 | 0.14 | 3.68 | 1.99 |
| L17 − L23 | 1.37 | 2.31 | 0.22 | 1.98 | 1.47 |
| concat(L17, L23) | 2.31 | 2.22 | 0.43 | 1.71 | 1.67 |
| Residual with other layer pairs | |||||
| L14 + (L14 − L17) | 1.08 | 1.96 | 0.07 | 1.88 | 1.25 |
| L14 + (L14 − L20) | 1.62 | 1.96 | 0.22 | 1.96 | 1.44 |
| L14 + (L14 − L23) | 1.12 | 1.94 | 0.14 | 2.06 | 1.31 |
| L17 + (L17 − L20) | 1.75 | 2.05 | 0.22 | 1.79 | 1.45 |
| L20 + (L20 − L23) | 1.43 | 2.33 | 0.29 | 3.04 | 1.77 |
| Ours | |||||
| L17 + (L17 − L23) | 1.03 | 1.93 | 0.07 | 1.64 | 1.17 |
Our configuration achieves the lowest average EER on all four datasets. Using L17 alone gives 1.46%, and simple fusions of L17 and L23 — addition, subtraction, concatenation — all remain at or above that level, so the gain does not come from merely having access to L23. Adopting the residual form lowers the average across all layer pairs tested, and among them L17 with a correction from L23 is the strongest: holding the base at L17, taking the correction from L23 rather than L20 reduces the average from 1.45% to 1.17%. This supports the design: L17 is retained as the primary local representation, and a cross-layer correction derived from a deeper block enhances it.
Revised Figure 3. To further verify and visually demonstrate our design, we have updated Figure 3 in the main text to an occlusion-sensitivity map. We mask each input patch sequentially and record the variation of matching distance; locations with larger distance shifts are highlighted with higher heat response. This visualization intuitively illustrates how we retain L17 as the core local representation and leverage L23 to produce a cross-layer correction term for representation enhancement.
Response to Reviewer s2gT: Q1 - ChiSig in cross-language and appendix evaluations
Response to Reviewer s2gT: Q1 - ChiSig in cross-language and appendix evaluations
Thank you for this suggestion. We are happy to add cross-language evaluation on ChiSig, which provides a strong test of transfer across writing systems: Chinese signatures differ substantially from those in the Bengali, Hindi and CEDAR datasets in character structure and stroke arrangement. Few studies in the public literature report cross-language signature verification involving ChiSig, which is the main reason the original manuscript did not include cross-language baseline comparisons for this dataset; we will clarify this in the revision.
Of the 1,658 eligible ChiSig writers, only 400 have both genuine and forged signatures; the remaining 1,258 (75.87%) have genuine signatures only. We therefore evaluated two protocols. The 395-writer balanced protocol uses 395 writers with exactly five genuine and five forged signatures each, under writer-disjoint train/test splits. The full 1,658-writer protocol retains all eligible writers under a writer-disjoint 829/829 split, which reflects the practical setting where forged signatures are scarce.
Table R1. In-domain and cross-language EER (%) under the two ChiSig protocols; lower is better. Rows are test datasets, columns are training datasets. A single value means the result is identical under both protocols; "395 / 1658" gives each protocol's result.
| Test / Train | Bengali | Hindi | CEDAR | ChiSig |
|---|---|---|---|---|
| Bengali | 1.03 | 3.26 | 7.75 | 13.19 / 10.78 |
| Hindi | 11.75 | 1.93 | 10.16 | 14.21 / 10.19 |
| CEDAR | 5.87 | 7.75 | 0.07 | 16.45 / 6.74 |
| ChiSig | 12.13 / 20.48 | 13.15 / 21.69 | 16.19 / 20.52 | 0.61 / 1.64 |
Under the 395 protocol the average EER over the six cross-language directions involving ChiSig is 14.22%. Given the substantial differences in character structure and stroke organization between Chinese and the other three writing systems, this indicates reasonable cross-writing-system transfer.
Training on ChiSig and testing on the other three datasets yields averages of 14.62% (395) and 9.24% (1658), so broader Chinese training coverage improves transfer outward. The reverse direction behaves differently: training on the other three and testing on ChiSig gives 13.82% (395) and 20.90% (1658). Under the 1658 protocol the Chinese test set spans a more diverse writer population, and the resulting shift in the distance distribution moves the operating point, raising the EER. Transfer to this broader Chinese distribution therefore still has room for improvement.
The two protocols are complementary: the 395 protocol characterises cross-language performance under class balance, while the 1658 protocol reflects the practical case where forgeries are scarce. We will report both protocols in the revision to give a fuller picture of the model's performance.
Response to Reviewer s2gT: W1- Novelty and isolation of component contributions
Response to Reviewer s2gT: W1 - Novelty and isolation of component contributions
We sincerely thank you for these thoughtful comments and for reading Table 6 so closely. Few prior works have explored large-scale self-supervised models for offline signature verification. This requires bridging the distribution gap between natural images and signature images, where discriminative cues lie in local stroke structures rather than object-level semantics. Meanwhile, we would like to clarify why pre-trained representations alone cannot tackle the two challenges we focus on: limited training writers in downstream tasks and cross-lingual generalization, and we provide new experimental evidence for each of our two core designs.
1. Signature-domain adaptation for limited-writer training.
Signature-domain adaptation uses unlabeled synthetic signatures prior to downstream supervised training, with the aim of reducing reliance on a large set of labeled training writers.
We realize that one point in our ablation tables was not stated clearly. "Raw DINOv3" in Tables 6 and 7 retains our cross-layer feature processing and local structural matching module; only the signature-domain self-supervised adaptation is removed. Its numbers therefore reflect unadapted DINOv3 combined with our local structural matching, not raw DINOv3 global features. We will relabel this row in the revision.
Table R1. Effect of signature-domain adaptation under five training writers. Both settings use the same verification architecture. Reproduced from Table 7; EER (%), lower is better.
With the verification architecture held fixed, signature-domain adaptation lowers EER on all four datasets, reducing the average from 16.60% to 9.05% (-7.55 points). This provides direct evidence of its benefit under limited-writer supervision.
2. Local structural matching for cross-language transfer.
Local structural matching addresses the need to compare local stroke structures across writing systems. Aggregating each signature independently into a single vector before comparison can weaken subtle local stroke differences. SigDINO therefore preserves foreground patch representations, establishes bidirectional soft correspondences, and then measures local discrepancies and aggregates the matched relations, so that the resulting representation reflects interactions between the two signatures rather than each one in isolation.
To examine this design directly, we ran a head-replacement experiment. We kept the signature-adapted backbone, the cross-layer enhancement, and the foreground feature extractor unchanged, and replaced only the local structural matching module with an MLP verification head of comparable parameter count; verification then uses the cosine distance between independently computed signature embeddings.
Table R2. Verification-head comparison; EER (%), lower is better. Rows give the training dataset and head; columns give the test dataset. The "Local structural matching" rows are from Tables 1, 2 and 4.
The MLP variant reaches an average in-domain EER of 2.77% over the three datasets and 15.11% over the six cross-language transfer directions; the corresponding figures for local structural matching are 1.01% and 7.76%, with lower EER in every one of the six transfer directions. The gap is modest in domain and much larger across languages, which is consistent with our motivation: preserving and comparing local correspondences before final aggregation matters most when the two signatures come from different writing systems.
3. Positioning of the contribution.
We would summarize our contribution as combining signature-domain representation adaptation with foreground local structural matching to address limitations that general-purpose pretrained representations exhibit on signature images: unlabeled signature adaptation supports training with few writers, while bidirectional local correspondences and matched-relation aggregation support cross-language verification. The ablations above indicate that the original pretrained features alone are not sufficient for this task, and that the two proposed components contribute substantial additional gains on top of them.