- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes SSC-LoRA for 3D gaze estimation. It addresses the concern that visual foundation models focus too much on appearance cues, such as identity and lighting, rather than gaze. The method uses SVD and gradients from gaze supervision and CLIP-generated appearance labels to select weight components. It then adjusts LoRA updates to suppress changes in appearance-related directions and strengthen updates in gaze-related directions, without adding trainable parameters. The authors evaluate SSC-LoRA with CLIP and DINOv2 backbones on five benchmarks, covering both in-domain and cross-domain settings, and provide ablations of the main design choices.
Critical strengths
- The problem is practically relevant. Adapting VFMs to gaze regression without letting them latch onto appearance shortcuts matters for cross-domain deployment.
- The method is simple and cheap to plug in. It reuses LoRA's A and B, adds no trainable parameters.
- The evaluation covers five datasets and four backbones, and the appendix includes several useful analyses, such as the PEFT comparison (Table 6), the pseudo-label accuracy check on IVGaze (Table 9), the alternative gaze supervision study (Table 8), and the layer-wise overlap analysis (Figure 8).
Critical weaknesses
-
The motivation itself is not very new. The idea that gaze-irrelevant appearance factors (identity, illumination, accessories, expression) dominate learned features and hurt cross-domain gaze estimation is the central premise of an established line of generalizable gaze estimation work, including PureGaze, Gaze-Consistent, FSCI, and CLIP-Gaze, which the paper itself cites in the Introduction and Related Work. The paper calls this “factor-sensitivity mismatch,” but it is unclear what new insight this term adds. This makes it hard to view the observation as a separate contribution.
-
Several claims overstate the results. The text says SSC-LoRA "also outperforms OmniGaze", but in Table 1 OmniGaze is better on MPIIFaceGaze, EyeDiap, and Gaze360, and in Table 2 it is better on both cross-domain targets by about 1°. The authors attribute this to extra training data, but this should be stated plainly rather than reported as outperformance. The IVGaze comparison with GazeDPTR in Section 4.1 refers to a method that is not in Table 1. More broadly, most baselines in Tables 1–2 use ResNet- or small Transformer backbones, so comparing them with CLIP-L/14 or DINOv2-L/14 mixes the effect of the backbone with that of the method. The fair comparison is against PEFT methods on the same backbone (Table 6), which belongs in the main paper.
-
The gains are not consistent across backbones. In Table 6, SSC-LoRA performs well with CLIP, but its advantage is less clear with DINOv2. On DINOv2-B/14, PiSSA and DoRA achieve lower errors on Gaze360. On DINOv2-L/14, DoRA performs better in all three settings, although SSC-LoRA still improves on vanilla LoRA. In Table 1, all SSC-LoRA variants perform worse than Dilated-Net and GazeTR on GazeGene. The paper should discuss these limitations and make its claims of consistent superiority more specific.
-
The evidence for reduced shortcut learning is still limited. The method blocks updates in selected gaze-irrelevant directions, but this alone does not show that the model relies less on appearance cues. Figure 11 is hard to interpret. Some highlighted pairs appear closer under SSC-LoRA, but the overall improvement is unclear. A clearer visualization and more direct quantitative evidence would help. For example, does SSC-LoRA make more stable predictions when lighting or other appearance factors change while gaze stays the same?
-
The presentation needs improvement. Much of Section 3 and Appendix A (Definitions 3.2 and 3.3, A.2–A.4) formalizes standard properties of orthogonal projectors at length, while key practical details are missing from the main text. There are also minor issues: the absolute value is missing in the last term of Eq. 2, the OmniGaze citation year is inconsistent ([NeurIPS25] vs. 2026 in the references), and there are grammatical errors (e.g., "SSC-LoRA ... achieve", "Figure 4 show", "baselines includes").
Questions for authors
- Why do the gains largely disappear for DINOv2 (Table 6) even though Figure 10 shows similar appearance clustering? Does the use of CLIP pseudo-labels for DINOv2 scoring play a role?
- How does SSC-LoRA compare with LoRA in terms of total training time, peak GPU memory usage, and inference cost?