- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes SPECTRA-Gaze, a gaze target estimation (GTE) method. SPECTRA-Gaze consists of an HSSI module which alters scene features based on “head information”. An RCNSI module considers “reliability” to refine the final heatmap prediction. The proposed method is evaluated on GazeFollow and VideoAttentionTarget.
Critical strengths
None
Critical weaknesses
The quantitative results are weak. Not only do the authors not evaluate on the commonly used ChildPlay dataset, they conveniently omit PaGE ViT-H+ (which is reported in the original PaGE paper and those reported numbers would out-perform SPECTRA-Gaze. No explanation is provided for either choice. Furthermore, neither the perf. Improvements shown in Table 1 in comparison to PaGE ViT-B nor the ablation in Table 2 show significant improvements in the reported metrics.
The proposed HSSI and RCNSI modules are highly complex, insufficiently motivated, and not very intuitive. For instance, there is no clear reason for HSSI to operate in the frequency domain (using DCT), nor is the benefit of using the frequency domain shown via ablation study (there’s only a HSSI on/off). RCNSI is similarly contrived, non-intuitive, and inconsequential. In fact, we can see that barely any of the metrics that improve in Table 2 (ablation) do so with sufficient increase, while the VAT AP metric actually worsens compared to the base model. I may even guess that such differences can come around simply by training with different random seeds.
Questions for authors
Your network architecture design seems to be heavily influenced by PaGE. What are the most important novel contributions made by SPECTRA-Gaze?
What are the ChildPlay numbers like for Tables 1 and 2? What about GOO-Real? Please note that both Gaze-LLE and PaGE papers provide results for ChildPlay and GOO-Real.