- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper is motivated by the observed asymmetry between bona-fide and spoof face samples in terms of their class distributions and feature representations. Based on this observation, the paper proposes HypLive-FAS, a hyperbolic live-manifold learning framework that models bona-fide representations using a PCA-anchored nonlinear manifold and identifies spoof samples through Jacobian-guided deviations from the learned manifold. Moreover, a liveness-preserving augmentation strategy further improve generalization capability. The experiments on commonly-used FAS datasets demonstrate competitive performance against existing methods.
Critical strengths
The experiment results show competitive performance against existing methods under cross-domain protocols, and the ablation studies provide empirical evidence for the effectiveness of the proposed components.
Critical weaknesses
- The motivation that bona-fide faces exhibit compact and consistent representations while spoof samples are heterogeneous has been extensively explored in prior FAS studies. Both one-class asymmetric representation and hyperbolic manifold-based learning have been extensively explored in recent studies. However, this paper proposed insufficiently novel contributions to the FAS community.
- Although the paper introduces a PCA-anchored nonlinear manifold and Jacobian-guided deviation scoring, their fundamental differences and advantages over existing approaches are not sufficiently established. Consequently, the methodological contribution appears incremental.
Questions for authors
What is the specific motivation of adopting PCA-anchored nonlinear manifold and Jacobian-guided deviation scoring, or why the authors use these two methods as the implementation scheme. If additional ablation study can demonstrate the effectness these two desgins over simpler alternatives.
5 comments
Response to W2 & Q2 (part 1)
Thank you for your question.
The specific motivation for using a PCA-anchored nonlinear manifold is as follows: the centered live tangent-space representation lies in a 512-dimensional space, but its shared authenticity cues are expected to concentrate along a smaller number of principal variation directions. PCA extracts these principal directions from source-domain live samples and provides a stable initialization for subsequent nonlinear manifold learning. Starting from the linear structure initialized by PCA, the nonlinear decoder further learns the local curvature of the live manifold, while the anchoring term prevents this structure from deviating too far from the PCA prior.
This choice is consistent with our modeling assumption about live structure in FAS. The live attributes of a real face arise from its genuine facial structure and direct capture process. Although they are affected by identity, pose, illumination, and imaging conditions, these variations are usually dominated by a limited number of factors. Therefore, the effective variation dimensionality of live features in the 512-dimensional space is expected to be lower than the original feature dimension. PCA extracts the principal directions with the largest variance from source-domain live samples and compresses live information into a low-dimensional subspace. Thus, PCA is not an arbitrary generic dimensionality-reduction operation; it is a structural initialization that matches the FAS assumption that shared live cues concentrate along a small number of principal directions.
The motivation for Jacobian-guided deviation scoring is as follows: the raw reconstruction residual does not necessarily correspond entirely to spoof cues. It may contain normal variation along the live-manifold directions. Some genuine samples may lie at different positions on the live manifold, and their changes in identity, pose, illumination, or imaging conditions may also produce a large reconstruction residual. Although these variations are not fully recovered by the low-dimensional reconstruction, they may still follow local directions of the live manifold and therefore should not simply be treated as spoof cues.
Let
\tilde y=G(a),\qquad r=y-\tilde y.$$ Around the current sample position $a$, the decoder can be represented by the first-order Taylor expansion $$G(a+\Delta a) \approx G(a)+J_G(a)\Delta a,$$ where $$J_G(a)=\frac{\partial G(a)}{\partial a}$$ is the decoder Jacobian at the current sample position. The Jacobian provides the local live-variation directions around the current sample. Through regularized local fitting with a ridge term and a primitive prior, we estimate the variation that can be explained by the current live manifold, $J_G(a)\hat{\Delta a}$, and compute $$r_{\mathrm{unexplained}}=r-J_G(a)\hat{\Delta a}.$$ The local fitting therefore attempts to absorb changes that can be explained by the live manifold, while the remaining regularized deviation is used as the spoofness score. A larger score indicates that the sample is more difficult to explain using live structure and is therefore more likely to be a spoof. This motivation is supported jointly by the Jacobian-related residual ablation in the original manuscript and by the new structured ablations that address the simple alternatives suggested by the reviewer. In the original results, the mean HTER/AUC were **2.73%/99.09%** when using the raw reconstruction residual, **1.82%/99.52%** after adding Jacobian local fitting, and **1.19%/99.64%** after further adding the primitive prior. These results indicate that Jacobian local fitting filters out some variation explainable by live structure, while the primitive prior provides an additional constraint on the local fitting.Response to W2 & Q2 (part 2)
To directly answer the reviewer's question about why we use a PCA-anchored nonlinear manifold and Jacobian-guided deviation scoring, and whether they outperform simpler alternatives, we conducted supplementary comparisons on the four target domains of Protocol 1 with three random seeds. The data splits, training recipe, evaluation method, and checkpoint-selection rule were kept identical:
\hline \text{Variant} & \text{Change relative to the full model} & \text{HTER (\\%)} & \text{AUC (\\%)} \\\\ \hline \text{Full HypLive-FAS} & \begin{array}{l} \text{PCA anchor, nonlinear decoder,} \\\\ \text{and sample-dependent Jacobian all retained} \end{array} & \mathbf{1.19} & \mathbf{99.64} \\\\ \text{Linear decoder} & \begin{array}{l} \text{Nonlinear decoder replaced with} \\\\ \text{a learnable linear decoder} \end{array} & 2.04 & 99.39 \\\\ \text{w/o PCA anchor} & \begin{array}{l} \text{Nonlinear decoder retained, but} \\\\ \text{PCA subspace anchoring removed} \end{array} & 2.09 & 99.36 \\\\ \text{Shared linear direction} & \begin{array}{l} \text{Sample-dependent } J(a) \text{ replaced with} \\\\ \text{a shared learnable } W_0 \end{array} & 1.87 & 99.47 \\\\ \hline \end{array}$$ First, the linear decoder retains only a global linear structure, and its HTER increases to 2.04%, indicating that a purely linear structure cannot adequately describe the local curvature of the live manifold. Second, after removing the PCA anchor, the nonlinear decoder is still used, but HTER increases to 2.09%, indicating that allowing the manifold to learn freely can cause the low-dimensional structure to drift unstably. Finally, the shared linear direction $W_0$ is a direct simplified alternative to the sample-dependent Jacobian. Its HTER is 1.87%; although it provides a useful approximation, it remains higher than the 1.19% of the full model, indicating that sample-dependent local directions contain information that cannot be fully replaced by a shared linear direction. The corresponding results have been added to Table 7 in Section 4.3.2 of the revised manuscript. These experiments support the roles of the PCA anchor, nonlinear decoder, and sample-dependent Jacobian in live-structure modeling and local-variation explanation.
Response to W1
Thank you for the comment. We agree that live compactness, spoof heterogeneity, class asymmetry, and hyperbolic representation learning themselves are not concepts introduced for the first time in this paper. The contribution of this work lies in translating these priors into a concrete mechanism for live-structure modeling and attack discrimination.
Existing asymmetric FAS methods shape class distributions at different levels. SSDG aggregates live samples and disperses spoofs using domain relationships, but domain labels do not directly describe the structure of live samples themselves. DiVT enhances class compactness through live concentration and spoof separation, but a global concentration constraint is not well suited to representing legitimate intra-class variation caused by identity, pose, and illumination. TACL adjusts local representations through sample relationships and token-level contrastive learning, but it does not explicitly construct a reconstructable live manifold or structurally decompose local residuals.
In contrast, HypLive-FAS learns a PCA-anchored nonlinear manifold from source-domain live samples and uses a sample-dependent Jacobian to fit local live variation. It then uses the remaining regularized deviation for attack discrimination. Thus, the distinction of this paper does not lie in proposing class asymmetry again, but in realizing it as a unified mechanism of live-structure learning, local-variation explanation, and deviation scoring.
Existing hyperbolic FAS methods also use hyperbolic space, but their hyperbolic modeling mainly serves instance–prototype relationships, hierarchical prototype modeling, distribution alignment, or hyperbolic classification. For example, HPDR primarily uses hyperbolic space to model relationships among instances, prototypes, and hierarchical prototypes, while HML-FAS combines hyperbolic enhancement, distribution alignment, and a hyperbolic classifier to learn robust cross-domain representations. In contrast, HypLive-FAS further exploits the negative curvature and radial expansion of hyperbolic space to directly construct a compact source-domain live manifold and discriminate attacks through local deviations from this manifold.
We have further clarified these distinctions in the Related Work section of the revised manuscript and added Table 7 to verify the roles of the PCA anchor, nonlinear decoder, and sample-dependent Jacobian.