- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Well, InfinityFace adapt the Infinity bitwise VAR text-to-image model to blind face restoration, feeding a corrected LQ suffix at each scale and LQ visual features alongside the text in cross-attention. It leads MANIQA and TOPIQ on real-world sets but has the lowest CelebA-Test PSNR.
Critical strengths
Putting LQ information into the unresolved suffix fits bitwise next-scale prediction well and differs from VARSR's static LR prefix. Real-world result are good, best or second-best on every no-reference metric on LFW and Wider, and the user study gives it the highest Rank-1 rate on every split.
Critical weaknesses
-
Identity is never measured, though CodeFormer and OSDFace report it. This matters because CelebA-Test PSNR is below the LQ input, and Fig. 9 shows text alone changes age texture.
-
The ablation is thin. Table 3 is Wider-only with no-reference metrics, every variant keeps an LQ suffix, and suffix control alone lowers MUSIQ (74.02 to 73.54) though the text says all metrics improve.
-
VARSR, the closest baseline, only has its VQ-VAE fine-tuned on FFHQ (line 318). If the rest stays a generic SR model, the gap mostly reflects face-specific training, not the proposed conditioning.
Questions for authors
-
In Fig. 9 the glasses visible in the LQ input vanish once the caption drops them. How often do captions miss attributes, and can LQ evidence override the text?
-
What are the latency and peak memory, including Qwen captioning, versus OSDFace and CodeFormer on the same GPU?
-
Why re-synthesize CelebA-Test with your own degradation (line 297) rather than use a version from prior work?
8 comments
In response to Reviewer Regy’s questions (Q1-Q3)
Role of degradation. Our fixed-caption degradation analysis suggests that discernible LQ cues can support recovery of attributes absent from or in conflict with the caption, while weaker cues leave more room for text and the generative prior to influence the output.
In Section 5.4 and Figure 8 of the revised manuscript, we examine two examples across four degradation levels from mild to severe, keeping one caption fixed for each example. In the upper example, the caption omits a visible cap and instead describes short dark hair. The first two restorations retain a recognizable cap despite this description; at the heaviest degradation, short dark hair replaces the cap, consistent with the caption. In the lower example, the caption omits facial expression and mouth state. The first three restorations retain a tooth-bearing smile, while the heaviest degradation produces a closed-mouth smile: the broad expression persists, but the visible teeth are lost. This behavior depends on the visibility of the particular attribute in the LQ image; these examples do not establish a universal degradation threshold at which text takes precedence.
Interpretation of Figure 9 in the original paper (now Figure 13 in the revised manuscript). The changes in glasses and age-related texture across captions illustrate how text can influence the restored appearance for the same LQ input. The purpose of this figure is to demonstrate a possible use of this capability: when severe degradation makes an attribute difficult to discern, reliable information about the subject from another source could inform the caption and guide restoration toward the subject's known characteristics.
Q2: Inference time and peak GPU memory.
We report per-image inference latency and peak allocated GPU memory for the compared methods under fixed single-GPU evaluation protocols.
| Method | Latency (s) | Peak memory (GiB) |
|---|---|---|
| CodeFormer | 0.037 | 0.82 |
| DAEFR | 0.051 | 1.43 |
| DifFace | 2.599 | 1.03 |
| OSDFace | 0.142 | 4.88 |
| VARSR | 0.299 | 8.13 |
| InfinityFace | 0.698 | 18.08 |
| Qwen captioning + InfinityFace | 1.736 | 34.42 |
With an existing caption, InfinityFace includes T5 encoding and restoration, taking 0.698 s/image with 18.08 GiB peak memory. Including online Qwen captioning increases latency to 1.736 s/image and peak memory to 34.42 GiB with all models co-resident.
Q3: Why synthesize CelebA-Test inputs rather than use a released version?
Like CodeFormer and DifFace, we synthesize our own test inputs. For CelebA-Test, we use the Real-ESRGAN pipeline. All methods are evaluated on the same synthesized inputs and the same real-world benchmarks.
Thank you for the constructive questions and we will address the concerns raised in the Weaknesses section in a separate follow-up response.
Okay, I'll wait for your weakness.
In response to Reviewer Regy’s questions (Q1)
We thank Reviewer Regy for the constructive feedback. We have made every effort to address the three questions (Q1–Q3) through additional experiments and analyses, manuscript revisions, and detailed point-by-point responses below. We welcome further questions and discussion.
Q1: (1) How often do captions miss attributes?
Caption audit. We selected 100 images at evenly spaced indices from the 3,000-image CelebA-Test set and conducted a careful manual audit of their Qwen-generated captions. For each sample, we inspected the caption alongside the LQ input and its corresponding GT image, reviewing each attribute to identify missing descriptions and assess the accuracy of explicit claims, using GT as the reference. The audit covered gender, age, skin tone, hair color, expression, and additional features such as earrings, mustaches, and eye makeup. The prompt permits descriptions of clearly visible attributes and excludes uncertain details.
Category definitions. We use five categories to evaluate captions generated from LQ images against the corresponding GT images. Correct denotes an explicit description supported by GT. Incorrect denotes a description that contradicts GT or makes an attribute claim without visible support in GT. Not mentioned denotes a predefined basic attribute absent from the caption; for example, person does not specify gender. Omitted denotes an additional feature visible in GT but absent from the caption. Not applicable denotes cases where GT contains no additional feature requiring description and the caption makes no additional feature claim.
Across the five basic attributes, captions left attributes unmentioned in 30 of 500 image–attribute pairs (6.0%): gender (3%), age (4%), skin tone (2%), hair color (2%), and expression (19%). Additional features visible in GT were omitted in 4 of 100 captions (4%). Missing descriptions were therefore most frequent for expression. The categories below distinguish caption completeness from description accuracy.
Correct descriptions of the five basic attributes range from 81 to 98 per attribute across the 100 captions. Incorrect descriptions occur only for gender (1) and hair color (7); no incorrect descriptions are recorded for age, skin tone, or expression. For additional features, 57 cases are labeled correct, 18 incorrect, and 21 not applicable, alongside the 4 omissions noted above.
(2) Can LQ evidence override the text?
Yes. Our results are consistent with LQ evidence taking precedence over text in some cases, although this is not guaranteed. A plausible explanation is that discernible visual cues constrain the restoration, whereas weak or ambiguous cues allow text to exert greater influence. As detailed below, the model can retain information absent from the caption and avoid some incorrect descriptions, but does not consistently prioritize LQ evidence over text. This comparison is descriptive and does not isolate the causal contribution of LQ conditioning.
We have added face examples and accompanying discussion in Appendix Figure 12 of the revised manuscript:
In the inspected outputs, most failures of LQ evidence to override text occur for incorrect or omitted additional features, whereas incorrect descriptions of the first 5, coarser-grained attributes are usually overridden. Across the 4 omitted-feature images, 2 retain the omitted feature, 1 partially retains it, and 1 loses it. None of the five corresponding restorations shows the incorrectly described chin-on-hand pose. Of the 9 cases involving incorrect earring descriptions, 4 visibly generate earrings, 4 show no visible added earrings with the ears obscured by hair, and 1 remains ambiguous. The 1 annotated gender-description error is also not corrected, although the LQ image provides ambiguous visual cues.