- Rating
- 2
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes FactorizePatch to improve the physical robustness of adversarial patches. The method separates the printing and camera imaging processes into differentiable stages and adaptively weights different camera degradations during optimization. The authors also construct a print-scan dataset for training a printer proxy. Experiments on CLIP and ResNet-50 demonstrate improved targeted attack performance across simulated and real-world settings, including different cameras and illumination conditions.
Major Comment
The paper presents a practical framework and achieves strong physical attack results. However, the current comparisons do not fully establish how much of the improvement comes from factorization rather than additional calibration data and simulation components. The limited evaluation across printing conditions also raises concerns about generalization. I lean toward rejection but would reconsider if these issues are adequately addressed.
Critical strengths
1. Practical and well-motivated design. Separating printing and camera imaging is a reasonable approach to physical adversarial attacks. The factorized pipeline allows different degradation stages to be modeled independently, while adaptive weighting improves robustness under challenging imaging conditions.
2. Strong physical attack results. FactorizePatch achieves 79.06% and 99.06% physical attack success rates on CLIP and ResNet-50, respectively. The evaluations across three cameras, different illumination conditions, and independent print-placement sessions provide useful evidence of physical robustness.
Critical weaknesses
1. The contribution of factorization is not fully isolated.
Although the D2P baseline follows its original training protocol, FactorizePatch uses substantially more calibration data. A data-matched comparison would help clarify whether the improvements come from the proposed factorization or the additional calibration data.
Specifically, FactorizePatch uses 2,000 print-scan pairs, while D2P uses only 200 print-camera pairs. Moreover, the two methods differ in their simulation components. The current experiments therefore do not fully isolate the benefit of the factorized design itself.
2. Limited generalization across printing conditions.
The printer proxy is trained using a single printer and scanner, while physical evaluations mainly vary the capture devices. Although the paper includes independent printing and placement tests, its effectiveness across different printers, paper types, and printing settings remains unclear. This limits the generality of the proposed physical modeling framework.
Questions for authors
Q1. Can the authors compare FactorizePatch with a monolithic D2P model using comparable calibration data and computational resources? This would help isolate the benefit of factorization.
Q2. How well does FactorizePatch transfer to different printers or printing settings? How much additional calibration data would be required?
Q3. What is the computational overhead of the four camera branches and adaptive weighting? Can the authors provide training-time comparisons with the baselines?
7 comments
Question 1-3
Q1. Can the authors compare FactorizePatch with a monolithic D2P model using comparable calibration data and computational resources?
With the same calibration data volume, FactorizePatch improves physical attack success rates by 5.73 and 15.73 percentage points on CLIP and ResNet-50, respectively.
We further trained a monolithic D2P model using the same 2,000 calibration pairs. The experimental results are shown below:
| Model | Digital ASR | Physical ASR |
|---|---|---|
| CLIP | 89.20% | 73.33% |
| ResNet-50 | 99.94% | 83.33% |
In comparison, FactorizePatch achieves Physical ASRs of 79.06% and 99.06% on CLIP and ResNet-50, respectively, corresponding to improvements of 5.73 and 15.73 percentage points.
These results demonstrate that the factorized framework retains significant advantages even after controlling for differences in calibration data volume.
Q2. How well does FactorizePatch transfer to different printers or printing settings? How much additional calibration data would be required?
FactorizePatch requires only 80–120 calibration pairs per new printer for full-network fine-tuning to achieve color reconstruction performance close to that on the original printer, while maintaining strong attack performance on new printing devices.
We conducted experiments on two additional printers, comparing full-network fine-tuning with training from scratch. The results are shown below:
| Printer | Calibration Data | Full-Network Fine-Tuning ΔE00 ↓ | Training from Scratch ΔE00 ↓ |
|---|---|---|---|
| Printer 1 | 80 pairs | 2.0679 | 2.2133 |
| Printer 2 | 120 pairs | 2.0062 | 2.1536 |
| Original Printer | 2,000 pairs | 1.9992 | — |
Fine-tuning on both new printers outperforms training from scratch with the same amount of data, demonstrating that the pretrained printer proxy can effectively transfer to new printing devices.
Further physical attack experiments show that the average ASRs on CLIP and ResNet-50 reach 70.83% and 63.33%, respectively, representing an average improvement of 14.46 percentage points over D2P, the second-best method across different printers.
Additionally, in complex real-world environments, including piled clothing, stacked books, and a bathroom sink, FactorizePatch achieves an ASR of 94.00% using only 200 calibration pairs, outperforming D2P (85.33%) by 8.67 percentage points.
These results demonstrate that FactorizePatch possesses cross-device adaptation capabilities and maintains strong physical attack performance under limited calibration data and complex background interference.
Q3. What is the computational overhead of the four camera branches and adaptive weighting? Can the authors provide training-time comparisons with the baselines?
The primary computational overhead of the four-branch architecture comes from additional forward and backward passes, whereas the EMA-based adaptive weighting mechanism itself introduces almost negligible computational cost.
We further measured the average iteration time (ms/iteration) of different methods on ResNet-50 and CLIP. The results are shown below:
| Method | ResNet-50 | CLIP |
|---|---|---|
| EOT-only | 137.2 | 592.9 |
| P&S | 148.1 | 603.4 |
| D2P Adaptation | 325.1 | 777.6 |
| Single P+C | 1,243.90 | 1,901.60 |
| 4-Branch Uniform | 4,931.40 | 8,021.30 |
| 4-Branch Adaptive | 4,881.00 | 8,066.30 |
First, compared with Single P+C, 4-Branch Uniform increases the average iteration time by 3.96× and 4.22× on ResNet-50 and CLIP, respectively. This overhead primarily comes from the additional forward and backward passes introduced by the four camera branches.
Second, compared with 4-Branch Uniform, the average iteration time of 4-Branch Adaptive changes by only -1.02% and +0.56% on ResNet-50 and CLIP, respectively. This demonstrates that EMA-driven adaptive weight computation introduces almost no additional computational overhead.
Overall, compared with D2P Adaptation, 4-Branch Adaptive requires approximately 15.01× and 10.37× the per-iteration time on ResNet-50 and CLIP, respectively.
Thank you for the additional experiments and detailed responses. While I appreciate the efforts to address my concerns, several issues remain unresolved:
1. Factorization is not sufficiently validated.
The results reported for the monolithic D2P model in Q1 exactly match those of Ours (200 pairs) in W1, making the claimed data-matched comparison difficult to verify. Thus, the specific contribution of factorization remains unclear.
2. Substantial computational overhead.
The four-branch adaptive method requires approximately 15.0× and 10.4× the per-iteration time of D2P Adaptation on ResNet-50 and CLIP, respectively. Its performance advantage under comparable computational budgets remains unverified.
3. Limited cross-printer generalization.
The additional experiments require 80–120 calibration pairs and full-network fine-tuning. They demonstrate adaptation to new printers rather than broad generalization across printing conditions. Variations in paper types and printing settings remain unexplored.
Overall, although the additional experiments partially address my concerns, they do not sufficiently resolve the above issues. Therefore, I maintain my original rating of 2 (Weak Reject).
weakness 1-2
We thank the reviewer for their constructive comments. We have carefully addressed all concerns and detailed questions raised in the review through point-by-point responses, additional experiments, and analyses. We hope these clarifications adequately resolve your concerns and kindly ask you to reconsider the paper's score. We would greatly appreciate an increase in the score if deemed appropriate.
1. The contribution of factorization is not fully isolated.
Even when reducing the printer proxy training data of FactorizePatch to only 200 pairs, its physical attack performance still significantly outperforms the second-best method, D2P Adaptation, trained with the same amount of paired data.
To eliminate the influence of training data volume, we further reduced the number of print-scan pairs used to train the FactorizePatch printer proxy from 1,600 to 200, and compared it with D2P Adaptation trained using the same 200 paired samples. The results are shown below:
Even with only 200 print-scan pairs, FactorizePatch achieves improvements of 10.33 and 12.00 percentage points on CLIP and ResNet-50, respectively. These results demonstrate that the performance advantages of our method do not merely come from using more calibration data, but rather from full physical pipeline modeling and joint optimization.
2. Limited generalization across printing conditions.
Through transfer experiments on two additional printers, we demonstrate that FactorizePatch can effectively adapt to new printers using only 80–120 additional calibration pairs, while maintaining strong physical attack performance in complex real-world scenarios.
We acknowledge that the original manuscript primarily trained the printer proxy using a single printing device, providing insufficient validation of cross-printer generalization. To address this limitation, we conducted additional experiments on two different printers, using 80 and 120 additional calibration pairs, respectively, for full-network fine-tuning.
The results show that the fine-tuned models achieve average ΔE00 values of 2.0679 and 2.0062, respectively, both outperforming training from scratch with the same amount of data, which yields 2.2133 and 2.1536. Notably, after fine-tuning with 120 pairs, the reconstruction performance approaches the value of 1.9992 achieved by training on the original printer with 2,000 pairs.
Furthermore, in physical attack experiments using the additional printers, the average ASRs on CLIP and ResNet-50 reach 70.83% and 63.33%, respectively, representing an average improvement of 14.46 percentage points over D2P, the second-best method across different printers.
We also conducted additional tests in complex real-world scenarios, including piled clothing, stacked books, and a bathroom sink. With only 200 calibration pairs, FactorizePatch achieves an ASR of 94.00%, outperforming D2P (85.33%) by 8.67 percentage points (a relative improvement of 10.16%).
These results further validate the practical applicability of our method in terms of both cross-printer adaptation and robustness to complex physical environments.