- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes SOFIA, a federated framework for industrial defect detection that combines client-specific hyperparameter optimization with object-oriented inpainting-based pretraining. Horse Self-adaptive Optimization (HSO), a simplified variant of the Wild Horse Optimizer, searches for local training configurations. Object-Oriented Inpainting (OOI) uses GradCAM++ masks and MI-GAN to generate localized synthetic anomalies from defect-free images. These components are integrated with a YOLO-World detector and federated model aggregation. Experiments are conducted on the Pill and NEU-DET datasets. The paper reports comparisons with detection baselines, component ablations, and analyses involving different communication rounds and client counts. Its main claim is that jointly adapting local optimization and improving representations through synthetic anomalies benefits federated defect detection.
Critical strengths
- The paper addresses a practically relevant combination of challenges. Distributed industrial data, limited defect examples, and differences between clients provide a reasonable motivation for jointly considering local optimization and representation learning. The framework offers a concrete way to investigate their combination in federated defect detection.
- The ablation results provide encouraging evidence for the combined framework. In Table 3, adding OOI to FL+HSO increases overall mAP50 from 0.842 to 0.872, with improvements for both Normal and Damage classes. OOI does not improve the separately trained local baseline in the same table. This difference is an interesting empirical finding that merits further investigation.
Critical weaknesses
- The central pretraining-to-detection pipeline is insufficiently specified. Section 3 describes MI-GAN reconstruction, adversarial learning, and knowledge distillation, and subsequently states that the pretrained weights are used in the detection phase. However, it does not clearly explain which network is pretrained, how the generated images are annotated for detector training, or which parameters are transferred into YOLO-World. The GradCAM++ reference model and mask-construction procedure also need clarification. Similarly, HSO’s neighborhood operator and candidate-selection procedure are not sufficiently specified. Appendix A reports changes to the final training configuration, including changes to batch size and learning rate on NEU-DET, but the rule connecting these adjustments to the HSO-selected configuration remains unclear. These omissions make it difficult to reproduce the proposed method and identify what produces the reported improvement.
- The experimental controls do not sufficiently establish the added value of the proposed components. Table 3 lacks an FL+OOI configuration, so it cannot determine whether the observed benefit requires HSO specifically or follows from combining OOI with federated training more generally. Figure 4 compares FL and FL+HSO, but does not establish HSO’s advantage over a simpler search method under an equal evaluation budget. Likewise, the contribution of object-oriented masking is not isolated from that of synthetic-image pretraining. Baseline interpretation is also problematic. The “CL” baseline in Section 4.4 consists of independently trained local models rather than a model trained on pooled data. Moreover, a client receiving federated updates can benefit from other clients’ data, so using one-third of the images locally does not establish a reduction in total training-data requirements. These issues weaken the attribution and scope of the paper’s main claims.
Questions for authors
- Please specify the complete OOI training and transfer procedure. Which model and target are used for GradCAM++? How are masks constructed? Is MI-GAN frozen or further trained? How are synthetic images annotated, which network receives pretraining, and how is its checkpoint used to initialize YOLO-World?
- Please clarify the executable HSO protocol and subsequent configuration adjustments. What are the population size, search iterations, neighborhood operator, candidate-selection rule, and per-client evaluation budget? Which data split is used to calculate fitness? For NEU-DET, why are the batch sizes and learning rate changed between Tables 6 and 7, and are equivalent adjustments applied to the baselines?
- Can you provide focused controls for the claimed component contributions? In particular, FL+OOI would help assess whether HSO is necessary for the reported interaction. A search baseline with the same evaluation budget and a random-mask baseline using the same generator and pretraining budget would help establish the contributions of HSO and object-oriented masking. Please report variability across independent runs for the principal comparisons.
- Please clarify model evaluation and training-data accounting. Are the reported client results obtained from the aggregated global model or locally updated models, and are they evaluated on the same test set? Were the Figure 2a baselines rerun under comparable conditions? How does the “one-third of the training data” claim account for information obtained through federated aggregation?
- Please clarify the heterogeneity and client-scaling protocols. How are client distributions constructed, and what measurable differences exist between them? When the number of clients increases, is the total dataset held fixed? What observations and independent repetitions underlie the confidence intervals, and how should these intervals be distinguished from the variation across clients reported in Table 9?