- Rating
- 1
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes SIS-Net, a set-based architecture for electronic-nose recognition under varying sensor configurations. The method employs a shared temporal CNN encoder, learnable sensor identity embeddings, and masked mean pooling to process variable-size sensor subsets. Training-time sensor-subset sampling enables a single model to operate under different sensor availability conditions without retraining.
Critical strengths
-
Practical and relevant problem formulation. The paper addresses a meaningful challenge in electronic-nose recognition: handling different sensor configurations using a single model without configuration-specific retraining. This is relevant to practical systems where sensors may become unavailable.
-
Systematic evaluation under varying sensor availability. The evaluation considers fixed, random, and held-out sensor configurations, with group-based cross-validation and component ablations. These experiments provide useful evidence of robustness to sensor removal.
Critical weaknesses
Fundamental limitation of the sensor identity-aware representation. The proposed architecture adds sensor identity embeddings to temporal features before mean pooling:
However, this can be rewritten as:
Consequently, sensor identity information is aggregated independently of the corresponding sensor measurements. For a fixed sensor subset, permuting the measurements among sensor identities produces exactly the same representation.
Therefore, the architecture cannot explicitly model which specific sensor produced which measurement. The identity embeddings primarily encode the composition of the available sensor subset rather than sensor-specific signal relationships. This substantially weakens the paper's central claim of sensor identity-aware modeling.
Limited novelty and experimental validation. The proposed method is essentially a simple set-based architecture combining a shared CNN, identity embeddings, mean pooling, and subset sampling. These components are well established, and the paper does not demonstrate a substantial methodological advance over existing set-based learning approaches.
Furthermore, evaluation is restricted to a single dataset with 975 processed samples and 16 sensors. The paper lacks direct comparisons against stronger set-based alternatives, such as Deep Sets with identity-conditioned features or Set Transformers, under the same subset-training protocol. Consequently, it remains unclear whether the improvements originate from the proposed architecture or primarily from training-time sensor-subset augmentation.
Questions for authors
-
How does SIS-Net preserve sensor-specific information when additive identity embeddings are followed by mean pooling?
-
How does SIS-Net compare with standard Deep Sets or Set Transformers using the same subset-training strategy?
-
Can the authors validate the approach on additional datasets or real sensor failure scenarios?
2 comments
Response to author
The author haven't address any of my concern. I will keep my decision.
Author Response to Reviewer fm39
We thank the reviewer for the careful mathematical analysis and constructive feedback. We address the three main concerns below.
(1) Sensor identity representation. We agree with the reviewer's mathematical observation. With additive identity embeddings followed by mean pooling, the representation decomposes into two independent terms:
ri=Ki1∑j∈SiEθ(xi,j)+Ki1∑j∈Siej.
Consequently, for a fixed available sensor subset, permuting measurements among sensor identities leaves the pooled representation unchanged. The identity embeddings encode the composition of the available sensor subset but do not explicitly preserve the correspondence between each measurement and its physical sensor identity.
We have revised the Abstract, Introduction, Methodology (Section 3.6), ablation discussion (Section 4.2), and Conclusion to clarify this limitation. The Sensor ID ablation in Table 3 shows that the embeddings provide useful available-set information in the evaluated settings. For example, Avg-4 Macro-F1 decreases from 0.7522 to 0.6546 when identity embeddings are removed. However, this does not demonstrate explicit signal–identity interaction modeling. We acknowledge that the original description overstated this capability.
(2) Comparison with stronger set-based models. We agree that SIS-Net is closely related to established Deep Sets formulations. Its contribution lies primarily in investigating electronic-nose recognition under changing sensor configurations, training-time subset sampling, and evaluation using one frozen checkpoint across Full, Fixed, Random, and HeldOut conditions. We have not compared against identity-conditioned Deep Sets or Set Transformers under the same protocol and therefore do not claim architectural superiority over them.
(3) Generalization and physical sensor failures. Our current evaluation uses one electronic-nose dataset with sensor unavailability simulated through controlled masking. We have not evaluated additional datasets or actual hardware failures. These limitations are now explicitly acknowledged in the revised Conclusion.
We appreciate the reviewer for highlighting these issues. Developing representations that preserve sensor–measurement correspondence and evaluating them across broader sensing conditions remain important directions for future work.