- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper extends o-minimality from a binary property of a function to a continuous metric. The goal is to propose a measurable, continuous version of o-minimality property to quantify the behavior of trained neural networks. The main idea is to check, for each input dimension, how many dimensions change the binary classification decision, and to apply decomposition-complexity metrics from previous work.
Critical strengths
- There are a lot of graphics to visualize the proposed metrics and results.
- The related work is long and comprehensive. It takes one page.
Critical weaknesses
-
The paper mentions that few recent papers wrote about "o-minimality". However, it is not clear whether this topic is worth investigating. The paper does not discuss where this "o-minimality" measurement fits relative to other related techniques on evaluating DNN's robustness, so the motivation for the study as written in the Abstract and Introduction is weak. To attract a broader audiences in adversarial machine learning and DNN verification, the paper needs to explain why the proposed metrics, built on "o-minimality," are more useful for proving model robustness and stability than other well established techniques such as Lipschitz-based metrics, DNN verification (either probabilistic or sound and complete), or randomized rounding.
-
Proposed oscillation complexity (OC) metrics is trivial, because the 1D check is not "sound" and guarantees nothing. Also, the decomposition complexity (DC) metrics:
"DC is a boundary-local instance of the region-counting complexity studied by Montúfar et al. (2014); Serra et al. (2018); Hanin & Rolnick (2019)."as authors stated verbatim in the paper, so this is not a contribution of this paper. There is no discussion of the relation between o-minimality theory and the proposed OC/DC metrics. -
The proposed method is short, less than one page, which is even shorter than the related work.
-
It seems like this paper is entirely LLM generated without careful revision by human. I cannot read it smoothly, especially the abstract. There are many signs that the text is generated without careful revision by the author, e.g., excessive usage of
---, constant interruption within every sentence, lots of negative structures like "not" or "rather than" for the LLM to reassure itself that the generated text is correct and it is not hallucinating. A human would write the same paper more directly. Another pattern of recently generated papers by LLMs is that half of the abstract is packed with numerical results, which isn't common before, because traditional human-written papers would concentrate on motivation and high-level concept of the contribution. There are many\textbf{summarize phrase}in thein the paragraph, which is also a sign of an LLM-generated paper. -
The language is informal, not suitable to be included in a computer science proceeding, e.g., "how far along a tameness spectrum does this model sit, ... move it, ... they already sit near ...", "Where post-trained LLMs sit", etc.
Questions for authors
I don't have any question, since it is unlikely that I'll change my score.