- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposes adding a symbolic regression step (PySR) between a kinematic simulator (pylinkage) and an LLM agent for 2D planar linkage synthesis, fitting simulated 2D trajectory coordinates into explicit equations to assist iterative critique and revision. However, this manuscript is in a severely broken, unproofread, and unfinished state, padded to 50 pages with full-page trivial plots and unverified AI-generated text/proofs, while suffering from fundamental mathematical and statistical flaws. I strongly urge the Area Chair (AC) to Desk Reject (or Strong Reject) this submission.
Critical strengths
The high-level intuition of translating raw numerical trajectory coordinates into compact symbolic expressions for LLM critique is conceptually reasonable.
Critical weaknesses
- Severely Broken and Unfinished Manuscript (Strong Call for Desk Reject) The authors clearly did not perform even a basic compilation check or human proofreading before submitting to ICLR (notably, Appendix A discloses the use of generative AI to draft manuscript text and proof sketches, and the paper is littered with unverified build artifacts). Specifically:
- Unresolved LaTeX references (?? and (?)) throughout the paper:
- Page 17, Line 906: "value-preserving models (??)."
- Page 17, Line 909: "through optimization oracles (??)."
- Page 20, Line 1030: "optimisation is deliberate (??):"
- Page 36, Line 1938: "iterative closest point algorithm (Drakoulis, 2023; ?)"
- Page 43, Line 2308: "It departs from meta-learning (?) in having..."
- Missing Table referenced as "Table ??":
- Page 34, Line 1827: "A naive aggregate reading of Table ?? suggests SR-absent critiques are more analytical..." -- Not only is the reference broken (Table ??), the referenced taxonomy table itself is completely missing from the manuscript.
- Truncated, half-written sentences:
- Page 28, Line 1480: "Formally, one common formulation is 6." (sentence abruptly ends here).
- Page 28, Line 1502: "Each shape is defined on 7." (sentence abruptly ends here).
- Corrupted Bibliography and garbled in-text citations:
- Page 10, Lines 487-494: The first two bibliography entries completely lack author fields, causing the main text to render nonsensical citation keys: "(son, 2024)" on Page 3, Line 166 and "(nob, 2022)" on Page 9, Line 469.
- Page 11, Line 570: Author name rendered in all-lowercase as "brian ichter".
- Chaotic, duplicate, and skipped Figure numbering & blatant page padding:
- Duplicate Figure 5: Page 25 defines Figure 5 (the neuro-symbolic loop diagram), and Page 35 defines a second Figure 5 (Ground truth Ellipse).
- Out-of-order and skipped numbers: Figure 8 appears on Page 33 before Figure 6 (Page 36) and Figure 7 (Page 37). Figures 17-20 do not exist at all -- the numbering jumps straight from Figure 16 (Page 46) to Figure 21 (Page 46).
- Page padding: Pages 35-46 (12 full pages) are padded by placing single, elementary 2D matplotlib curves (one circle, one line, one ellipse per page) at huge scale to inflate the submission to 50 pages.
-
Self-Contradictory Core Formulation (Branch Collapse on Closed Curves) Four of the six target curve families in MSynth (Circle, Ellipse, Lemniscate of Bernoulli, and NACA Airfoil) -- as well as generic four-bar coupler curves -- are closed, multi-valued curves where a single x coordinate corresponds to two or more y values. Yet the pipeline fits single-valued explicit functions y = f(x) via least squares (Page 4, Eq. 2; Page 31, Line 1672). Ironically, the authors themselves prove in Proposition B.5 (Page 22, Lines 1144-1155) that fitting y = f(x) to a symmetric closed curve like an ellipse collapses the upper and lower branches into the zero constant f(x) = 0, losing all shape information! And on Page 22, Line 1181, the authors explicitly admit that their proposed variance recovery fix (Eq. 17) "is a constructive alternative, not an additional component of the evaluated pipeline."
-
Flawed Evaluation Protocol and Distorted Aggregate Statistics
- 4-point ICP degeneracy: Each target curve is sampled at only n = 4 points (Page 5, Line 225; Page 28, Line 1506) and aligned via unconstrained rigid ICP before computing Chamfer distance, which is geometrically under-constrained and prone to degenerate local minima.
- Unnormalized means completely dominated by a single class: In Table 2 (Page 32) and Table 6 (Pages 48-50), Parabola has a mean Chamfer error of ~853.3, whereas the other five shapes have errors between 1.1 and 8.6. Consequently, every unnormalized cross-shape average reported in the text (e.g., 140.00 vs. 148.50 on Page 6, Line 264, and Appendix T) is >98% dictated by Parabola alone.
- Degradation on the strongest model: On Llama-3.3-70B (Table 1, Page 6), adding the paper's core Symbolic Regression module (FB + SR) actually degrades performance compared to standard text critique (FB) alone (0.634 -> 0.659 on 4-bar; 0.634 -> 0.648 on 6-bar).
Questions for authors
- To the Authors and Area Chair: How was a 50-page manuscript in this condition -- riddled with unresolved "??" and "(?)" macros, a completely missing "Table ??", half-written sentences ending in "is 6." and "on 7.", corrupted bibliography keys ("(son, 2024)", "(nob, 2022)"), duplicate Figure 5s, skipped Figures 17-20, and a core implementation y = f(x) that the paper's own appendix proves collapses to zero on closed curves -- submitted without basic human inspection, and why was a submission of this quality not Desk Rejected?