- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper investigates how numerical supervision interacts with the requested output format in neural symbolic regression. Starting from pretrained Flash-ANSR checkpoints, it compares continuation training with literal numerical targets and role-based targets, and evaluates each under placeholder and constant output requests. A confirmatory evaluation on 256 newly generated expression families and three training seeds finds an interaction between training targets and output requests at two predictive-accuracy thresholds. The paper also studies a balanced 50/50 training mixture and conducts diagnostic interventions on numerical-token supervision, decoder context, and optimizer initialization. Its main contribution is an empirical study of the generation–refinement interface and a training recipe for retaining both output capabilities.
Critical strengths
-
A credible empirical interaction with confirmation on newly generated families. The study evaluates both target formats under both output requests, rather than drawing conclusions from a single interface. Confirmation on newly generated families, multiple training seeds, paired comparisons, and multiplicity-adjusted intervals strengthens the evidence that the relative performance of the two continuation-training schemes depends on the requested interface within this setting.
-
Informative diagnostic experiments and reporting of inconclusive results. The distinction between boundary supervision, value-byte supervision, numerical conditioning history, and optimizer initialization is useful. In particular, the boundary/value-byte controls and fixed-parent initialization experiments help identify different ways numerical information enters the pipeline. The paper also reports unresolved structural results, nonfinite outcomes, and inconclusive public-data comparisons, which makes its empirical limitations more assessable.
Critical weaknesses
-
Limited explanatory insight beyond training-format specialization. Literal and Roles jointly change instructions, target representations, and numerical supervision, leaving their individual contributions unclear. The diagnostic experiments identify effects on generation and initialization, yet insufficiently explain how these effects produce the ranking reversal. The scientific insight beyond matching training formats to output requests remains underdeveloped. The dense presentation and scattered qualifications make it difficult to trace how the diagnostic experiments support the central argument.
-
Unclear practical value of native dual-interface support. The practical need for native dual-interface support and its benefits over matched single-interface workflows or simple output conversion remain unclear. Mixed-request search offers no confirmed advantage over repeated constant requests, while the supervision–interface interaction remains inconclusive on public datasets. These limitations weaken the motivation for adopting the proposed approach.
Questions for authors
-
Which results distinguish numerical-supervision effects from specialization to training formats?
-
How do the diagnostic findings explain why scale-augmented continuation changes the supervision–interface interaction?
-
What do the common-fitting controls establish about the solver’s contribution to the ranking reversal?
-
Which practical scenarios benefit from native dual-interface support over matched single-interface workflows or simple output conversion?
-
How do the inconclusive public-data results affect the scope of your conclusions and recommendation for balanced training?
-
Some experiments lack comparisons with relevant methods; could these be provided?
Response to oK6c (Review Mismatch)
Thank you for reviewing for ICLR 2027. We think this review may have been posted to the wrong submission by mistake.
Your review discusses governing-equation identifiability using a consistency map T, the null space of a physics operator, a neural-network tangent space, and an uncertainty-ratio elbow rule for selecting a constraint weight lambda (citing Miao et al., 2011; He et al., 2024; Bona-Pellissier et al., 2022). None of these methods or weight-selection experiments are in Submission 16331.
Our paper studies symbolic regression, specifically how Literal, Roles, and Balanced numerical supervision interact with template versus constant output requests, scale augmentation, and solver initialization.
Could you please check your assigned papers and update the review for Submission 16331 when you have a chance? We have also uploaded our revised paper and are happy to answer any questions.