- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper "GreenCert: Signed-Response Verification of Neural Network Training Trajectories" proposes a verification method for optimiser trajectories, i.e., which outputs may be reached when the actual optimisation trajectory deviates from the proposed one. For this, GreenCert propagates signed errors through the optimiser dynamics (thereby allowing for subsequent cancellation) and then infers the reachable output margins of resulting networks. Evaluations against sequential baselines show superiority on some benchmarks, but on larger models GreenCert does not perform well.
Critical strengths
- the framework appears to be sound and correct in its formulations.
Critical weaknesses
- the presentation and motivation of the paper are questionable. It remains unclear why a certificate for training trajectories is needed, when it induces costs exceeding the execution of the optimisation by orders of magnitude. Also, when a reference trajectory exists, future optimiser dynamics are already evaluated, so it remains unclear why certificates are needed.
- The paper is extremely hard to read. In particular, there are several words and sentences that appear to be artifacts of heavy LLM assistance in writing the paper. Examples "The optional fallback has no fresh rescue", "Post-seal fixed-radius transformer audit", "amended budet clocks", "a metadata admission bridge", "frozen errors are unchanged". Appendix F is a particularly bad example, containing direct comments of an LLM used to prepare the code appendix. This is a direct quote from Appendix F: "The anonymous supplement is distinct from the manuscript source. Its top-level README and manifests identify the original inputs, numerical sources, results and logs for each study. The source package also includes ARTIFACT_INDEX.md and a relocation map linking every moved topic to its appendix and original record. Full pre-revision source passages are retained as noncompiled artifact documentation; none is experimental data generated by this edit." Thus, overall in terms of presentation and polish this paper is far from being ready to be published at a venue like ICLR.
- GreenCert does not outperform the baselines in all experiments, so overall it appears like a weak improvement over simple baselines.
Questions for authors
- What concrete practical question/problem requires a certificate obtained through GreenCert?
- What are the advantages of GreenCert on the experiments where it performs worse than the baselines?