Recent advances in self-correction (SC) and recursive self-improvement (RSI) offer new ways to improve large language models' reasoning. A natural approach is to accumulate correction experience as reusable skills to guide subsequent problem solving. To this end, we propose SC2SE (Self-Correction to Self-Evolution), an agentic test-time learning framework for mathematical reasoning. With model parameters frozen and without requiring ground-truth answers as learning feedback, SC2SE learns from its own verification and revision experience through four collaborating agents for problem solving, stepwise correction, skill evolution, and role calibration. These agents distill correction experience into skills; role calibration checks each skill's suitability for the solver role before and after skill aggregation, turning diagnoses of existing solutions into actionable guidance for subsequent problem solving. Updated skills guide the next round of problem solving, and new answers undergo further verification and correction, forming a test-time self-evolution loop: correction → skill accumulation → skill-assisted answering → further correction. We conduct same-pool evaluation on four mainstream large language models and five public mathematics datasets. The results show that skill-assisted initial answers achieve higher mean accuracy (ACC) than the compared RSI baselines; with further correction, SC2SE improves mean ACC by 14.3 percentage points over the highest mean ACC among the compared baselines. Together with component comparisons and process case studies, these results support the complementary roles of self-correction and skill accumulation: correction provides experience for skill learning, while accumulated skills support subsequent problem solving and revision.
Response to Reviewer P3Dt
Thank you for your suggestions. We have added a role calibration ablation and a comparison of SC2SE with related methods. We address each question below.
Q1. How does accuracy change when role calibration is turned off?
Turning off role calibration reduced initial accuracy by 7.1 percentage points and accuracy after correction by 3.5 points. By the time we ran this test, DeepSeek had updated its API and the Flash version used in the submission could no longer be selected. Both groups used the updated DeepSeek Flash. We compared the groups on the same five datasets with the same shared initial answers and random seed. The table gives the ablation results.
With role calibration on, initial accuracy increased by 7.1 percentage points and accuracy after correction increased by 3.5 points. Calibration makes the skills easier for the solver to use on new problems and thus directly affects the initial answer. The corrector does not read the skill library. The gain after correction may reflect some additional correct initial answers remaining correct after verification.
How SC2SE differs from existing methods
SC2SE studies how to turn an error found on one problem into a step the solver can use in its initial answer to the next problem. For example, dividing z2=z by z causes the solver to miss z=0. SC2SE extracts the following guidance from this correction: “Before dividing by an expression that contains an unknown, first consider the case where the expression is zero.” Before and after merging skills, the calibration agent checks whether the solver can use this guidance from the new problem's conditions alone.
We drew on SkillOpt's structured skill edits. SkillOpt proposes edits from scored trajectories and selects updates using a separate validation set. SkillAudit compares how the same task is performed with and without skills and uses this comparison to revise the skills. SC2SE extracts guidance from solving and correcting math problems at test time, without feedback from reference answers. SkillOpt · SkillAudit
ProgCo uses feedback from programmatic verification to revise the current answer. Its mean accuracy across four models was 45.6%. ProgCo paper
We compared SC2SE with Dynamic Cheatsheet (DC) and ACE. Your suggestion to include another related method helps test whether learning skills from solving problems is effective. We therefore also evaluated EvoLib, which extracts knowledge from problem solving for use on later problems. The table reports the four-model averages and the additional results on the updated DeepSeek Flash separately. In the additional comparison, we scored the final answers produced by each method's own learning and answering procedure. EvoLib paper
Across four models, SC2SE averaged 64.6% accuracy, compared with 42.8% for DC and 44.1% for ACE. On the updated DeepSeek Flash, SC2SE achieved 76.5% accuracy, 10.6 percentage points above EvoLib's 65.9%.