- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes EP-CoA for long-context reasoning. It combines evidence scoring, position-aware assignment, a worker summary index, and gated correction. Experiments cover five benchmarks and three language models. Results show competitive performance, while the clearest component gain comes from correction gating. Evidence placement itself does not show a clear benefit.
Critical strengths
The paper studies a useful problem and reports results across different tasks and model families. I appreciate the comparison with a strong single-agent baseline. The authors also report negative assignment results and examine serving variation. The correction analysis shows when rewriting helps or damages answers, which is useful for practice.
Critical weaknesses
The main evidence-placement idea is not supported by the reported ablations. Joint assignment performs worse when documents have several chunks (Table 7). The quality proxy and its implementation are not clearly specified. Also, two or four repeated runs on only two tasks cannot support the broad claims about reliable improvements.
Questions for authors
How is the quality proxy computed, and does it use any reference answers? Can you report paired confidence intervals and repeat all tasks? Why do Equations 4 and 5 use different importance terms? Can placement be tested without changing reading order? Please provide scorer prompts, thresholds, and all parameter settings.