- Rating
- 3(+1)
- Confidence
- 1(−1)
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper aims to solve the key problem: how agents perform safely and consistently in a partial-observed and complex enterprise-level tasks. This paper introduce E-Ledger, a multi-agent harness for safe and persistent execution. E-Ledger employs a code approval layer that checks every proposed action against policy before execution, and maintains a world ledger of verified hidden rules alongside evidence-backed dynamic state.
Critical strengths
-
The research question is interesting and of great significance. We do need enterprise agent to be deployed in a partial-observed environments. By combining "non-bypassable" and "unobserved side effect", E-Ledger is more promising than naive prompt enhancement or other methods.
-
The framework architecture is well-designed. Agents are clearly separated, with well-defined boundaries for greatly taking each responsibility.
Critical weaknesses
- It seems only comparing the test-time cost (as shown in Table 1). How about training-time cost? Compared to other methods, does E-Ledger have an advantage in terms of training costs?
- The data scale of the benchmark test appears to be small. It may not effectively demonstrate the advantages of E-Ledger.
Questions for authors
- It seems only comparing the test-time cost (as shown in Table 1). How about training-time cost? Compared to other methods, does E-Ledger have an advantage in terms of training costs?
- I think single-run is acceptable limitation in the field. But you list it as key limitation (as shown in Appendix G). What other limitation does E-Ledger may have?
Comments by Reviewer umU3
Thanks for the author's response. Although I have raised my rating to 3, I have lowered my confidence level, and I consider this a borderline paper. I hope AC may take the feedback from other reviewers into careful consideration.