acceptodds
Under review as a conference paper at ICLR 2027

ValueWorld: Evaluating Trajectory-level value enactment in language agents

Abstract

Value evaluation asks whether an AI system behaves consistently with specified human or normative values. Existing evaluations of language models predominantly infer this from isolated responses, through judgments, choices, or generated text in fixed scenarios. Language agents, however, act through trajectories in which earlier actions change subsequent states and decisions. Value-consistent responses therefore need not imply value-consistent behavior over continued interaction. In this work, we introduce ValueWorld, an executable protocol for evaluating trajectory-level value enactment in text-based agent environments. Specifically, ValueWorld operationalizes specified value principles through task-grounded behavioral constraints and evaluates whether agents select value-consistent actions under competing task pressures, carry those choices into subsequent open-ended execution, and adapt to changing operating conditions while continuing to satisfy the relevant constraints. Under the primary GPT-4.1 setting, the shared backend achieves 95.1% preferred-choice accuracy on matched isolated probes. When the same decisions occur during interaction, preferred-choice rates among reached decisions fall to 56.6–78.8%, and end-to-end preferred-choice evidence falls further to 35.4–46.5% after accounting for decision reach. Moreover, only 23.7% of value-preferred decisions are followed by positive decision-specific behavioral evidence at the next open-ended step. Among trajectories that reach the predefined contextual shift, post-shift preferred-choice rates remain 41.7–59.3%. Together, these results reveal a recognition–enactment gap: strong response-level value recognition does not reliably predict value-consistent behavior over trajectories. Backend sensitivity further shows that decision–execution correspondence varies substantially across language models. Trajectory-level evaluation extends value evaluation from isolated responses to how values are enacted over continued interaction.

Primary area:
datasets and benchmarks
Keywords:
LLM Agents, Value Evaluation, Agent Evaluation, Trajectory-Level Evaluation

Reviews

Among:
Shape:
1234this paper, Bottom 2%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 1.33 over 3 reviews, above 2% of the others.
Reviewer_AoC5OpenReview ↗
Rating
1
Confidence
3
Informativeness
1
Presentation
2
Soundness
1
Read review
Paper summary

This paper introduces VALUEWORLD, a benchmark for evaluating trajectory-level value enactment in language agents. Unlike existing response-level evaluations, VALUEWORLD examines whether agents consistently follow value-related behavioral constraints during sequential interactions. The benchmark consists of 48 tasks across six domains and evaluates three aspects: (1) the gap between isolated value recognition and in-trajectory decisions, (2) whether value-preferred decisions translate into subsequent actions, and (3) whether agents maintain value-consistent behavior under contextual shifts. Experiments across six agent frameworks show that, despite 95.1% accuracy on isolated value-preferred choices, only 23.7% of preferred decisions yield positive behavioral follow-through, and constraint violations increase after contextual shifts. These findings highlight a substantial gap between value recognition and behavioral enactment.

Critical strengths

1. Important and Well-Motivated Research Problem

The paper addresses an important and well-motivated problem by highlighting the gap between value recognition and actual behavioral enactment in language agents. Examining whether value-related constraints are maintained throughout sequential interactions is an important research question that cannot be fully addressed through isolated response-level evaluations.

2. Systematic and Well-Organized Experimental Framework

The paper presents a systematic experimental framework for examining different aspects of value enactment. In particular, the three diagnostic analyses (Q1–Q3) are well-organized and cover the relationship between isolated value recognition, in-trajectory decisions, subsequent execution, and behavior under contextual shifts. This structured decomposition provides a useful basis for investigating where value recognition and behavioral execution may diverge.

3. Distinction Between Proposed Actions and Realized Events

The distinction between proposed actions and realized events is a thoughtful methodological choice. By evaluating the outcomes of actions within the simulated environment, the framework can distinguish intended actions from failed attempts and unintended consequences. This provides a more grounded approach to evaluating agent behavior than relying solely on stated intentions or generated responses.

Critical weaknesses

Major Weaknesses

1. Numerical inconsistencies in the human validation results (Table 12)

Table 12 reports several metrics that appear mathematically inconsistent under the stated post-stratification procedure. This is particularly concerning because the human validation results are used to support the reliability of the main Q2 findings.

First, the automatic FOLLOW rate is 23.7%, and the reported FOLLOW precision is 92.1%. These values imply that at least 21.8% of the population should be labeled FOLLOW by human annotators. However, the reported human-estimated FOLLOW rate is only 19.6%.

Additional inconsistencies arise if the reported metrics are derived from the same post-stratified confusion matrix. The class-wise F1 scores range from 92.3% to 95.8%, whereas the reported overall accuracy is 88.7%. For single-label multiclass classification, accuracy must lie between the minimum and maximum class-wise F1 scores when all metrics are computed from the same confusion matrix.

Furthermore, the reported automatic and human-estimated class proportions impose upper bounds on the possible F1 scores. The maximum FOLLOW F1 is approximately 90.5%, compared with the reported 95.8%. Similarly, the maximum CONTRADICT F1 is approximately 82.8%, compared with the reported 92.3%.

These discrepancies raise questions about whether different weighting schemes or evaluation populations were used without sufficient explanation. The authors should provide the underlying confusion matrix, clarify how each metric was computed, and reconcile these numerical inconsistencies.

2. Apparent inconsistency between human CVR and the human results in Table 2

The human constraint violation rate reported in Section 3.2 appears difficult to reconcile with the major-violation-free rate reported in Table 2.

The human reference achieves CVR = 0.0069 across 240 trajectories, each with a maximum horizon of 12 steps. Under the CVR definition in Appendix E.2, this implies an upper bound of approximately 20 major-violation steps across all human trajectories.

However, Table 2 reports a major-violation-free rate of 93.5% for human decision–execution pairs, indicating that 6.5% of the evaluated subsequent steps contain a major violation.

Given that all human trajectories reach the contextual shift and the reported post-shift preferred-choice rate is 91.7%, the human reference should contain a substantial number of eligible decision–execution pairs. Under the expected forced-choice eligibility and continuation conditions, this could imply more major-violation steps than are compatible with the reported overall CVR.

The exact contradiction depends on the number of valid and eligible human decision–execution pairs, which is not explicitly reported. The authors should therefore provide the raw number of major violations, the number of eligible human decision–execution pairs, and the corresponding denominators to clarify the apparent inconsistency.

3. Limited generalizability to stronger and more recent backend models

The main experiments rely heavily on GPT-4.1, raising concerns about whether the reported recognition–enactment gap generalizes to more capable contemporary language models.

Although Section 3.6 includes additional backends, such as GPT-5.4, Qwen3-30B, and DeepSeek-V4.1-Flash, these experiments are limited to the Vanilla LLM framework. Consequently, the central Q1–Q3 findings are not comprehensively evaluated across different backend models and agent frameworks.

This limitation is particularly important because the evaluated agents exhibit low task progress and relatively high constraint violation rates. Some observed failures may therefore reflect limitations in general task-execution capabilities rather than value enactment specifically.

Moreover, GPT-5.4 achieves substantially higher decision–execution correspondence than GPT-4.1 in Table 3. This suggests that the observed gap is strongly affected by backend capability.

The authors should extend their main experiments to stronger backend models across multiple agent frameworks to establish whether the findings remain consistent as model capabilities improve.

4. Insufficient differentiation from closely related work

The motivation is meaningful, but the paper does not sufficiently establish its novelty relative to existing research on agent safety, value evaluation, and sequential behavioral consistency.

Several studies address closely related questions. For example, LM Agents May Fail to Act on Their Own Risk Knowledge (Tang et al., 2025) investigates the gap between risk knowledge and actual agent execution. MACHIAVELLI (Pan et al., 2023) evaluates ethical behavior under competing task rewards, and ST-WebAgentBench (Levy et al., 2026) examines policy compliance during agent execution.

More directly, Agent-ValueBench (Dong et al., 2026) introduces executable environments for evaluating agent values across multiple value systems and agent frameworks.

Although VALUEWORLD emphasizes matched isolated decisions, immediate behavioral follow-through, and predefined contextual shifts, the paper does not clearly explain how these components differ from or improve upon existing approaches.

A more systematic comparison is necessary to establish the paper's conceptual and methodological contributions beyond previous trajectory-level safety and value evaluations.

5. Insufficient conceptual definition and systematic selection of values

A fundamental concern is whether the values evaluated in VALUEWORLD are sufficiently well-defined.

Appendix B describes several protected boundaries, including confidentiality, fairness, research integrity, and harm prevention. However, the underlying criteria for selecting and organizing these values remain unclear.

It is not sufficiently explained whether these principles are derived from established theories, systematically identified from application domains, or selected primarily through the authors' judgments.

Established frameworks, such as Schwartz's Theory of Basic Human Values, could provide useful theoretical grounding, although adopting this particular framework is not necessarily required.

At minimum, the authors should explicitly define what constitutes a value principle, explain why the selected values were chosen, and clarify the intended coverage of the value space. Without this foundation, it is difficult to determine what aspects of value enactment the benchmark actually measures and how broadly its findings can be generalized.

6. Limited validation of the mapping from values to behavioral constraints

The benchmark operationalizes abstract value principles through task-grounded behavioral constraints. However, the validity of this mapping is not sufficiently established.

Compliance with a particular behavioral rule or institutional procedure does not necessarily demonstrate adherence to the broader value that the rule is intended to represent. Similarly, avoiding a prohibited action may capture only a narrow aspect of an underlying value.

Although Appendix B describes a task construction and review procedure, and Appendix D provides human validation of the behavioral auditing process, these evaluations do not directly establish whether the selected constraints faithfully represent their intended values.

The authors should provide explicit validation of the value-to-constraint mapping. For example, independent human annotators could assess the semantic correspondence between each value principle and its behavioral constraints. Reporting quantitative validity ratings and inter-annotator agreement would strengthen the construct validity of the benchmark.

7. Potential duplication of repeated rollouts and unclear effective sample size

The paper reports five rollouts for each agent–task pair, resulting in 1,440 automated trajectories. However, Appendix F.1 specifies temperature 0 and a fixed seed of 2026, raising questions about the degree of variation across repeated rollouts.

Several reported aggregate percentages also correspond to event counts that are consistently multiples of five. For example, the reach and end-to-end preferred-choice rates in Table 1 imply counts divisible by five when calculated over 720 scheduled decisions per framework. The same pattern appears in SFRR and selected shift-reach results.

Although this pattern does not prove that the trajectories are identical, it suggests that repeated rollouts may contain substantial duplication.

If the five rollouts produce identical or nearly identical outcomes, the nominal trajectory count would overstate the number of distinct behavioral observations. This would also complicate comparisons with the human reference, where the five trajectories per task are generated by different individuals.

The authors should report within-task variation, the number of unique trajectories, and the extent of outcome agreement across repeated rollouts. Experiments with independent seeds would provide stronger evidence of reproducibility and robustness.

8. Difficulty disentangling value enactment from general agent capabilities

The paper shows that agent frameworks sharing the same backend model produce different trajectory-level outcomes. However, such differences do not necessarily indicate differences in value enactment capabilities.

Agent frameworks vary in planning strategies, reflection mechanisms, memory management, and action-selection processes. These factors influence task completion, trajectory length, and the probability of reaching diagnostic decisions, independently of value-related reasoning.

Furthermore, Appendix F.1 indicates that frameworks use the same external interaction budget but not matched inference compute, introducing an additional potential confounding factor.

The authors should examine whether framework differences persist after accounting for general task-execution performance, decision reach, and inference budgets.

Without such analyses, it remains difficult to determine whether the observed framework-level differences reflect value enactment specifically or broader differences in agent effectiveness.


Minor Weaknesses

1. Abstract clarity and organization

The abstract is difficult to follow because several technical concepts and metrics are introduced before the experimental setting is sufficiently explained.

Terms such as matched isolated probes, decision reach, and end-to-end preferred-choice evidence appear without adequate context.

I suggest first introducing the research problem and briefly describing the benchmark and evaluation setting, followed by the main experimental findings.

2. Repetition between the abstract and introduction

The opening sentence of the abstract is identical to the opening sentence of the introduction.

Although this is not a major issue, revising the introduction to provide additional context or a more detailed motivation would improve the writing.

3. Missing reference to Figure 1

Figure 1 provides an intuitive illustration of the difference between response-level value recognition and trajectory-level value enactment.

However, the figure does not appear to be explicitly referenced in the main text. Adding an appropriate reference would improve readability.

4. Inconsistency between Figure 2 and the stage description

Section 2.1 states that VALUEWORLD consists of three stages, whereas Figure 2 presents four numbered components.

The authors should clarify whether the task specification and controlled runtime are intentionally grouped into one stage or revise the description to match the figure.

5. Inconsistent terminology and notation

Some terminology and notation are not used consistently throughout the paper.

For example, Figure 4 uses Direct LLM, whereas other sections use Vanilla LLM. The matched follow-through difference is also denoted differently in Appendices E.4 and E.6.

The authors should standardize terminology and mathematical notation throughout the manuscript.

6. Ambiguous reporting of post-shift preferred-choice rates

The paper reports both shift-reach-conditioned preferred-choice rates (41.7–59.3%) and end-to-end preferred-choice rates (14.6–37.5%).

However, these are sometimes discussed under the general term post-shift preferred-choice rate without consistently specifying the denominator.

Since the end-to-end metric includes failures to reach the relevant decision points, the distinction is important for interpreting value-related decision failures.

The authors should clearly distinguish these metrics whenever reporting or discussing the results.

7. Clarification of termination conditions and metric interpretation

Section 3.1 describes trajectory termination in terms of the horizon or task-defined terminal conditions, whereas Appendix C.5 specifies the maximum horizon and a limit of two major violations.

Although these descriptions may be compatible, the exact termination rule should be stated consistently, given its direct influence on decision reach and end-to-end preferred-choice rates.

The interpretation of Q2 also requires care because NOEVIDENCE does not necessarily indicate behavioral inconsistency. The paper could more explicitly distinguish the absence of immediate positive follow-through evidence from an actual violation of value-related constraints.

8. Citation formatting and presentation consistency

The citation formatting appears somewhat unconventional and should be checked against the conference template.

Additionally, the presentation of key evaluation terminology could be more consistent. In particular, concepts such as response-level recognition, value enactment, and behavioral constraint compliance would benefit from clearer definitions and more consistent visual emphasis.

These revisions would improve the manuscript's overall readability and presentation.

Questions for authors
  1. Numerical Consistency in Table 12

    Could the authors clarify how the metrics in Table 12 were computed? In particular, the reported FOLLOW precision (92.1%), automatic FOLLOW rate (23.7%), and human-estimated FOLLOW rate (19.6%) appear mathematically inconsistent under the stated post-stratification procedure. The reported accuracy (88.7%) also appears incompatible with the class-wise F1 scores (92.3–95.8%) if they are derived from the same confusion matrix. Could the authors provide the underlying confusion matrix and detailed calculations to reconcile these results?

  2. Consistency of Human Evaluation Results

    How can the human CVR of 0.0069 be reconciled with the 93.5% major-violation-free rate reported in Table 2? Could the authors provide the total number of human major violations, the number of eligible decision–execution pairs, and the corresponding denominators for both metrics?

  3. Generalization Across Backend Models

    Given the substantial improvement in decision–execution correspondence observed with GPT-5.4, to what extent does the recognition–enactment gap persist with stronger backend models? Could the authors extend Q1–Q3 to additional backends across multiple agent frameworks?

  4. Definition and Selection of Values

    What theoretical or methodological criteria were used to select the value principles represented in VALUEWORLD? How do the authors define the scope of the evaluated values, and why were these particular principles chosen over alternative value frameworks?

  5. Validation of Value-to-Constraint Mapping

    How do the authors ensure that the task-specific behavioral constraints faithfully represent their intended value principles? Has this mapping been independently validated by human annotators, beyond the validation of task annotations and behavioral auditing?

  6. Independence of Repeated Rollouts

    Given the deterministic generation settings and the multiples-of-five pattern in several reported aggregate counts, how much variation exists across the five rollouts for each agent–task pair? Could the authors report the proportion of identical trajectories or outcome sequences and clarify whether independent seeds were used?

Reviewer_Fuo8OpenReview ↗
Rating
1
Confidence
3
Informativeness
1
Presentation
2
Soundness
2
Read review
Paper summary

This paper introduces Valueworld that can evaluate whether agents select value-consistent actions under competing task pressures. Based on the test, this work reveals a recognition–enactment gap in language agent's action.

Critical strengths
  1. The recognition-enactment gap is a meaningful question, and the work has proved why response-level evaluations may be insufficient for assessing real-world agent value and reliability.
  2. I think the evaluation framework design has covered multiple aspects of value enactment, including isolated recognition, decision-execution consistency, and adaptation to contextual shifts.
Critical weaknesses
  1. I think the observation of inconsistency between value knowledge and behavior is not novel. The following works have explored the similar directions: Agent-ValueBench: A Comprehensive Benchmark for Evaluating Agent Values PrivacyLens: Evaluating Privacy Norm Awareness of Language Models in Action

  2. The benchmark consists of 48 simulated text-based tasks, each limited to 12 interaction steps. These relatively short and controlled scenarios may not adequately represent the complexity of real-world, long-horizon agent tasks.

  3. The paper reports decreased value-consistent behavior after contextual shifts but does not include a matched no-shift control group. Therefore, the observed degradation could result from increasing task complexity or accumulated errors rather than the contextual shift itself.

  4. Automated agents achieve very low task progress (9.7–24.6%) compared with human experts (97.9%). This raises concerns about whether the observed failures reflect genuine value inconsistency or more general limitations in task execution and reasoning.

Questions for authors

See weakness above

Reviewer_CcgAOpenReview ↗
Rating
2
Confidence
2
Informativeness
2
Presentation
2
Soundness
1
Read review
Paper summary

The paper proposes ValueWorld, which evaluates whether agents satisfy specified value-related behavioral constraints while pursuing tasks in text-based environments. Its 48 tasks across six domains combine open-ended actions, three scheduled binary decisions, and a contextual shift. The protocol separates proposed actions from realized events. It connects isolated preferred-choice probes, in-trajectory decisions, immediate follow-through, and post-shift behavior.

The primary study compares six GPT-4.1 agent frameworks over 1,440 trajectories with 240 trajectories from five expert participants. Additional experiments examine contextual shifts and four backends. The authors use human annotation to validate the automatic audits.

Critical strengths
  1. The paper provides an operational definition of value enactment, which extends the evaluation of value alignment to the trajectory of agent actions. The method separates decision reach, preferred choices among reached decisions, and end-to-end preferred-choice evidence, preventing early termination from appearing solely as an incorrect choice.

  2. Human references and paired statistics improve interpretation of the results. The paper presents human study where five experts perform the same 48 tasks through the same pipeline. Their trajectories provide a reference for behavior under the benchmark interface.

Critical weaknesses
  1. The conceptual framing overlaps with prior works on evaluation, which makes me question the claimed novelty of introducing trajectory-level ethical evaluation or recognition–action gaps. For example, Tang et al. (2025) already compare risk knowledge, risk identification in trajectories, and actual avoidance of risky actions. MACHIAVELLI evaluates ethical violations and reward–ethics trade-offs in sequential games. ST-WebAgentBench evaluates legitimate enterprise tasks under explicit behavioral policies, including completion under policy.

Therefore, sequential ethical assessment, knowledge–action discrepancies, and constrained legitimate task completion each have prior works. ValueWorld's identifiable contribution is their diagnostic combination with execution criteria and predefined contextual shifts. The paper does not quantify the additional information this combination supplies over existing trajectory audits. A concrete comparative case would clarify its significance.

  1. Table 3 lacks backend-specific pair counts, uncertainty estimates, and a complete description of additional-backend rollout settings.

  2. It unclear to me why ProcessBypass is non-major, while Lie is major as ranked in Equation (12). Equations (13)–(14) derive major-violation status solely from the primary tag. The validator applies this priority to open-ended audits. Table 9 excludes bypasses that already realize a higher-priority substantive violation. When Lie has a lower priority, an open-ended step with exactly the supported tags {ProcessBypass, Lie} receives ProcessBypass as primary and is scored non-major. For example, an agent could bypass approval and falsely tell an auditor that approval occurred.

References

Yuzhi Tang, Tianxiao Li, Elizabeth Li, Chris J. Maddison, Honghua Dong, Yangjun Ruan, LM Agents May Fail to Act on Their Own Risk Knowledge, COLM 2025

Questions for authors
  • Do all Table 12 metrics use the same weighted confusion matrix? Please supply stratum-specific confusion counts, weights, and corrected metrics. Does corrected human validation preserve the main immediate-execution result?
  • How many tasks, rollouts, reached decisions, and eligible pairs support each Table 3 row? What are the corresponding uncertainty estimates? Does a human or independent-judge subset preserve the backend ordering?

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.