- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper introduces LETM for multiclass decisions where an agent receives only correct or incorrect feedback. After a successful recovery, LETM stores context-specific preferences between the successful action and previously rejected alternatives, allowing similar future instances to benefit from past mistakes without updating the encoder or using memory learning. Across different harness, adding LETM to an existing memory-equipped controller improves first-attempt accuracy and reduces the number of attempts on all four datasets. Controls suggest that these benefits depend on persistent, context-sensitive retrieval rather than simply avoiding repeated actions or accumulating global class-pair statistics.
Critical strengths
-
LETM improves mean first-attempt accuracy by at most 4% and reduces mean attempts across four datasets, with first-attempt gains statistically significant on three datasets.
-
Comparisons against disabled or scrambled memory, random retries, and global pairwise memory help isolate the contribution of persistent, context-specific recovery information.
Critical weaknesses
-
The main comparisons isolate components of the authors’ controller, while external learning methods use different supervision or update regimes. Comparisons with bandit-learning and episodic-memory methods adapted to the same binary-feedback and retry budget would better establish competitiveness.
-
The experiments cover classification tasks with only 6–20 classes, deterministic correctness feedback, and repeated guesses on an unchanged instance.
-
The method uses dataset-specific addressing representations, and the diagnostics show substantial performance changes when these representations change. This leaves uncertainty about how reliably LETM works with a fixed, generally applicable representation.
Questions for authors
See weakness.