acceptodds
Under review as a conference paper at ICLR 2027

Targeted Remasking: Token-to-Mask Refinement as Inference-Time Correction for Diffusion Language Models

Abstract

Diffusion language models (dLLMs) generate text through iterative denoising, filling multiple masked positions at each step. Positions filled in the same step are predicted without conditioning on one another's newly filled values and can therefore be mutually inconsistent; once retained, these inconsistencies become context for later predictions. We introduce Token-to-Mask (T2M), a training-free inference-time correction method that identifies low-confidence positions using the model's probability of the current token, remasks them, and reconstructs them in later denoising steps. On dLLMs equipped with correction mechanisms, a single T2M configuration transfers across tasks and models without retuning and broadly improves task metrics over each model's native correction mechanism.

Primary area:
foundation or frontier models, including LLMs
Keywords:
Diffusion Language Models, dLLMs

Reviews

Among:
Shape:
1234this paper, Bottom 2%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 1.33 over 3 reviews, above 2% of the others.
Reviewer_wdddOpenReview ↗
Rating
1(−1)
Confidence
4
Informativeness
2
Presentation
3
Soundness
2
Read review
Paper summary

Diffusion language models (dLLMs) generate text by iteratively filling masked positions, often committing multiple tokens in parallel. Tokens filled in the same step may be mutually inconsistent as they are not conditioned on each other. The work proposes Token-to-Mask (T2M), a training-free inference-time correction method that remasks tokens with probabilities less than a threshold and reconstructs them in later denoising steps. T2M improves performance on 15 out of 17 benchmarks on LLaDA2.1-mini against its T2T decoding. The work emphasizes improvements of remasking over immediate editing at the cost of additional inference computation.

Critical strengths
  1. The research question of whether an unstable token should be edited or remasked is an interesting direction in improving inference-time diffusion language model correction. While both directions exist in existing literature, the emphasize put by this work on this distinction is well motivated.
  2. The proposed method T2M is training-free and it is simple, intuitive, and easy to implement. The evaluation shows consistent improvements over a broad range of benchmarks which demonstrates the method's effectiveness.
Critical weaknesses
  1. T2M requires approximately 2-3x times as many forward evaluations as the baseline T2T. Figure 3 explores different threshold settings, but does not fully establish that T2M is preferable under identical inference budgets. It may be expected that increasing compute during inference in diffusion models can improve results. Hence, the work is missing evaluations comparing T2M against different baselines under similar compute budget, which would better distinguish its capabilities.

  2. The motivating problem of mutual inconsistency is not fully connected to the proposed solution. The paper starts by motivating the mutual inconsistency problem: positions filled in the same step are not conditioned on each other. However, the rest of the work, including the proposed solution, does not directly connect back to this problem. It is unclear why remasking based on a confidence threshold would resolve this specific problem rather than other types of inconsistencies.

Questions for authors
  1. How does T2M compare with ReMDM-conf, CORE, and T2T when using similar inference budget? For some methods the budget can be increased by increasing the number of decoding timesteps.

  2. How frequently do parallel commitments actually produce inconsistent tokens, and how often does T2M successfully resolve those inconsistencies? An (either qualitative or quantitative) analysis of how frequently such inconsistencies occur, how often T2M resolves or recreates them, and actual generation examples would strengthen the motivation.

  3. Wide-In, Narrow-Out (WINO) (Hong et al., ICLR 2026) seems to be a closely related work that also uses a confidence threshold to remask previously committed tokens and reconstruct them later (please refer to Eq. 3). WINO uses shadow-based verification, whereas T2M directly evaluates the current token without masking it. WINO also combines remasking with aggressive parallel decoding and reports inference speedups over its baseline. Could the authors clarify what T2M contributes beyond WINO and, if feasible, compare their accuracy and inference efficiency under similar settings? In particular, how would WINO's shadow-based verification and decoding settings perform when applied to LLaDA2.1, compared to T2M?

3 comments

Thank you for highlighting the connection to WINO and for asking how remasking can resolve inconsistencies between tokens generated in parallel.

We distinguish two generations of diffusion language models by how they are trained. Early models receive prediction supervision only at masked positions. Later models trained for token correction also receive prediction supervision at visible positions.

In the first generation, mask-only training applies the prediction loss only at masked positions. These models can output logits at visible positions, but those outputs receive no corresponding supervision and therefore need not provide a meaningful correction signal. Some correction methods for these models already use remasking. To identify which tokens need correction, they must obtain a signal indirectly or learn one through additional training, because they cannot rely directly on visible-token probabilities that have received no such supervision.

In the second generation, visible positions also receive prediction supervision. Applying softmax to the logits at these positions therefore yields prediction confidences grounded in that training. This makes it possible to use the probability assigned to the current visible token directly for detection. The native correction strategy for these models, however, is to edit the current token by replacing it directly with another token proposed by the model.

Our primary innovation is the combination of directly using the probability of the visible token and remasking it (prob + remask). T2M reuses the confidence estimates at visible positions learned during correction training. It uses the probability assigned to the current token to identify positions for correction, remasks those positions, and leaves reconstruction to subsequent denoising steps. This requires no additional training or indirect construction of a detection signal. Earlier remasking methods draw their signal from other sources, while the backbone that provides our signal natively uses it for editing. We pair this signal with remasking and use controlled detector–action comparisons to evaluate how editing and remasking perform with the same detection signal.

(LLaDA, §2.1, LLaDA2.1, §3.1)

WINO and matched-budget comparisons

To check a visible token x, WINO puts a mask at the corresponding position in a shadow block and prevents that position from attending directly to x. It reads the probability of predicting x itself at that mask. Only if this probability is below the verification threshold does WINO turn x back into a mask in the original sequence. T2M reads the probability of x at its original, still-visible position. A latency comparison must include WINO’s shadow verification and T2M’s subsequent denoising.

We agree that we should compare WINO and T2M on the same LLaDA2.1 checkpoint and evaluate T2M against ReMDM-conf, CORE, and T2T under matched inference budgets. We will run these comparisons in follow-up work and report accuracy and inference cost.

Default T2M uses 2.0–3.1× as many forward evaluations as native T2T. Table 3 compares actions under the same detector.

DetectorReplace accuracy @ NFE/tokenRemask accuracy @ NFE/token
T2T trigger89.54 @ 0.26289.76 @ 0.267
CORE, interval 887.11 @ 0.49688.86 @ 0.457
CORE, interval 285.22 @ 0.64289.39 @ 0.523

With the T2T trigger the costs are similar. With CORE, remasking improves accuracy and reduces NFE/token at both intervals. Our ReMDM result is for the random variant (91.28 accuracy at 2.88 NFE/token), while LOWPROB with τ=0.9 reaches 91.66 at 0.672 NFE/token.

Parallel inconsistency

Parallel filling is one way a token can lose support as context develops. Suppose a city and a tower name are filled in the same step. Each may be plausible on its own, yet the pair may be inconsistent. Once the city is visible, the model may assign the chosen tower name a probability below the LOWPROB threshold. T2M can then reopen the tower name and predict it again with the city in view. If both tokens receive low support, both can be reopened within the remasking budget. This repeated updating in light of the other positions is the intuition shared with Gibbs sampling. LOWPROB measures support for a token in its current context. The score alone cannot tell us whether parallel filling caused a conflict.

These statistics would directly test our motivation. We did not collect them originally. During rebuttal, we allocated our time and compute to another submission we considered more likely to be accepted and deferred this analysis and the additional baselines. We will analyze generation traces in follow-up work to measure how often tokens filled together conflict and how often T2M resolves or reintroduces those conflicts.

Reviewer_wdddOpenReview ↗

Rebuttal response

I thank the authors for the clarifications.

My primary concerns were threefold: novelty, motivation, and computation. After reviewing the rebuttal, I find that these concerns remain mostly unresolved.

Novelty: The rebuttal clarifies the distinction from existing methods such as WINO, however, I remain unconvinced that directly using visible-token probabilities for detection rather than existing similar verification mechanism constitutes sufficient methodological novelty.

Motivation: The hypothetical example is plausible but provides no qualitative or quantitative evidence that T2M resolves parallel inconsistencies.

Computation: While Table 3 provides useful comparisons under the same detector, it does not establish whether existing methods could achieve comparable or better performance under matched inference budgets.

Given these unresolved concerns, I have decided to lower our score from 2 (Weak Rejection) to 1 (Clear Rejection).

Thank you for the follow-up. Our earlier reply used a hypothetical example where we should have pointed to the evidence. Parallel inconsistency is a documented motivation for both remasking and token editing. Our question is what the decoder should do once it flags a committed token.

D3PM (§3) factorizes each reverse step across positions given the current sequence. Tokens filled together can therefore each be plausible under that context and still be incompatible with one another. ParallelBench gives a concrete test: when shuffling a list, two positions filled together can select the same item, violating the requirement that each item appear exactly once. Its analysis and LLaDA experiments show that even filling two positions per step becomes unreliable as the list grows (Eq. 5, Fig. 2). Structured Denoising Diffusion Models in Discrete State-Spaces · ParallelBench: Understanding the Trade-offs of Parallel Decoding in Diffusion LLMs

WINO, which you cite, explicitly motivates revocable decoding with contradictory tokens produced during early parallel decoding (§4.1). It verifies draft tokens and remasks those that lose support. LLaDA2.1 identifies the same problem and introduces token-to-token editing so that later steps can overwrite earlier commitments (§§1–2). Our contribution is to use the correction-trained model’s probability of the visible token to trigger remasking and to test the choice of correction action while holding the detector fixed. Wide-In, Narrow-Out: Revokable Decoding for Efficient and Effective DLLMs · LLaDA2.1: Speeding Up Text Diffusion via Token Editing

Our paper provides both qualitative and quantitative evidence for this choice. In the controlled example in Fig. 1(c), the model flags gasoline in “the firefighter extinguished the fire with gasoline.” It assigns water probability 0.27, below the edit threshold. After remasking, that probability rises to 0.87 and the model fills in water. Fig. 1(b) shows an actual GSM8K trace: the editor overwrites the correct units digit 5 with 2 and ends at 225, whereas T2M reopens the position and recovers the 5. On full GSM8K with the same LOWPROB detector, direct replacement gives 89.39% accuracy and deferred remasking gives 91.13% (Table 3). These experiments show how the correction action affects predictions and final answers. Estimating the fraction of same-step conflicts that T2M repairs would require labeling their origin in generation traces.

On computation, Table 3 also permits a comparison across detectors. On LLaDA2.1-mini, default T2M scores 91.13% at 0.584 forward evaluations per token, while CORE with direct replacement at interval 2 scores 85.22% at 0.642. Thus T2M uses fewer evaluations per token at these measured settings. How WINO and the other baselines would rank if each were optimized at a common inference budget remains open.

We understand why the absence of new experiments leaves some of your questions open. In your original review, you identified the choice between editing and remasking as a strength of the paper. In your follow-up, you acknowledge that the distinction from WINO is clearer and that Table 3 provides a useful comparison. Given that the remaining concerns were already part of your initial assessment, could you clarify what changed in your judgment of the paper to warrant lowering the rating from Weak Rejection to Clear Rejection? We would appreciate your reconsidering the lower rating in light of the evidence above.

Reviewer_AGVpOpenReview ↗
Rating
1
Confidence
4
Informativeness
1
Presentation
3
Soundness
2
Read review
Paper summary

This paper introduces Token-to-Mask (T2M), a training-free inference-time correction method for dLLMs. Instead of directly replacing previously generated tokens, T2M identifies low-confidence tokens based on their predicted probabilities, masks them again and lets the later denoising steps regenerate them. The authors evaluate the method on 17 benchmarks and several diffusion language models, reporting improvements over existing correction strategies on most tasks. They also compare different confidence-based detection methods and examine the effects of remasking compared with direct token replacement.

Critical strengths

None

Critical weaknesses

Major Weakness 1: Lack of Methodological Novelty

The proposed method offers very limited methodological novelty. Confidence-guided remasking has been extensively studied in prior diffusion language models. LLaDA [1] already employs low-confidence remasking during iterative decoding, while subsequent works such as RemeDi [2], WINO [3], Saber [4], and DecoCal [5] further explore revisiting and correcting previously generated tokens based on confidence or prediction stability.

The core mechanism of T2M follows the same established principle: identify low-confidence tokens using their predicted probabilities, remask them, and allow subsequent denoising steps to regenerate them. The primary contribution appears to be replacing the existing T2T editing mechanism in LLaDA2.1 with a confidence-guided remasking strategy, controlled by thresholding and remasking budgets. It is unclear what constitutes the novel methodological contribution beyond this straightforward adaptation of existing techniques.

While the empirical improvements are shown, demonstrating that an existing remasking strategy performs better than an existing editing strategy does not, by itself, establish methodological novelty. The authors should clearly distinguish T2M from prior confidence-guided remasking approaches, particularly WINO [3], and explain what fundamentally new mechanism or insight the proposed method provides.

Major Weakness 2: Insufficient Comparisons with Existing Inference-Time Methods

The experimental evaluation lacks comparisons with several highly relevant training-free inference-time methods, including WINO [3], Saber [4], DecoCal [5], COVER [6], and PURE [7]. In particular, WINO already introduces training-free revocable decoding through verification and remasking of suspicious tokens, making it a particularly important baseline for evaluating both the novelty and effectiveness of T2M.

Although the paper includes comparisons with T2T editing, ReMDM-style random remasking, CORE, and RemeDi, the evaluation against alternative correction methods is largely restricted to GSM8K. The broader 17-benchmark evaluation primarily compares T2M against T2T editing. Moreover, some baseline implementations are modified from their original configurations, making it difficult to assess whether the observed improvements arise from the proposed method or differences in decoding configurations.

Furthermore, T2M requires approximately 2–3 times more forward evaluations than T2T editing, making comparisons under matched computational budgets and wall-clock latency particularly important. Without comprehensive comparisons against strong existing training-free refinement methods, it remains unclear whether T2M offers a meaningful improvement in the accuracy-efficiency trade-off.

Given the limited methodological novelty, these missing comparisons substantially weaken the empirical justification for the proposed approach.

[1] Nie et al. Large Language Diffusion Models. NeurIPS 2025.

[2] Huang et al. Don't Settle Too Early: Self-Reflective Remasking for Diffusion Language Models. ICLR 2026.

[3] Hong et al. Wide-In, Narrow-Out: Revokable Decoding for Efficient and Effective DLLMs. ICLR 2026.

[4] Dong et al. Saber: An Efficient Sampling with Adaptive Acceleration and Backtracking Enhanced Remasking for Diffusion Language Model. ACL 2026.

[5] Xu et al. DecoCal: Decoding with Calibration in Diffusion Large Language Models. ACL 2026.

[6] Xiang et al. Stop the Flip-Flop: Context-Preserving Verification for Fast Revocable Diffusion Decoding. ICML 2026.

[7] Park et al. PURE: Post-hoc Unlocking and REfinement for Discrete Diffusion Decoding. Findings of ACL 2026.

Questions for authors

Please check Critical Weaknesses part.

2 comments

Thank you for the detailed review, particularly for raising questions about the novelty of T2M and the choice of baselines.

We distinguish two generations of diffusion language models by how they are trained. Early models receive prediction supervision only at masked positions. Later models trained for token correction also receive prediction supervision at visible positions.

In the first generation, mask-only training applies the prediction loss only at masked positions. These models can output logits at visible positions, but those outputs receive no corresponding supervision and therefore need not provide a meaningful correction signal. Some correction methods for these models already use remasking. To identify which tokens need correction, they must obtain a signal indirectly or learn one through additional training, because they cannot rely directly on visible-token probabilities that have received no such supervision.

In the second generation, visible positions also receive prediction supervision. Applying softmax to the logits at these positions therefore yields prediction confidences grounded in that training. This makes it possible to use the probability assigned to the current visible token directly for detection. The native correction strategy for these models, however, is to edit the current token by replacing it directly with another token proposed by the model.

Our primary innovation is the combination of directly using the probability of the visible token and remasking it (prob + remask). T2M reuses the confidence estimates at visible positions learned during correction training. It uses the probability assigned to the current token to identify positions for correction, remasks those positions, and leaves reconstruction to subsequent denoising steps. This requires no additional training or indirect construction of a detection signal. Earlier remasking methods draw their signal from other sources, while the backbone that provides our signal natively uses it for editing. We pair this signal with remasking and use controlled detector–action comparisons to evaluate how editing and remasking perform with the same detection signal.

(LLaDA, §2.1, LLaDA2.1, §3.1)

Differences from the cited methods

MethodRelevant distinction from direct LOWPROB detection
LLaDAThe original LLaDA decoder only performs mask→token updates. Confidence determines which masked predictions to commit this step. Unselected positions stay masked, and a committed token never goes back to mask. generate.py
RemeDiAt each step, RemeDi ranks all positions in the current block together. In the released decoder, a visible position is scored by the logit of its current token and a masked position by the logit of its best fill candidate. Only the top K positions carry tokens into the next step. All others are masked, including previously visible positions that drop out of the top K. K grows over the denoising steps. inference.py
WINOTo check a visible token x, WINO puts a mask at the corresponding position in a shadow block and prevents that position from attending directly to x. It reads the probability of predicting x itself at that mask. Only if this probability is below the verification threshold does WINO turn x back into a mask in the original sequence. T2M reads the probability of x at its original, still-visible position.
Saber, DecoCal, and PUREThey use confidence changes, historical calibration, or trajectory instability. Our LOGITDIFF variant studies this related family of temporal criteria.
COVERIt constructs a verification view and makes Keep/Replace/ReMask decisions.

Baseline comparisons

The direction of the comparison matters. LOWPROB uses the probability assigned to the current token at its own visible position. On a baseline backbone trained only at masked positions, we can compute that probability, but the training objective gives it no interpretation as confidence that the visible token is correct. Applying the same threshold there would therefore not test LOWPROB with the signal it requires. We instead implement the baseline’s correction rule on a backbone that supplies this signal. Holding the weights fixed also lets us attribute differences to the decoding policies rather than to different models.

For CORE, we ported its published detector to LLaDA2.1-mini. Its original 32 candidates would mask our entire 32-token block, so we used four in both action conditions (Appendix A). With the detector held fixed, leaving flagged positions masked for later reconstruction improved GSM8K accuracy over CORE’s same-step refill at both detection intervals and used fewer forward evaluations per token (Table 3).

For RemeDi, we used its released top-K decoder on RemeDi-Instruct as the baseline. We then ran T2M on those same weights, using threshold-based mask-to-token filling and LOWPROB remasking (§4.1). This compares two decoding policies on RemeDi-Instruct, including their choices of which positions to fill and which to reopen.

We acknowledge that additional baseline comparisons are necessary, particularly with WINO. During this rebuttal we devoted our available time and compute to another submission we considered more likely to be accepted, so we did not run the additional baselines. In follow-up work we will compare T2M with WINO, Saber, DecoCal, COVER, and PURE on the same backbone under matched inference budgets and report accuracy and wall-clock latency.

Reviewer_eFiYOpenReview ↗
Rating
2
Confidence
4
Informativeness
2
Presentation
3
Soundness
2
Read review
Paper summary

This paper proposes Token-to-Mask (T2M), a training-free method for correcting diffusion language models at inference time. Instead of directly replacing a suspicious token, T2M remasks it and lets the model predict it in later denoising steps. The method uses the probability of the current token to decide which positions to remask. Experiments on 17 benchmarks show improvements on 15 tasks. The paper also compares different error detectors and correction actions.

Critical strengths
  1. Simple and training-free method. T2M does not require additional training. It can be added to an existing decoding process, making it relatively easy to implement.

  2. Useful comparison of correction methods. The detector–action experiments help separate the effects of error detection and correction. On GSM8K, remasking performs better than direct replacement under several matched detectors.

Critical weaknesses
  1. Limited practical value due to the extra inference cost. The accuracy gains are modest on many benchmarks, while T2M requires 2.0–3.1× as many forward passes as T2T. For example, GSM8K accuracy increases from 89.61% to 91.21%, while latency increases from 0.92 seconds to 1.99 seconds.

  2. Novelty over existing remasking methods is limited. Remasking, confidence-based token selection have already been studied in methods such as ReMDM and RemeDi. T2M's use of the current token's probability as a detector may be a useful design choice, but the design space seems limted.

Questions for authors

How does T2M differ in a fundamental way from existing confidence-based remasking methods, especially ReMDM and RemeDi? Which part of the method is the main new contribution beyond applying a token-level confidence threshold to remasking?

2 comments

Thank you for recognizing the value of the detector–action comparisons and for asking how T2M differs from earlier remasking methods.

We distinguish two generations of diffusion language models by how they are trained. Early models receive prediction supervision only at masked positions. Later models trained for token correction also receive prediction supervision at visible positions.

In the first generation, mask-only training applies the prediction loss only at masked positions. These models can output logits at visible positions, but those outputs receive no corresponding supervision and therefore need not provide a meaningful correction signal. Some correction methods for these models already use remasking. To identify which tokens need correction, they must obtain a signal indirectly or learn one through additional training, because they cannot rely directly on visible-token probabilities that have received no such supervision.

In the second generation, visible positions also receive prediction supervision. Applying softmax to the logits at these positions therefore yields prediction confidences grounded in that training. This makes it possible to use the probability assigned to the current visible token directly for detection. The native correction strategy for these models, however, is to edit the current token by replacing it directly with another token proposed by the model.

Our primary innovation is the combination of directly using the probability of the visible token and remasking it (prob + remask). T2M reuses the confidence estimates at visible positions learned during correction training. It uses the probability assigned to the current token to identify positions for correction, remasks those positions, and leaves reconstruction to subsequent denoising steps. This requires no additional training or indirect construction of a detection signal. Earlier remasking methods draw their signal from other sources, while the backbone that provides our signal natively uses it for editing. We pair this signal with remasking and use controlled detector–action comparisons to evaluate how editing and remasking perform with the same detection signal.

(LLaDA, §2.1, LLaDA2.1, §3.1)

ReMDM-conf weights remasking by the confidence cached when the token was last unmasked. That score reflects the context at generation time. Our ReMDM baseline uses the uniform random variant. ReMDM, §4.1

At each step, RemeDi ranks all positions in the current block together. In the released decoder, a visible position is scored by the logit of its current token and a masked position by the logit of its best fill candidate. Only the top K positions carry tokens into the next step. All others are masked, including previously visible positions that drop out of the top K. K grows over the denoising steps. A visible token can therefore be remasked simply because other positions outrank it. T2M first tests each current token against a probability threshold and ranks candidates only if the remasking budget binds (§3.2). inference.py

Inference cost and accuracy

Default T2M uses 2.0–3.1× as many forward evaluations as native T2T (latency in Appendix G). Table 3 isolates the effect of changing the action while holding the CORE detector fixed.

CORE intervalReplace accuracyRemask accuracyNFE/token, replace → remask
887.1188.860.496 → 0.457
285.2289.390.642 → 0.523

At both intervals, remasking improved accuracy with fewer forward evaluations per token. Across tasks, the configuration selected on GSM8K improved 15 of 17 benchmarks without retuning, including gains of 3.66 points on HumanEval+ and 2.02 on GPQA.

The main concern is still that the accuracy gains are relatively small compared with the additional inference cost. So I will maintain my rating.

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.