- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes TessTok, a tokenizer for microstructure orientation maps that represents an image using quantized tessellation seeds containing position, size, orientation, and shape information. It introduces Fold-Flow Quantization (FFQ), which combines a learned monotone warp with an iterated smooth folding operation, and an existence gate that enables inference-time rate control. The evaluation covers reconstruction quality, grain geometry, and orientation statistics on synthetic magnesium-alloy microstructures, together with an ImageNet experiment. The central idea is to make the compressed representation reflect the objects underlying the physical field.
Critical strengths
-
The structural prior is well motivated by the application. Tessellation seeds are a reasonable representation for microstructure maps with approximately constant orientation within each grain. The compressed variables have interpretable connections to grain geometry and crystallographic orientation.
-
The method supports inference-time rate control. Adjusting the fraction of retained seeds allows a single trained model to operate at different compression budgets without retraining. The rate–fidelity sweep demonstrates this flexibility experimentally.
Critical weaknesses
-
The experiments focus on compression and reconstruction, without demonstrating benefits for simulation or inverse design. Compared with fine-tuned ViT-VQGAN, TessTok improves PSNR by 0.75 dB and matched grain area from 0.912 to 0.927. The practical significance of these gains for the intended physical applications remains unclear.
-
The main comparison uses natural-image tokenizers without domain adaptation, while TessTok is trained on microstructure data. The fine-tuned results in the appendix narrow the gap substantially and should be the primary comparison. Training budgets, trainable parameters, and objectives also need to be comparable.
-
The ablations do not clearly isolate the contributions of individual components. In particular, FSQ and other quantizers receive 60 training epochs, while FFQ uses the full staged schedule. FFQ gains 0.07 dB in PSNR and improves orientation statistics, but performs worse on rFID and matched grain area. Controlled comparisons are needed to establish its advantage.
Questions for authors
-
Can you compare FSQ and FFQ under the same training schedule, objective, and rate accounting? An identity-warp FFQ ablation would help separate the effects of smooth folding and learned quantization-level placement.
-
Can you report orientation errors between spatially corresponding pixels or matched grains, with a clear definition of grain matching? Global orientation statistics may not capture whether orientations are preserved at the correct locations.
-
Is the intended input to the physical solver the hard tessellation render or the final neural reconstruction? If it is the latter, what ensures constant orientation within each grain and prevents additional boundaries?
3 comments
Official Comment by NxZ6
After go through the author's feedback, I believe some of my concerns are well addressed in the rebuttal and I am glad to rise my rating to 3.
Thank you for reading the rebuttal and for raising your rating. Your suggestions on controlled comparisons and rate accounting have made the paper stronger. Two further results have come up in our experimentation since our response, and both are also in the general comment. First, set to ViT-VQGAN's rate (12,397 bits) without retraining, TessTok leads on PSNR ↑ (23.65 vs. 23.61 dB), rFID ↓ (8.45 vs. 13.56) and per-grain orientation error ↓ (24.0° vs. 26.8°). Second, we tested the variable seed count strength of TessTok in isolation. The same model, again without retraining, sends a fixed 552 seeds per field at the same bits. Against the variable count of the main model, every metric gets worse when we send fixed seeds (test images): PSNR ↑ 23.22 vs. 23.43 dB, rFID ↓ 11.76 vs. 8.87, per-grain error ↓ 24.8° vs. 24.3°. This helped us isolate the contribution of the content-adaptive seed count as a source of the TessTok gains.
Response to Reviewer NxZ6: solver test, fine-tuned baselines as the main comparison, and FSQ vs. FFQ under one schedule
Thank you for finding the tessellation seed prior well motivated.
W1 "benefits for simulation or inverse design..." / Q3 "..intended input to the physical solver..."
Intended and tested solver input: The decoded field is nearest-upsampled to 300² and segmented by SAM into grains, each grain gets the per-component median of its pixels' Euler angles, so this step gives one piecewise constant orientation per grain. Its grain boundaries agree with the original's exact ones (F1 = 0.926; ViT-VQGAN 0.906). The resulting grain map goes to the open-source crystal-plasticity solver DAMASK [1] (as in [2,3]), which turns it into a stress–strain curve. Material strength (from this curve) depends on each grain's orientation to the load, so decode errors become strength errors. We ran it on 60 test fields (AZ31, Mg-5Gd alloys under 25 % tension) (Sec. 4.4). Median % error vs the original (exact grains) of yield stress σy, tensile strength σu and hardening exponent n; curve RMS (MPa). Bits: one index-entropy estimate for all rows. TessTok's decoder now reads only the transmitted seeds and all TessTok numbers here outside Tab. 3 come from this model, trained for 75 epochs.
TessTok has the lowest error in all four columns, at 4 % fewer bits than ViT-VQGAN. The gaps to ViT-VQGAN are significant for σy, σu and RMS (paired Wilcoxon, p=0.008, 0.045, 0.031). This is the practical significance you asked about: TessTok's PSNR is now 0.17 dB below ViT-VQGAN's, yet its solver error is lower, because the solver reads grains and their orientations, where TessTok is more accurate (per-grain error 24.3° vs 26.8°, matched area 0.948 vs 0.912). No inverse-design loop is run in this study, but such a loop repeats this step [4].
W2 "fine-tuned results … should be the primary comparison"
Following your recommendation, we make it the main comparison (Tab. 1) in the revised PDF. With 4 % fewer bits than ViT-VQGAN, TessTok is better on rFID (8.87 vs 13.56), SSIM, MS-SSIM and every grain metric (per-grain error 24.32° vs 26.79°, matched area 0.948 vs 0.912, mean-orientation error 2.18° vs 2.33° for all 15 alloy families), and slightly behind on PSNR (23.43 vs 23.61 dB). WeTok and MAGVIT-v2 use fewer bits and trail on every metric. For the baselines we take the public pretrained weights and fine-tune them on the microstructure train data for 30 epochs. TessTok's seed bottleneck has no pretrained weights and is trained from scratch on the same pretrained ViT ends for 75 epochs, with added MSE, rate/seed-count and grain-seed loss terms; Tab. 8 lists budget, trained weights and losses per method.
W3/Q1 "same training schedule"
Yes (Tab. 3): every row is trained to 75 epochs with the same recipe; only the quantizer (and, where marked, commitment) differs. Its rows send all 1,024 seed slots, hence more bits; the last row is our main model, which sends only the active seeds.
The FFQ fold beats FSQ with rounding + straight-through estimator (STE) on rFID, PSNR, per-grain error and matched area. Compared image by image on the test set, the last three gaps are statistically significant (95 % confidence). The deficit you noted vanishes; Δθˉ ties (2.56° vs 2.55°). Row 3 is your identity-warp ablation where learned and identity warp agree within 0.01 dB and 0.02°, so we withdraw the level-placement claim; the contribution is the STE-free fold.
Q2 "orientation errors … matched grains"
SAM segments both original and reconstructed image, each original grain pairs with the reconstructed grain that overlaps it most (IoU ≥ 0.3). On the original's exact grains, per-grain error is 27.6° for TessTok vs 30.0° for ViT-VQGAN, matched area 0.882 vs 0.838. Without segmentation, the median pixel error is 22.8° vs 26.8°. All six matching variants agree: TessTok beats all the codebook and binary tokenizers in all 15 families (Tab. 15, App. H.1).
A revised PDF is uploaded with an additional page, containing fine-tuned comparison at equal rate, isolated fold, defined grain matching and a solver test added. With added evidence corresponding to your specific concerns, we would be grateful if you would consider raising your rating.
[1] Roters et al., Comput. Mater. Sci. 2019 [2] Tasan et al., Acta Mater. 2014 [3] Diehl et al., JOM 2017 [4] Kusampudi & Diehl, Int. J. Plast. 2023