- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a calibrated thermal twin framework for identifying building heat loss from surface temperature observations. The authors argue that interior conductivity fields cannot be uniquely recovered from limited boundary measurements and instead focus on estimating surface U-values and localizing thermal bridge footprints. The framework combines a geometry-conditioned neural operator, a calibrated surface-flux readout, and split-conformal prediction for uncertainty estimation. Experiments on synthetic building datasets and several inverse problems show that direct U-value estimation can outperform methods based on full-field reconstruction. Additional experiments on real building geometries and measured infrared data provide preliminary evidence of practical applicability.
Critical strengths
- Clear motivation. The paper distinguishes between recovering an interior conductivity field and estimating quantities supported by boundary observations. The non-uniqueness analysis provides a reasonable justification for focusing on U-values and thermal bridge footprints.
- Extensive experimental analysis. The experiments compare direct readout with optimization-based and learned inverse methods across different datasets and noise levels. The paper also reports cases where learned inverses perform better and evaluates uncertainty using conformal prediction.
Critical weaknesses
- Limited real-world validation. The main U-value accuracy results rely on synthetic data, while the measured infrared experiments lack ground-truth U-values. It remains unclear whether the calibration learned from synthetic envelopes transfers reliably to real buildings.
- Idealized noise and calibration assumptions. The experiments mainly consider independent measurement noise, whereas real thermal images may contain spatially correlated errors, emissivity bias, and uncertain boundary conditions. The conformal coverage guarantee also depends on exchangeability, which may not hold across different buildings or measurement settings.
- Inconsistent reporting of experimental results. The paper reports both original (40/32/32) and enlarged (120/96/96) validation sets, with different U-value errors appearing across sections. The relationship between these results and the corresponding experimental settings should be clarified to improve reproducibility.
Questions for authors
- Which validation sets support the main results reported in the abstract and tables? How do the original and enlarged evaluation sets relate to each other?
- How robust is the U-value estimation to spatially correlated noise, shared measurement bias, or uncertain boundary conditions?
- How well does the calibration learned from synthetic data transfer to real buildings, given the absence of measured U-value ground truth?
- How should the reported conformal coverage be interpreted under distribution shifts or repeated calibration-test splits with relatively small validation sets?
4 comments
[W2 & Q2: Measurement error beyond independent noise]
We repeated the junction noise sweep under three error models, exterior slab, five seeds, 40 geometries, the same calibration. (i) Spatially correlated noise, a Gaussian random field with correlation length 5, 15 or 30 % of the face and unit marginal variance, spatial mean kept. (ii) A shared gain θ·(1 + sζ), one ζ per image, the emissivity or drive-temperature case. (iii) A shared offset θ + sζ·mean(θ_face), the reflected-temperature case. ΔT is 20 K, so the largest level s = 0.04 is a 0.8 K error. U-value MAE (W/m²K) at s = 0.04 and the readout's 90 % conformal interval. At s = 0 every model gives 0.039 for the readout, 0.046 to 0.049 for optimization and 0.15 to 0.18 for Transolver. The clear-wall guess is 0.28 to 0.30.
| Error model | Readout (ours) | Optimization | Transolver | Coverage / width of the readout interval |
|---|---|---|---|---|
| Independent (paper) | 0.081 | 0.110 | 0.175 | 0.90 / 0.36 |
| Shared gain | 0.046 | 0.051 | 0.165 | 0.90 / 0.23 |
| Shared offset | 0.050 | 0.056 | 0.160 | 0.90 / 0.24 |
| Correlated, 5 % of the face | 0.123 | 0.156 | 0.181 | 0.89 / 0.49 |
| Correlated, 15 % | 0.231 | 0.250 | 0.204 | 0.89 / 0.94 |
| Correlated, 30 % | 0.340 | 0.315 | 0.200 | 0.90 / 1.51 |
A shared gain or offset is absorbed by the calibration, so Assumption 1 was too pessimistic there. Spatially correlated error is the limitation. A smooth perturbation at the slab scale is not averaged down, and at the largest level and length every route reading the surface falls past the clear-wall guess (0.34 and 0.32 against 0.28), while Transolver sits at 0.20 only because it is at 0.15 to 0.21 at every level including zero noise. Coverage stays at 0.89 to 0.91 in every cell while the width grows from 0.22 to 1.5, so the interval reports the failure. The readout beats both field routes at every level at 5 % correlation length (p = 4×10⁻⁴ and 0.047 at s = 0.04), up to s = 0.02 (0.4 K) at 15 % and s = 0.01 (0.2 K) at 30 %. The physical reading is the size of the signal. The exterior face sits r_se·U·ΔT, about 0.4 K, above outdoor air. Independent camera noise of 0.03 to 0.05 K averages over the roughly 80 readout points to a few percent of that signal. A smooth 0.4 K error at the slab scale is the signal itself, and no estimator reading that surface can remove it. The revision states this envelope with the interval flagging anything beyond (Appendix A.12, C7).
Uncertain boundary conditions. An error in the outdoor reference temperature enters as the shared offset and an error in the indoor-to-outdoor contrast as the shared gain, both measured above. An uncertain exterior film resistance r_se is a multiplicative error on U for every route, since all read U = θ_face / r_se, so a 25 % error, the spread between calm and windy conditions, costs 25 % of U for every method and for the ISO 6946 formula itself, which is why exterior surveys are specified at low wind. The revision states dU/U = −dr_se/r_se (C7).
[W3 & Q1: The two validation-set sizes]
The 40/32/32 geometries are the original validation sets. The 120/96/96 sets were generated afterwards from the same validation seed and contain the originals as their first draws, so they are supersets evaluated with the same five training seeds and trained models. The revision uses the enlarged sets everywhere in the main text and moves the original-set tables to Appendix A.14 (C3). The hard and box noise sweeps, previously run only on the original sets, are now run on the enlarged sets. U-value MAE (W/m²K), each cell noise s = 0 → s = 0.04, p of the readout against optimization at s = 0.04.
| Corpus, geometries | Readout (ours) | Optimization | Transolver | p |
|---|---|---|---|---|
| Junction, 40 | 0.039 → 0.081 | 0.047 → 0.110 | 0.164 → 0.175 | 6×10⁻⁵ |
| Junction, 120 | 0.036 → 0.086 | 0.042 → 0.111 | 0.183 → 0.189 | 8×10⁻⁸ |
| Hard, 32 | 0.029 → 0.049 | 0.042 → 0.085 | 0.047 → 0.086 | 6×10⁻⁵ |
| Hard, 96 | 0.024 → 0.046 | 0.037 → 0.088 | 0.037 → 0.084 | 4×10⁻¹⁵ |
| Box, 32 | 0.042 → 0.076 | 0.054 → 0.149 | 0.038 → 0.052 | 10⁻⁶ |
| Box, 96 | 0.033 → 0.077 | 0.037 → 0.135 | 0.029 → 0.050 | 6×10⁻¹⁴ |
The enlarged sets sharpen every comparison and change no conclusion, including that on box the Transolver route reads U slightly better than the surface. With the prior-equipped baselines of the 7Zij thread, the readout's margin on hard is significant only on the 96-geometry set (p = 0.010 and 0.007).
[Q4: Conformal coverage under shift and with small sets]
Coverage is marginal under exchangeability for any estimator, and the paper reports repeated 50/50 splits of the validation geometries. The standard deviation of coverage across splits is 0.09 at 20 calibration geometries and 0.055 at 60, reported in Appendix A.13. To test the guarantee off its assumption we calibrated on one corpus and tested on another, which breaks exchangeability deliberately and needs no new training. Empirical coverage of the nominal 90 % interval over the six off-diagonal pairs.
| Estimator | Own corpus | Worst pair | Best pair |
|---|---|---|---|
| Readout (ours) | 0.90 to 0.92 | 0.80 | 0.98 |
| Supervised head | 0.90 to 0.92 | 0.75 | 0.99 |
| Optimization route | 0.90 to 0.92 | 0.52 | 1.00 |
| Transolver route | 0.90 to 0.92 | 0.38 | 1.00 |
The worst case for the readout is calibrating on hard, the corpus with the narrowest spread of U, and testing on junction. Exchangeability failure costs every estimator its guarantee, the readout loses the least, and the field routes' intervals, whose width is set by their prior, collapse under shift (C8).
[Changes to the paper]
C1 abstract states the validation scope. C3 enlarged sets primary, original sets in Appendix A.14. C7 measurement-error appendix with the operating envelope and the r_se sensitivity, and the envelope pointer in the Discussion. C8 appendix on the calibration parameters, their non-transfer, the prior-ratio readout and cross-corpus coverage. The remaining changes are in the general response.
We hope the new evidence addresses your concerns. We would appreciate it if you could kindly reconsider your score.
I thank the authors for the detailed response. The clarification that the 120/96/96 sets are supersets generated from the same validation seed resolves my concern about inconsistent reporting (W3). However, my two other concerns are not resolved. First, the authors confirm that no dataset pairing wall infrared imagery with ISO 9869 heat-flux U-values is publicly available, so absolute U accuracy remains established only on the ISO 10211 synthetic corpus; the physical-interpretability argument for calibration transfer is a justification, not evidence, and the abstract's claim of "initial evidence for practical application" on real buildings should be accordingly downgraded. Second, the newly added noise study undermines rather than supports the central claim: under 15% and 30% spatially correlated noise the proposed estimator (0.231/0.340) is worse than Transolver (0.204/0.200), and cross-corpus conformal coverage drops to 0.52, which the authors themselves describe as loss of the guarantee. I therefore keep my score at 2.
Thank you for the informed and constructive review. We address each point below, in three comments. Every change in the revised PDF is typeset in blue.
[W1 & Q3: Real-world validation and calibration transfer]
Absolute U-value accuracy is established on the ISO 10211 validated synthetic corpora and not on measured buildings, because no public dataset pairs infrared imagery of a wall with a heat-flux-meter (ISO 9869) U-value and a layer table. The measured-data appendix claims plausibility of localization and nothing about U, and on the real TUM2TWIN shells, where the twin's prior-equipped inverse locates the inserted bridges at 0.74 and 0.66, U is degenerate at the clear-wall value. The abstract now states this scope (C1). A measured validation needs exterior infrared, interior and exterior air temperatures, a heat-flux plate on the same section and the construction record, and it is the next step.
The two calibration parameters have a physical meaning, which answers the transfer question. Regressing the raw slab readout on true U gives slope 1.11 on junction, 2.03 on hard and 2.37 on box. The readout averages a slab 2 % inside the outer layer, and how far θ has climbed from its face value r_se·U at that depth is set by that layer's conductivity. The affine map absorbs this, so it is corpus-specific and does not transfer (junction's map on hard gives 0.098 against hard's own 0.024). It is a sampling artefact of reading a point cloud inside the wall, not a sim-to-real device. A camera reads the face itself, where θ_face = r_se·U holds exactly and the correction vanishes. U-value MAE (W/m²K), enlarged sets, with two parameter-free replacements.
Scaling the raw slab mean by the 1-D prior's own slab-to-face ratio, computed from the layer table with no fit, replaces the calibration within 0.01 W/m²K on hard and box and fails on junction, where the bridges rather than the layer table set the near-face profile. Extrapolating the slab profile to the face fails wherever the slab straddles a layer interface (0.28 and 0.29 on hard and box). Narrowing the slab toward the face shrinks the raw bias as the physics predicts (raw slope 2.03 → 1.71 on hard and 1.11 → 1.06 on junction between 2 % and 0.5 % depth). The two parameters encode where the sampled slab sits inside the outer layer, and the revision reports the non-transfer and the prior-ratio readout in Appendix A.13 (C8).