- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes the GON (Generalizable Outcome Networks) to address the control-latency issue that pretrained control models, such as Decision Transformer, Gato, RT-1/RT-2, and OpenVLA, are facing. Detailed commnets are outlined in Critical Weaknesse.
Critical strengths
The paper is trying to address the control-latency issue that pretrained control models, such as Decision Transformer, Gato, RT-1/RT-2, and OpenVLA, are facing.
Critical weaknesses
- The paper is more suitable for a power/energy conference, like IEEE PES, since it does not have a contribution to ML, and the experimental examples focus only on HVAC.
- The experiment was performed on a simulator/simulation, rather than real physical systems. The obtained conclusion has some underlying assumptions that may not hold in reality. One example is that the trained model via the encoder will face model mismatch since physical operating environments are usually complex and non-stationary. As a result, the results will face the challenging Sim2Real gaps.
- The paper is hard to follow; some critical information is missing. For example, what are the Decision Transformer, Gato, RT-1/RT-2, and OpenVLA? What are the core technical building blocks?
- The paper claims that pretrained control models such as Decision Transformer, Gato, RT-1/RT-2, and OpenVLA learn policies face control latency. The root reasons can be the chosen approaches for HVAC; others, such as adaptive controllers, can be much better.
- The experiment is a single simulated HVAC; it cannot demonstrate its generalization capability.
- To handle control latency issues, as well as model mismatch and distribution shift, the approaches of adaptive models and adaptive controllers in the control community have been proposed. The paper lacks such a literature review and comparisons.
- The title has the keyword "Learning Action Effects in Physical Systems", implying learning in real physical systems operating in the real physical world. Achieving physical learning in the physical world will be a great contribution. However, all the experiments are done in virtual simulators.
- What kinds of simulators are used in experiments?
Questions for authors
See Critical Weaknesses.
Thank you for the review and for the time spent on it. We appreciate the opportunity to clarify several aspects of the paper, and we address each point below.
Control latency. We would like to clarify that the paper does not study control latency; it does not make that claim, and the word "latency" does not appear in it. The problem we study is separating what the HVAC action did from what the outside conditions did. An HVAC action takes hours to have an effect, and weather, sunlight, and occupancy change the temperature during the same time, so a recorded trajectory cannot show how much of the change came from the action (Abstract; Section 1, paragraph 3; Section 3.1). Since the review's summary, its listed strength, and its suggestions about adaptive controllers are framed around latency, we hope this clarification helps in re-evaluating those points.
"The experiment is a single simulated HVAC." We respectfully note that the evaluation covers many buildings. GON is trained on 800 buildings and tested as one frozen model on 100 different unseen buildings across all eight ASHRAE climate zones, with no adaptation (Section 4.1, Tables 1 and 3, Figure 3). We believe this is the generalization test the review asks for. The buildings come from the OfficeSmall family (Appendix A.1.1) and differ in thermal dynamics and climate.
"What are DT, Gato, RT-1/RT-2, and OpenVLA?" These are widely used pretrained control models in machine learning. Each is cited and briefly described in Section 1 (paragraph 2), and Decision Transformer is discussed again in Section 2.1. GON's building blocks are given in Section 3, Figure 2, and Table 4. We have expanded these descriptions in Section 1.
"What simulators are used?" We use EnergyPlus [1], through the Building2Building benchmark [2], as stated in Section 1, Section 4, and Appendix A.1.1. EnergyPlus is the U.S. Department of Energy's building simulation engine and is widely used in building research and design. Building2Building was built specifically to test whether learned controllers generalize to new buildings, which is exactly what we evaluate.
Simulation and the title. Building2Building is our testbed. It was available to us, it was designed for this kind of evaluation, and it lets us test one controller on 100 unseen buildings under the same conditions as every baseline. It does not mean GON only applies to buildings. The method only needs matched rollouts during training, and the same idea applies to other physical systems where actions act slowly while outside conditions keep changing the state. By "physical systems" we mean systems governed by physical dynamics. We agree that real-world deployment would be a valuable next step; the paper does not claim it, and we see sim-to-real transfer as an important but separate question from the one we answer. The abstract now states that evaluation is in EnergyPlus.
Adaptive control. Thank you for this pointer. Adaptive controllers update a model online on the target building. We study zero-shot transfer: one frozen model, no updates on the test building. We see these as different, complementary settings, and we have added a short discussion of adaptive control to the related work (Section 2.4). Our MPC baseline is configured separately for each building, and GON's energy use is within 5% of it while using a single model for all 100 buildings.
ML contribution. The contribution is a machine learning method: matched counterfactual training data, a paired training loss, and outcome-conditioned flow matching with candidate selection. Table 2 shows that each part matters. The question is what a learned model can identify about its own actions from trajectory data, which we see as an ML question rather than a power systems one. HVAC is our testbed, in the same way robotics is the testbed for Decision Transformer and Diffusion Policy.
We note that the review rates soundness as "minor or fixable concerns." We hope the clarifications above address the main points about the problem and the experiments, and we would be grateful if the reviewer would consider revisiting the rating in light of them.
[1] D. B. Crawley et al. EnergyPlus: creating a new-generation building energy simulation program. Energy and Buildings, 33(4):319-331, 2001.
[2] V. Taboga, J. Veilleux, D. Jang, A. Rankawat, and P.-L. Bacon. Building2Building: A Large Scale Benchmark for Generalizable Real-World Reinforcement Learning. arXiv:2607.16534, 2026.