- Rating
- 1(−1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies charging control for electric trucks and introduces TERL, an actor-critic framework using tree ensembles of fixed size. It alternates periodic rebuilding through advantage-weighted regression with on-policy leaf updates. Experiments on Pendulum and a simulated charging corridor compare TERL with neural and GBRL agents. TERL achieves higher charging profit than the reported GBRL baselines and lower inference latency, although the best neural policy achieves higher profit.
Critical strengths
-
Fixing the ensemble size addresses the growing model cost of GBRL. Periodic rebuilding allows the tree structure to change while leaf updates adapt the policy between rebuilds. The reported inference results support the usefulness of this design.
-
The charging task combines battery degradation, uncertain energy consumption, electricity prices, and driver-rest constraints. Evaluation across seasons and battery-health levels provides a useful setting for studying these competing objectives.
Critical weaknesses
-
The experiments do not separate the effects of rebuilding, leaf updates, and replay recency. Similar results for TERL-A2C and TERL-PPO do not establish which component produces the improvement.
-
The claimed non-stationarity needs clarification. Battery capacity and calendar information are already included in the state. Their evolution alone does not establish that the transition rules change over time.
-
Battery degradation is included in the reward, and battery capacity persists across missions. However, the evaluation does not directly show battery lifetime or cumulative profit across missions. The handling of returns at mission boundaries and any additional replacement cost needs clarification.
-
The supplied manuscript does not give numerical values for the degradation coefficients and several reward parameters, including driver wages, battery depreciation, and the failure penalty. These values are needed to reproduce the charging trade-off.
-
The paper lacks necessary diagrams to provide readers with a clear and intuitive understanding of the research content and methodology process.
Questions for authors
-
How does TERL compare with periodic AWR rebuilding without leaf updates, and with leaf updates without rebuilding, under comparable budgets?
-
After accounting for battery capacity and calendar information, which part of the transition dynamics changes during training?
-
Does the return stop at the end of each mission? Is battery replacement charged separately, or already covered by the depreciation term? Can you report battery-health trajectories and cumulative profit across missions?
-
Can you provide numerical values for the degradation coefficients, driver wages, battery depreciation, and failure penalty? How sensitive are the results to the assumed degradation cost?
We would like to express our gratitude to the reviewer for showing great interest in our work and providing relevant comments. We attempt to answer the reviewer's questions as follows: 1 - We are unfortunately not able to run the experiments the reviewer asks for within the time-frame for the rebuttal phase. 2 - The part of the transition dynamics that remains changing is the temperature, as it evolves based on real historical records from meteostat. 3,4 - The return does not stop at the completion of one mission, but continues for the indefinite future, and the cost of battery replacement is assumed to be covered by the depreciation term. Unfortunately, we are not able to reveal the specific numerical values used, due to the interest of the collaborating company that has provided the information.