- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The authors have tried to tackle a transfer learning problem in the domain of flapping wings. Such systems are complex as they involve interaction between a moving body whose aerodynamic force generation surfaces are continuously changing configuration unlike fixed wing systems like airplanes. The idea is to use simulation data (which is abundant and cheaper compared to experimental data) to train a model to predict the instantaneous aerodynamics forces and then transfer it to unseen configurations of the flying robots like change in the medium, flapping frequency etc. This paper proposes CLAW, a physics informed transfer learning framework that learns aerodynamic force relationships from simulation and adapts them to experimental flapping wing systems using limited data. Its main strength is improved data efficiency through shared aerodynamic representations.
Critical strengths
- The authors aim to tackle a real gap in the domain, where limited experimental data is available.
- The authors have used a physics informed model design. The decomposition into shared and platform specific components is motivated by aerodynamic force scaling rather than an arbitrary network architecture.
- The authors have demonstrated meaningful gains over training from scratch
- The CLAW model used here is compact and fast to train.
- One important result identified here is that many domain adaptation methods try to make the source and target feature distributions similar. CLAW argues that this can be physically inappropriate.
- Detailed comparisons are provided against other domain adaptation and fine tuning strategies.
Critical weaknesses
- The source of the simulation data is not full field CFD simulations. Instead it is a semi-analytical, physics based model, which is comparatively cheap to evaluate. This can limit how well the forces are resolved in the training data.
- The authors do not show how well the training data compares against experiment or full field CFD.
- The authors transfer the learned model on experimental data, but only uses 183 trajectories due to lack of complete cycles. So the transfer learning part is evaluated only on the highly periodic portion of the experimental data, which may not be fully representative of real world flight performance.
- The transfer experiment is very limited. It does not cover multiple geometry configurations. It could partly be due to lack of experimental data. But if available, it will be interesting to see the performance on another set of independent experimental data.
- In zero shot test target, CLAW is not the best model, but the authors show it is cheaper in terms of time. But in real world application, it is not clear if that timesaving is relevant or such systems will benefit more from a more accurate model.
- The few shot transfer results does not establish the superiority of CLAW over other strategies.
Questions for authors
- If the model used in this study for generating simulating data does not require full field CFD calculation, which means it is cheap to evaluate, what is the need for a trained model? Can't we use the cheaper analytical model to predict for unseen scenarios?
- Can the authors demonstrate that the filtered target dataset is representative of the complete target dataset?
- Why does table 2 and 3 appear before table 1? Is that a formatting error?
- Can the authors provide more transfer experiments with additional wing geometries, Re and reduced frequencies?
The authors have provided additional justifications, but I don't think they have addressed my concerns. Instead, they add new concerns:
9. As an invited emergency reviewer, I expect the authors to show at least basic courtesy and respect for the time I spent reviewing this submission on the extremely short notice.