- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors propose an engineering workflow for deploying a NN in a geology application. They discuss quantization, ablate first & last layer choice, the targeted hardware platform, data augmentation and provide synthetic experiments.
Critical strengths
This paper shows a case-study of applied ML to a geology problem. As such, it is probably interesting and a worthwhile read to that specific community.
Critical weaknesses
This paper is more of a lab-report than a new scientific contribution to ICLR. I see novelty as the major weakness, along with a lack of isolated baselines: The central LayerShield method of retaining higher precision at the first and last layers while quantizing the rest with standard QAT losely resembles established quantization practice, including prior work cited, such as PACT. The main accuracy table compares MLP versus multi-task learning, without isolating quantization. Speed-up claims wrt. to a legacy C implementation are somewhat arbitrary - presumably this is a CPU vs. accelerator comparison. I can see many AI formulations, which isn't necessarily bad but also not entirely clear how we as a community want to deal with this.
Questions for authors
- What is different between LayerShield-QAT from established QAT approaches?
- Compare different aspects of your QAT approach: FP32 everywhere on one side to LayerShield at the other end, including first/last layer choices.
- Your graphics are low-resolution and partly impossible to read.