- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper studies how to reduce the cost when update new model to mobile devices/receivers. When the server/sender trains a new model, sending the updated model to the receiver will impose a communication cost. To minimize such cost, regularization to impose sparse updates is one solution to reduce the transmission cost. This paper studies how to select the anchor for regularization and shows that the proposed QCTR achieves lower communication cost under a multi-round update setup.
Critical strengths
- The paper targets an interesting question
- The proposed anchor effectively reduces the cost over multiple rounds.
Critical weaknesses
-
The readability of this paper needs to be improved. For example, the introduction section provides no background. When one starts reading from the first section, terms like “round”, “adaptation”, “receiver”, “sequence of models”, and “in-place updates” cannot be understood with the limited context. Readability is fundamental to a paper. Further revision is needed.
-
The problem is not well motivated. Who cares about this problem? Why is this an issue? These are not even properly provided in the introduction. Specifically, the proposed anchor effectively reduces the cost by several MB. In practice, patches of several MB is common for software apps. Is it really worth the potential performance risk? If it’s an important issue, what’s the current solution? There’s no reference to the closest prior work with a similar setup to motivate the problem. This is also reflected by the fact that none of the baselines are designed for this specific issue. Though it’s not wrong to address a new problem, if that is the case, more discussion needs to be provided to motivate the issue.
-
The survey is not complete. For example, similar prior work [a] studying multi-round model transfer cost is not cited or discussed. This makes the claim of defining the question as a contribution less convincing.
[a] Learning a Neural Diff for Speech Models. Interspeech 2021
Questions for authors
- As mentioned in the weaknesses, the current writing does not provide enough context for the terms mentioned. Those terms can mean different things in the context of quantization and federated learning literature. Without the context of the target task, it’s hard for the reader to understand the exact meaning.
- It seems that the proposed anchor achieved better performance than the unregularized counterpart. This needs to be discussed.