- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The authors ask whether a trace of past learning is retained in networks. They focus on statistics of connections between neurons that receive similar inputs. By training networks in a manner that encourages either competition or cooperation in such cases, they test all four combinations of two sequential regimes. They find that the first regime leaves a trace even when performing an identical second regime. They also show that exchanging this component of connectivity between networks and refitting readouts can partially transfer their performance.
Critical strengths
The question of retention of learning history is an interesting one.
Critical weaknesses
The paper is written in a way that makes it extremely hard to make sense of the authors’ claims. The introduction is not very coherent. For instance, where do “pressures” come from? What is “clean-only”? These are defined later on, or in appendix, but this makes reading the paper harder. When referring to “The compact figure”, do the authors refer to “Figure 1”? The significance of the trace is unclear, as it nearly disappears with extended training, and can also reverse under some conditions.
Questions for authors
See above