- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper studies how dictionary expansion affects sparse feature recovery in synthetic data and proposes progressive dimensional expansion with residual-guided atom insertion and capacity recycling for more efficient sparse auto-encoder training.
Critical strengths
This paper shows dimensionality expansion could improve the sparse feature learning.
Critical weaknesses
- The novelty of method is limited, increasing the complexity of the network could improve the performance is straightforward.
- The contributions are only derived from the simulation experiments, lack of theoretical analysis.
Questions for authors
- Only from the experiment, is it enough to prove your recovery conclusion? It is a lack of theoretical analysis.
- Why are the research questions, especially Q2, Q3, important to be answered? What are the limitations of the baselines corresponding to these questions?
- From the results, compared with TopK fixed, the advancement of PDE is limited. What is the benefit of the proposed method? What is the cost of the dimension expansion in the proposed method?