Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers.
Tianlong ChenZhenyu ZhangAjay Kumar JaiswalShiwei LiuZhangyang WangPublished in: ICLR (2023)
Keyphrases
- motion field estimation
- dense stereo
- dense optical flow
- dense motion estimation
- high dimensional
- sparse data
- compressive sensing
- dense reconstruction
- optical flow computation
- compressed sensing
- partial discharge
- sparse coding
- motion estimation
- optical flow
- sparse reconstruction
- canonical correlation analysis
- dictionary learning
- sparse representation