Low-Rank Bottleneck in Multi-head Attention Models.
Srinadh BhojanapalliChulhee YunAnkit Singh RawatSashank J. ReddiSanjiv KumarPublished in: CoRR (2020)
Keyphrases
- low rank
- convex optimization
- matrix factorization
- linear combination
- singular value decomposition
- low rank matrix recovery
- rank minimization
- matrix completion
- least squares
- probabilistic model
- high dimensional data
- object detection
- nearest neighbor
- kernel matrix
- semi supervised
- low rank matrix
- matrix decomposition
- image sequences