Transformer visualization via dictionary learning: contextualized embedding as a linear superposition of transformer factors.
Zeyu YunYubei ChenBruno A. OlshausenYann LeCunPublished in: DeeLIO@NAACL-HLT (2021)
Keyphrases
- dictionary learning
- sparse representation
- sparse coding
- graph embedding
- image super resolution
- group sparsity
- object category recognition
- dictionary learning for sparse
- similarity measure
- data analysis
- high quality
- multidimensional scaling
- linear combination
- vector space
- data mining
- co occurrence
- text mining
- reinforcement learning
- face recognition
- computer vision
- learning algorithm
- machine learning