Grokking of Hierarchical Structure in Vanilla Transformers.
Shikhar MurtyPratyusha SharmaJacob AndreasChristopher D. ManningPublished in: CoRR (2023)
Keyphrases
- hierarchical structure
- hierarchical classification
- hierarchical structures
- hierarchically structured
- hierarchical organization
- tree structure
- binary tree
- formal concept analysis
- image representation
- computer vision
- partial discharge
- database management systems
- management system
- association rules
- data structure
- training data
- database systems
- random effects
- machine learning
- hierarchical data structures