The Topological BERT: Transforming Attention into Topology for Natural Language Processing.
Ilan PerezRaphael ReinauerPublished in: CoRR (2022)
Keyphrases
- natural language processing
- topology preservation
- topological properties
- topology preserving
- machine learning
- natural language
- information extraction
- persistent homology
- text mining
- visual attention
- wordnet
- semantic analysis
- free text
- word sense disambiguation
- topological features
- topological information
- focus of attention
- text processing
- computational linguistics
- named entity recognition
- data sets
- reeb graph
- part of speech
- machine translation
- question answering
- neural network
- small world
- ontology learning
- named entities
- genetic algorithm
- parallel thinning algorithm
- data mining