Balaur: Language Model Pretraining with Lexical Semantic Relations.
Andrei MirceaJackie C. K. CheungPublished in: EMNLP (Findings) (2023)
Keyphrases
- semantic relations
- language model
- wordnet
- language modeling
- co occurrence
- n gram
- natural language processing
- probabilistic model
- semantic network
- document retrieval
- relation extraction
- information retrieval
- retrieval model
- test collection
- context sensitive
- semantic relationships
- word pairs
- knowledge sources
- query expansion
- lexical chains
- query terms
- semantic roles
- relevance model
- semantic relatedness between words
- smoothing methods
- word sense disambiguation
- web pages
- translation model
- query specific
- document representation
- knowledge representation