HistBERT: A Pre-trained Language Model for Diachronic Lexical Semantic Analysis.
Wenjun QiuYang XuPublished in: CoRR (2022)
Keyphrases
- semantic analysis
- language model
- pre trained
- natural language processing
- context sensitive
- parse tree
- language modeling
- semantic information
- wordnet
- training data
- n gram
- natural language
- training examples
- probabilistic model
- information retrieval
- query expansion
- speech recognition
- information extraction
- retrieval model
- query terms
- semantic relations
- keywords
- control signals
- word sense disambiguation
- pseudo relevance feedback
- machine learning
- contextual information
- high level
- artificial intelligence
- translation model
- smoothing methods
- information retrieval systems