What Events Do Pre-trained Language Models Learn from Text? Probing Event-Based Commonsense Knowledge by Confidence Sorting.
Jiachun LiChenhao WangYubo ChenKang LiuJun ZhaoPublished in: NLPCC (1) (2023)
Keyphrases
- language model
- pre trained
- commonsense knowledge
- information retrieval
- language modeling
- training data
- n gram
- probabilistic model
- commonsense reasoning
- information gathering
- speech recognition
- query expansion
- training examples
- retrieval model
- language understanding
- test collection
- text mining
- smoothing methods
- automated reasoning
- control signals
- information retrieval systems
- relevance model
- machine learning