Diffusion Theory as a Scalpel: Detecting and Purifying Poisonous Dimensions in Pre-trained Language Models Caused by Backdoor or Bias.
Zhiyuan ZhangDeli ChenHao ZhouFandong MengJie ZhouXu SunPublished in: CoRR (2023)
Keyphrases
- language model
- pre trained
- language modeling
- n gram
- language modelling
- probabilistic model
- speech recognition
- retrieval model
- statistical language models
- information retrieval
- test collection
- document retrieval
- document ranking
- query expansion
- language models for information retrieval
- smoothing methods
- training data
- training examples
- machine learning
- relevance model
- multimedia
- statistical language modeling
- data sets