An Empirical Analysis of Memorization in Fine-tuned Autoregressive Language Models.
Fatemehsadat MireshghallahArchit UniyalTianhao WangDavid EvansTaylor Berg-KirkpatrickPublished in: EMNLP (2022)
Keyphrases
- autoregressive
- language model
- fine tuned
- fine tuning
- language modeling
- moving average
- non stationary
- n gram
- gaussian markov random field
- document retrieval
- speech recognition
- information retrieval
- probabilistic model
- domain specific
- retrieval model
- context sensitive
- random fields
- language modelling
- statistical language models
- test collection
- query expansion
- smoothing methods
- sar images
- document ranking
- language models for information retrieval
- relevance model
- pseudo relevance feedback
- multiscale
- image segmentation
- image processing
- co occurrence
- graphical models
- maximum entropy
- feature selection
- machine learning