Exposing Attention Glitches with Flip-Flop Language Modeling.
Bingbin LiuJordan T. AshSurbhi GoelAkshay KrishnamurthyCyril ZhangPublished in: NeurIPS (2023)
Keyphrases
- language modeling
- language model
- information retrieval
- query expansion
- retrieval model
- probabilistic model
- n gram
- cross lingual
- flip flops
- statistical language models
- statistical language modeling
- word segmentation
- text classification
- relevance model
- translation model
- test collection
- retrieval effectiveness
- vector space
- document retrieval
- sentence retrieval
- dirichlet prior
- mixture model