Exposing Attention Glitches with Flip-Flop Language Modeling.
Bingbin LiuJordan T. AshSurbhi GoelAkshay KrishnamurthyCyril ZhangPublished in: CoRR (2023)
Keyphrases
- language modeling
- language model
- information retrieval
- query expansion
- retrieval model
- cross lingual
- n gram
- probabilistic model
- statistical language models
- text classification
- improvements in retrieval effectiveness
- relevance model
- mixture model
- word segmentation
- neural network
- flip flops
- document retrieval
- document collections
- signal processing
- sentence retrieval
- real time