Meanings and Feelings of Large Language Models: Observability of Latent States in Generative AI.
Tian Yu LiuStefano SoattoMatteo MarchiPratik ChaudhariPaulo TabuadaPublished in: CoRR (2024)
Keyphrases
- language model
- language modeling
- probabilistic model
- document retrieval
- generative model
- n gram
- latent variables
- retrieval model
- speech recognition
- information retrieval
- query expansion
- language modeling framework
- language modelling
- context sensitive
- statistical language models
- test collection
- language models for information retrieval
- language model for information retrieval
- pseudo relevance feedback
- vector space model
- mixture model
- natural language
- relevance model
- query specific
- document length
- okapi bm
- translation model
- document ranking
- smoothing methods
- web pages
- search engine