The First to Know: How Token Distributions Reveal Hidden Knowledge in Large Vision-Language Models?
Qinyu ZhaoMing XuKartik GuptaAkshay AsthanaLiang ZhengStephen GouldPublished in: CoRR (2024)
Keyphrases
- language model
- hidden knowledge
- language modeling
- probabilistic model
- information retrieval
- document retrieval
- n gram
- retrieval model
- language modelling
- statistical language models
- query expansion
- speech recognition
- language models for information retrieval
- test collection
- context sensitive
- smoothing methods
- okapi bm
- vector space model
- pseudo relevance feedback
- word error rate
- language model for information retrieval
- document ranking
- translation model
- term dependencies
- information extraction
- knn
- hidden markov models
- ad hoc information retrieval
- data mining
- real world