Semantic Text Transmission via Prediction with Small Language Models: Cost-Similarity Trade-off.
Bhavani A MadhabhaviGangadhar KarevvanavarRajshekhar V. BhatNikolaos PappasPublished in: CoRR (2024)
Keyphrases
- language model
- trade off
- information retrieval
- language modeling
- semantic similarity
- document retrieval
- semantic information
- n gram
- probabilistic model
- document level
- statistical language models
- retrieval model
- language modelling
- prediction accuracy
- speech recognition
- query expansion
- text retrieval
- multiword
- word pairs
- test collection
- similarity measurement
- vector space model
- similarity measure
- query terms
- pseudo relevance feedback
- text mining
- translation model
- natural language
- smoothing methods
- passage retrieval
- relevance model
- language models for information retrieval
- document ranking
- text documents
- distance measure
- search engine
- document representation
- context dependent
- retrieval effectiveness
- document collections
- wordnet
- information retrieval systems
- natural language processing
- information extraction
- okapi bm