Semantic Text Transmission via Prediction with Small Language Models: Cost-Similarity Trade-off.
Bhavani A MadhabhaviGangadhar KarevvanavarRajshekhar V. BhatNikolaos PappasPublished in: ICC Workshops (2024)
Keyphrases
- language model
- trade off
- information retrieval
- language modeling
- semantic similarity
- semantic information
- document retrieval
- document level
- n gram
- prediction accuracy
- language modelling
- query expansion
- test collection
- statistical language models
- retrieval model
- probabilistic model
- text retrieval
- word pairs
- relevance model
- speech recognition
- multiword
- language models for information retrieval
- similarity measure
- context sensitive
- document representation
- query terms
- vector space model
- document similarity
- smoothing methods
- web documents
- document ranking
- co occurrence
- okapi bm
- improve retrieval effectiveness
- low level features
- document structure
- keywords