From Prejudice to Parity: A New Approach to Debiasing Large Language Model Word Embeddings.
Aishik RakshitSmriti SinghShuvam KeshariArijit Ghosh ChowdhuryVinija JainAman ChadhaPublished in: CoRR (2024)
Keyphrases
- language model
- n gram
- translation model
- language modeling
- word clouds
- multiword
- word error rate
- speech recognition
- language modelling
- out of vocabulary
- document retrieval
- statistical machine translation
- probabilistic model
- statistical language modeling
- information retrieval
- retrieval model
- word segmentation
- context sensitive
- co occurrence
- mixture model
- query expansion
- word recognition
- term weighting
- query terms
- low dimensional
- smoothing methods
- ad hoc information retrieval
- language models for information retrieval
- automatic speech recognition
- vector space model
- word level
- statistical model
- text categorization
- cross language information retrieval
- dimensionality reduction
- document length
- statistical language models
- natural language processing
- relevance model