Mind the Privacy Unit! User-Level Differential Privacy for Language Model Fine-Tuning.
Lynn ChuaBadih GhaziYangsibo HuangPritish KamathDaogao LiuPasin ManurangsiAmer SinhaChiyuan ZhangPublished in: CoRR (2024)
Keyphrases
- differential privacy
- language model
- fine tuning
- differentially private
- privacy preserving
- language modeling
- search logs
- query expansion
- private data
- n gram
- privacy guarantees
- probabilistic model
- privacy preservation
- information retrieval
- retrieval model
- anonymized data
- data privacy
- data sharing
- document retrieval
- test collection
- smoothing methods
- personal information
- translation model
- recommender systems
- data quality
- privacy preserving data mining
- query terms
- information retrieval systems
- web search
- relevance feedback
- data publishing
- feature selection
- data mining