Neural Architecture Search for Parameter-Efficient Fine-tuning of Large Pre-trained Language Models.
Neal LawtonAnoop KumarGovind ThattaiAram GalstyanGreg Ver SteegPublished in: CoRR (2023)
Keyphrases
- fine tuning
- language model
- neural architecture
- language modeling
- pre trained
- speech recognition
- document retrieval
- probabilistic model
- retrieval model
- information retrieval
- document ranking
- n gram
- search space
- test collection
- query expansion
- feed forward
- smoothing methods
- neural network
- language models for information retrieval
- relevance model
- text classification