Rethinking Learning Rate Tuning in the Era of Large Language Models.
Hongpeng JinWenqi WeiXuyu WangWenbin ZhangYanzhao WuPublished in: CoRR (2023)
Keyphrases
- learning rate
- language model
- language modeling
- convergence rate
- learning algorithm
- n gram
- probabilistic model
- query expansion
- speech recognition
- document retrieval
- retrieval model
- convergence speed
- rapid convergence
- information retrieval
- multilayer neural networks
- language modelling
- test collection
- adaptive learning rate
- document ranking
- context sensitive
- statistical language models
- convergence theorem
- weight vector
- okapi bm
- language model for information retrieval
- pseudo relevance feedback
- vector space model
- query terms
- translation model
- relevance model
- question answering